Integrating service development with evaluation in telehealthcare: an ethnographic study.

PubMed

Finch, Tracy; May, Carl; Mair, Frances; Mort, Maggie; Gask, Linda

2003-11-22

To identify issues that facilitate the successful integration of evaluation and development of telehealthcare services. Ethnographic study using various qualitative research techniques to obtain data from several sources, including in-depth semistructured interviews, project steering group meetings, and public telehealthcare meetings. Seven telehealthcare evaluation projects (four randomised controlled trials and three pragmatic service evaluations) in the United Kingdom, studied over two years. Projects spanned a range of specialties-dermatology, psychiatry, respiratory medicine, cardiology, and oncology. Clinicians, managers, technical experts, and researchers involved in the projects. Key problems in successfully integrating evaluation and service development in telehealthcare are, firstly, defining existing clinical practices (and anticipating changes) in ways that permit measurement; secondly, managing additional workload and conflicting responsibilities brought about by combining clinical and research responsibilities (including managing risk); and, thirdly, understanding various perspectives on effectiveness and the limitations of evaluation results beyond the context of the research study. Combined implementation and evaluation of telehealthcare systems is complex, and is often underestimated. The distinction between quantitative outcomes and the workability of the system is important for producing evaluative knowledge that is of practical value. More pragmatic approaches to evaluation, that permit both quantitative and qualitative methods, are required to improve the quality of such research and its relevance for service provision in the NHS.

Evaluating Research Articles from Start to Finish.

ERIC Educational Resources Information Center

Girden, Ellen R.

This book in intended to train students in reading a research report critically. It uses actual research articles as examples including both good and flawed studies in each category and provides interpretation and evaluation of the appropriateness of the statistical analyses in each study. Individual chapters usually include two sample studies and…

A Study of Facilities and Infrastructure Planning, Prioritization, and Assessment at Federal Security Laboratories

DTIC Science & Technology

2012-11-01

Research , Development, Test , and Evaluation (RDT&E) Appropriations The RDT&E appropriation consists of the mission program budgets for all... research , development, test and evaluation work performed by contractors and government installations and includes an installations and activities budget...than $4,000,000. 9 f. Research , Development, Test , and Evaluation Appropriations The Research , Development, Test , and Evaluation (RDT&E

Critiquing qualitative research.

PubMed

Beck, Cheryl Tatano

2009-10-01

The ability to critique research is a valuable skill that is fundamental to a perioperative nurse's ability to base his or her clinical practice on evidence derived from research. Criteria differ for critiquing a quantitative versus a qualitative study (ie, statistics are evaluated in a quantitative study, but not in a qualitative study). This article provides on guidelines for assessing qualitative research. Excerpts from a published qualitative research report are summarized and then critiqued. Questions are provided that help evaluate different sections of a research study (eg, sample, data collection methods, data analysis).

Youth participatory research and evaluation to inform a Chagas disease prevention program in Ecuador.

PubMed

Marco-Crespo, Belén; Casapulla, Sharon; Nieto-Sanchez, Claudia; Urrego, J Guillermo Gómez; Grijalva, Mario J

2018-04-30

This qualitative study engaged a group of young people in participatory research and evaluation activities in order to study to what extent engaging youth in health interventions can inform research and evaluation processes. We applied a youth participatory research and evaluation approach (PRE) to inform research and evaluation on the impact of a Chagas disease control program in southern Ecuador. Our main interest was to examine the methodological contributions of PRE to knowledge sharing for health intervention planning in the context of global health and neglected tropical diseases. The results of this study suggest that by demystifying research and evaluation practices and rendering them accessible and relevant, marginalized youth can develop critical and reflexive thinking skills that could be useful for decision-making on health promotion. Our findings also reveal the potential of youth as active participants in project development in ways that enhance, validate, and improve health interventions. Young people are interested in learning about and sharing local knowledge that can benefit research and evaluation processes. Despite the numerous strengths demonstrated by PRE, the inherent complexities of international development, such as cultural differences, asymmetrical power relations, and the ongoing challenges of sustainability, remain. Copyright © 2018 Elsevier Ltd. All rights reserved.

User Experience Evaluations in Rehabilitation Video Games for Children: A Systematic Mapping of the Literature.

PubMed

Rico-Olarte, Carolina; López, Diego M; Blobel, Bernd; Kepplinger, Sara

2017-01-01

In recent years, the interest in user experience (UX) evaluation methods for assessing technology solutions, especially in health systems for children with special needs like cognitive disabilities, has increased. Conduct a systematic mapping study to provide an overview in the field of UX evaluations in rehabilitation video games for children. The definition of research questions, the search for primary studies and the extraction of those studies by inclusion and exclusion criteria lead to the mapping of primary papers according to a classification scheme. Main findings from this study include the detection of the target population of the selected studies, the recognition of two different ways of evaluating UX: (i) user evaluation and (ii) system evaluation, and UX measurements and devices used. This systematic mapping specifies the research gaps identified for future research works in the area.

Helping Students Evaluate the Validity of a Research Study.

ERIC Educational Resources Information Center

Morgan, George A.; Gliner, Jeffrey A.

Students often have difficulty in evaluating the validity of a study. A conceptually and linguistically meaningful framework for evaluating research studies is proposed that is based on the discussion of internal and external validity of T. D. Cook and D. T. Campbell (1979). The proposal includes six key dimensions, three related to internal…

Evaluating Mixed Research Studies: A Mixed Methods Approach

ERIC Educational Resources Information Center

Leech, Nancy L.; Dellinger, Amy B.; Brannagan, Kim B.; Tanaka, Hideyuki

2010-01-01

The purpose of this article is to demonstrate application of a new framework, the validation framework (VF), to assist researchers in evaluating mixed research studies. Based on an earlier work by Dellinger and Leech, a description of the VF is delineated. Using the VF, three studies from education, health care, and counseling fields are…

Evaluation of university scientific research ability based on the output of sci-tech papers: A D-AHP approach.

PubMed

Zong, Fan; Wang, Lifang

2017-01-01

University scientific research ability is an important indicator to express the strength of universities. In this paper, the evaluation of university scientific research ability is investigated based on the output of sci-tech papers. Four university alliances from North America, UK, Australia, and China, are selected as the case study of the university scientific research evaluation. Data coming from Thomson Reuters InCites are collected to support the evaluation. The work has contributed new framework to the issue of university scientific research ability evaluation. At first, we have established a hierarchical structure to show the factors that impact the evaluation of university scientific research ability. Then, a new MCDM method called D-AHP model is used to implement the evaluation and ranking of different university alliances, in which a data-driven approach is proposed to automatically generate the D numbers preference relations. Next, a sensitivity analysis has been given to show the impact of weights of factors and sub-factors on the evaluation result. At last, the results obtained by using different methods are compared and discussed to verify the effectiveness and reasonability of this study, and some suggestions are given to promote China's scientific research ability.

Institute for Developmental Studies Interim Progress Report. Part II: Research and Evaluation.

ERIC Educational Resources Information Center

Deutsch, Martin; And Others

The Institute for Developmental Studies (IDS) is engaged in research aimed at specifying what the academic handicaps of deprived children are, what causes these handicaps, and what can be done to overcome them. This IDS report on their research and evaluation program is divided into two sections. The first, "Summaries of Basic Research, Applied…

Testimony in Narrative Educational Research: A Qualitative Interview, Narrative Analysis and Epistemological Evaluation

ERIC Educational Resources Information Center

Christopher, Justin

2017-01-01

The purpose of this study is to assess issues that arise in the context of epistemological claims in narrative educational research by means of narrative analysis and epistemological evaluation. The research questions which guided the study were: 1) To what extent is epistemology considered by narrative educational researchers?; 2) What issues do…

A Decade of Research on Evaluation: A Systematic Review of Research on Evaluation Published between 2005 and 2014

ERIC Educational Resources Information Center

Coryn, Chris L. S.; Wilson, Lyssa N.; Westine, Carl D.; Hobson, Kristin A.; Ozeki, Satoshi; Fiekowsky, Erica L.; Greenman, Gregory D., II; Schröter, Daniela C.

2017-01-01

Although investigations into evaluation theories, methods, and practices have been occurring since the late 1970s, research on evaluation (RoE) has seemingly increased in the past decade. In this review, 257 studies published in 14 evaluation-focused journals over a 10-year period (between 2005 and 2014) were identified as RoE and then classified…

Integrating service development with evaluation in telehealthcare: an ethnographic study

PubMed Central

Finch, Tracy; May, Carl; Mair, Frances; Mort, Maggie; Gask, Linda

2003-01-01

Objectives To identify issues that facilitate the successful integration of evaluation and development of telehealthcare services. Design Ethnographic study using various qualitative research techniques to obtain data from several sources, including in-depth semistructured interviews, project steering group meetings, and public telehealthcare meetings. Setting Seven telehealthcare evaluation projects (four randomised controlled trials and three pragmatic service evaluations) in the United Kingdom, studied over two years. Projects spanned a range of specialties—dermatology, psychiatry, respiratory medicine, cardiology, and oncology. Participants Clinicians, managers, technical experts, and researchers involved in the projects. Results and discussion Key problems in successfully integrating evaluation and service development in telehealthcare are, firstly, defining existing clinical practices (and anticipating changes) in ways that permit measurement; secondly, managing additional workload and conflicting responsibilities brought about by combining clinical and research responsibilities (including managing risk); and, thirdly, understanding various perspectives on effectiveness and the limitations of evaluation results beyond the context of the research study. Conclusions Combined implementation and evaluation of telehealthcare systems is complex, and is often underestimated. The distinction between quantitative outcomes and the workability of the system is important for producing evaluative knowledge that is of practical value. More pragmatic approaches to evaluation, that permit both quantitative and qualitative methods, are required to improve the quality of such research and its relevance for service provision in the NHS. PMID:14630758

Evaluation of doctoral nursing programs in Japan by faculty members and their educational and research activities.

PubMed

Arimoto, Azusa; Gregg, Misuzu F; Nagata, Satoko; Miki, Yuko; Murashima, Sachiyo

2012-07-01

Evaluation of doctoral programs in nursing is becoming more important with the rapid increase in the programs in Japan. This study aimed to evaluate doctoral nursing programs by faculty members and to analyze the relationship of the evaluation with educational and research activities of faculty members in Japan. Target settings were all 46 doctoral nursing programs. Eighty-five faculty members from 28 programs answered the questionnaire, which included 17 items for program evaluation, 12 items for faculty evaluation, 9 items for resource evaluation, 3 items for overall evaluations, and educational and research activities. A majority gave low evaluations for sources of funding, the number of faculty members and support staff, and administrative systems. Faculty members who financially supported a greater number of students gave a higher evaluation for extramural funding support, publication, provision of diverse learning experiences, time of supervision, and research infrastructure. The more time a faculty member spent on advising doctoral students, the higher were their evaluations on the supportive learning environment, administrative systems, time of supervision, and timely feedback on students' research. The findings of this study indicate a need for improvement in research infrastructure, funding sources, and human resources to achieve quality nursing doctoral education in Japan. Copyright © 2011 Elsevier Ltd. All rights reserved.

Traffic control device evaluation program: simulator evaluation of sponsored changeable message signs and in-situ evaluation of rumble strip alternatives.

DOT National Transportation Integrated Search

2016-07-01

This report describes two research activities. One research study tested the effects of adding commercial : logos acknowledging sponsorship to Changeable Message Signs. A driving simulator study was conducted : using test signs with travel times and ...

A lifestyle intervention study targeting individuals with low socioeconomic status of different ethnic origins: important aspects for successful implementation.

PubMed

Teuscher, Dorit; Bukman, Andrea J; van Baak, Marleen A; Feskens, Edith J M; Renes, Reint Jan; Meershoek, Agnes

2017-07-25

Evaluation of the implementation process of trials is important, because the way a study is implemented modifies its outcomes. Furthermore, lessons learned during implementation can inform other researchers on factors that play a role when implementing interventions described in research. This study evaluates the implementation of the MetSLIM study, targeting individuals with low socioeconomic status of different ethnic origins. The MetSLIM study was set up to evaluate the effectiveness of a lifestyle programme on waist circumference and other cardio-metabolic risk factors. The objective of this evaluation was to identify components that were essential for the implementation of the MetSLIM study and to inform other researchers on methodological aspects when working with inadequately reached populations in health research. In this evaluation study the experiences of health professionals, study assistants, a community worker and regional research coordinators involved in the MetSLIM study were explored using semi-structured interviews. Questionnaires were used to evaluate participants' satisfaction with the lifestyle intervention. Our analyses show that a flexible recruitment protocol eventually leads to recruitment of sufficient participants; that trust in the recruiter is an important factor in the recruitment of individuals with low socioeconomic status of different ethnic origins; and that health professionals will unavoidably shape the form of intervention activities. Furthermore, our evaluation shows that daily practice and research mutually influence each other and that the results of an intervention are a product of this interaction. Health promotion research would benefit from a perspective that sees intervention activities not as fixed entities but rather as social interaction that can take on numerous forms. Analysing and reporting the implementation process of studies, like in this evaluation, will allow readers to get a detailed view on the appropriateness of the (intended) study design and intervention for the targeted population. Evaluation studies that shed light on the reasons for adaptations, rather than describing them as deviation from the original plan, would point out methodological aspects important for a study's replication. Furthermore, they would show how various factors can influence the implementation, and therewith initiate a learning cycle for the development of future intervention studies. Netherlands Trial Register NTR3721 (since November 27, 2012).

Designing, Teaching, and Evaluating Two Complementary Mixed Methods Research Courses

ERIC Educational Resources Information Center

Christ, Thomas W.

2009-01-01

Teaching mixed methods research is difficult. This longitudinal explanatory study examined how two classes were designed, taught, and evaluated. Curriculum, Research, and Teaching (EDCS-606) and Mixed Methods Research (EDCS-780) used a research proposal generation process to highlight the importance of the purpose, research question and…

Methodological Challenges in Cross-Language Qualitative Research: A Research Review

PubMed Central

Squires, Allison

2009-01-01

Objectives Cross-language qualitative research occurs when a language barrier is present between researchers and participants. The language barrier is frequently mediated through the use of a translator or interpreter. The purpose of this critical review of cross-language qualitative research was three fold: 1) review the methods literature addressing cross language research; 2) synthesize the methodological recommendations from the literature into a list of criteria that could evaluate how researchers methodologically managed translators and interpreters in their qualitative studies; and 3) test these criteria on published cross-language qualitative studies. Data sources A group of 40 purposively selected cross-language qualitative studies found in nursing and health sciences journals. Review methods The synthesis of the cross-language methods literature produced 14 criteria to evaluate how qualitative researchers managed the language barrier between themselves and their study participants. To test the criteria, the researcher conducted a summative content analysis framed by discourse analysis techniques of the 40 cross-language studies. Results The evaluation showed that only 6 out of 40 studies met all the criteria recommended by the cross-language methods literature for the production of trustworthy results in cross-language qualitative studies. Multiple inconsistencies, reflecting disadvantageous methodological choices by cross-language researchers, appeared in the remaining 33 studies. To name a few, these included rendering the translator or interpreter as an invisible part of the research process, failure to pilot test interview questions in the participant’s language, no description of translator or interpreter credentials, failure to acknowledge translation as a limitation of the study, and inappropriate methodological frameworks for cross-language research. Conclusions The finding about researchers making the role of the translator or interpreter invisible during the research process supports studies completed by other authors examining this issue. The analysis demonstrated that the criteria produced by this study may provide useful guidelines for evaluating cross-language research and for novice cross-language researchers designing their first studies. Finally, the study also indicates that researchers attempting cross-language studies need to address the methodological issues surrounding language barriers between researchers and participants more systematically. PMID:18789799

Methodological challenges in cross-language qualitative research: a research review.

PubMed

Squires, Allison

2009-02-01

Cross-language qualitative research occurs when a language barrier is present between researchers and participants. The language barrier is frequently mediated through the use of a translator or interpreter. The purpose of this analysis of cross-language qualitative research was threefold: (1) review the methods literature addressing cross-language research; (2) synthesize the methodological recommendations from the literature into a list of criteria that could evaluate how researchers methodologically managed translators and interpreters in their qualitative studies; (3) test these criteria on published cross-language qualitative studies. A group of 40 purposively selected cross-language qualitative studies found in nursing and health sciences journals. The synthesis of the cross-language methods literature produced 14 criteria to evaluate how qualitative researchers managed the language barrier between themselves and their study participants. To test the criteria, the researcher conducted a summative content analysis framed by discourse analysis techniques of the 40 cross-language studies. The evaluation showed that only 6 out of 40 studies met all the criteria recommended by the cross-language methods literature for the production of trustworthy results in cross-language qualitative studies. Multiple inconsistencies, reflecting disadvantageous methodological choices by cross-language researchers, appeared in the remaining 33 studies. To name a few, these included rendering the translator or interpreter as an invisible part of the research process, failure to pilot test interview questions in the participant's language, no description of translator or interpreter credentials, failure to acknowledge translation as a limitation of the study, and inappropriate methodological frameworks for cross-language research. The finding about researchers making the role of the translator or interpreter invisible during the research process supports studies completed by other authors examining this issue. The analysis demonstrated that the criteria produced by this study may provide useful guidelines for evaluating cross-language research and for novice cross-language researchers designing their first studies. Finally, the study also indicates that researchers attempting cross-language studies need to address the methodological issues surrounding language barriers between researchers and participants more systematically.

Usability Study and Heuristic Evaluation of the Applied Robotics for Installations and Base Operations (ARIBO) Driverless Vehicle Reservation Application ARIBO Mobile

DTIC Science & Technology

2017-03-01

ARL-TN-0814 ● MAR 2017 US Army Research Laboratory Usability Study and Heuristic Evaluation of the Applied Robotics for...ARL-TN-0814 ● MAR 2017 US Army Research Laboratory Usability Study and Heuristic Evaluation of the Applied Robotics for...Heuristic Evaluation of the Applied Robotics for Installations and Base Operations (ARIBO) Driverless Vehicle Reservation Application ARIBO Mobile 5a

High-Alpha Handling Qualities Flight Research on the NASA F/A-18 High Alpha Research Vehicle

NASA Technical Reports Server (NTRS)

Wichman, Keith D.; Pahle, Joseph W.; Bahm, Catherine; Davidson, John B.; Bacon, Barton J.; Murphy, Patrick C.; Ostroff, Aaron J.; Hoffler, Keith D.

1996-01-01

A flight research study of high-angle-of-attack handling qualities has been conducted at the NASA Dryden Flight Research Center using the F/A-18 High Alpha Research Vehicle (HARV). The objectives were to create a high-angle-of-attack handling qualities flight database, develop appropriate research evaluation maneuvers, and evaluate high-angle-of-attack handling qualities guidelines and criteria. Using linear and nonlinear simulations and flight research data, the predictions from each criterion were compared with the pilot ratings and comments. Proposed high-angle-of-attack nonlinear design guidelines and proposed handling qualities criteria and guidelines developed using piloted simulation were considered. Recently formulated time-domain Neal-Smith guidelines were also considered for application to high-angle-of-attack maneuvering. Conventional envelope criteria were evaluated for possible extension to the high-angle-of-attack regime. Additionally, the maneuvers were studied as potential evaluation techniques, including a limited validation of the proposed standard evaluation maneuver set. This paper gives an overview of these research objectives through examples and summarizes result highlights. The maneuver development is described briefly, the criteria evaluation is emphasized with example results given, and a brief discussion of the database form and content is presented.

Systematic review of methods for evaluating healthcare research economic impact

PubMed Central

2010-01-01

Background The economic benefits of healthcare research require study so that appropriate resources can be allocated to this research, particularly in developing countries. As a first step, we performed a systematic review to identify the methods used to assess the economic impact of healthcare research, and the outcomes. Method An electronic search was conducted in relevant databases using a combination of specific keywords. In addition, 21 relevant Web sites were identified. Results The initial search yielded 8,416 articles. After studying titles, abstracts, and full texts, 18 articles were included in the analysis. Eleven other reports were found on Web sites. We found that the outcomes assessed as healthcare research payback included direct cost-savings, cost reductions in healthcare delivery systems, benefits from commercial advancement, and outcomes associated with improved health status. Two methods were used to study healthcare research payback: macro-economic studies, which examine the relationship between research studies and economic outcome at the aggregated level, and case studies, which examine specific research projects to assess economic impact. Conclusions Our study shows that different methods and outcomes can be used to assess the economic impacts of healthcare research. There is no unique methodological approach for the economic evaluation of such research. In our systematic search we found no research that had evaluated the economic return of research in low and middle income countries. We therefore recommend a consensus on practical guidelines at international level on the basis of more comprehensive methodologies (such as Canadian Academic of Health Science and payback frameworks) in order to build capacity, arrange for necessary informative infrastructures and promote necessary skills for economic evaluation studies. PMID:20196839

Evaluation of university scientific research ability based on the output of sci-tech papers: A D-AHP approach

PubMed Central

Wang, Lifang

2017-01-01

University scientific research ability is an important indicator to express the strength of universities. In this paper, the evaluation of university scientific research ability is investigated based on the output of sci-tech papers. Four university alliances from North America, UK, Australia, and China, are selected as the case study of the university scientific research evaluation. Data coming from Thomson Reuters InCites are collected to support the evaluation. The work has contributed new framework to the issue of university scientific research ability evaluation. At first, we have established a hierarchical structure to show the factors that impact the evaluation of university scientific research ability. Then, a new MCDM method called D-AHP model is used to implement the evaluation and ranking of different university alliances, in which a data-driven approach is proposed to automatically generate the D numbers preference relations. Next, a sensitivity analysis has been given to show the impact of weights of factors and sub-factors on the evaluation result. At last, the results obtained by using different methods are compared and discussed to verify the effectiveness and reasonability of this study, and some suggestions are given to promote China’s scientific research ability. PMID:28212446

Assessing Statistical Change Indices in Selected Social Work Intervention Research Studies

ERIC Educational Resources Information Center

Ham, Amanda D.; Huggins-Hoyt, Kimberly Y.; Pettus, Joelle

2016-01-01

Objectives: This study examined how evaluation and intervention research (IR) studies assessed statistical change to ascertain effectiveness. Methods: Studies from six core social work journals (2009-2013) were reviewed (N = 1,380). Fifty-two evaluation (n= 27) and intervention (n = 25) studies met the inclusion criteria. These studies were…

Methodological quality and scientific impact of quantitative nursing education research over 18 months.

PubMed

Yucha, Carolyn B; Schneider, Barbara St Pierre; Smyer, Tish; Kowalski, Susan; Stowers, Eva

2011-01-01

The methodological quality of nursing education research has not been rigorously studied. The purpose of this study was to evaluate the methodological quality and scientific impact of nursing education research reports. The methodological quality of 133 quantitative nursing education research articles published between July 2006 and December 2007 was evaluated using the Medical Education Research Study Quality Instrument (MERSQI).The mean (+/- SD) MERSQI score was 9.8 +/- 2.2. It correlated (p < .05) with several scientific impact indicators: citation counts from Scopus (r = .223), Google Scholar (r = .224), and journal impact factor (r = .216); it was not associated with Web of Science citation count, funding, or h Index. The similarities between this study's MERSQI ratings for nursing literature and those reported for the medical literature, coupled with the association with citation counts, suggest that the MERSQI is an appropriate instrument to evaluate the quality of nursing education research.

Evaluation through Follow-Up of Students (UGU). Project No. 2119. Current Project 1983:4.

ERIC Educational Resources Information Center

Ljung, Bengt-Olov; Emanuelsson, Ingemar

1983-01-01

This newsletter describes a research design enabling descriptive, comparative, evaluative follow-up studies of individual development in social contexts related to schooling. In addition, it describes a research project focusing mainly on evaluative studies of the ability of the educational system to confer, on different individuals in various…

Consider the source: persuasion of implicit evaluations is moderated by source credibility.

PubMed

Smith, Colin Tucker; De Houwer, Jan; Nosek, Brian A

2013-02-01

The long history of persuasion research shows how to change explicit, self-reported evaluations through direct appeals. At the same time, research on how to change implicit evaluations has focused almost entirely on techniques of retraining existing evaluations or manipulating contexts. In five studies, we examined whether direct appeals can change implicit evaluations in the same way as they do explicit evaluations. In five studies, both explicit and implicit evaluations showed greater evidence of persuasion following information presented by a highly credible source than a source low in credibility. Whereas cognitive load did not alter the effect of source credibility on explicit evaluations, source credibility had an effect on the persuasion of implicit evaluations only when participants were encouraged and able to consider information about the source. Our findings reveal the relevance of persuasion research for changing implicit evaluations and provide new ideas about the processes underlying both types of evaluation.

A review of ride comfort studies in the United Kingdom

NASA Technical Reports Server (NTRS)

Griffin, M. J.

1975-01-01

United Kingdom research which is relevant to the assessment of vehicle ride comfort was reviewed. The findings reported in approximately 80 research papers are outlined, and an index to the areas of application of these studies is provided. The data obtained by different research groups are compared, and it is concluded that, while there are some areas of general agreement, the findings obtained from previous United Kingdom research are insufficient to define a general purpose ride comfort evaluation procedure. The degree to which United Kingdom research supports the vibration evaluation procedure defined in the current International Standard on the evaluation of human exposure to whole-body vibration is discussed.

Evaluating Prior Scholarship in Literature Reviews of Research Articles: A Comparative Study of Practices in Two Research Paradigms

ERIC Educational Resources Information Center

Kwan, Becky S. C.; Chan, Hang; Lam, Colin

2012-01-01

Evaluations of prior scholarship play a crucial role in the literature review (LR) of a research article by showing how the boundary of an area of inquiry can be further advanced by the writer's work. Yet, many inexperienced writers find evaluating others' work a major challenge. Although the task has received some attention in research and…

Evaluation of Psychological Hardiness and Coping Style as Risk/Resilience Factors for Health Risk Behaviour

DTIC Science & Technology

2011-04-01

205 RESEARCH DESIGN & METHODS Objective/Hypothesis: The objective of the study is to evaluate the utility of a short hardiness-resilience...problems. Study Design & Methods : This research will evaluate the utility of hardiness, as measured by the DRS-15R, as a screening tool for...may take a toll on defense workers. This research points the way to new approaches for early identification of military workers at risk for stress

76 FR 18226 - Guidance for Industry on Postmarketing Studies and Clinical Trials-Implementation of Section 505...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-04-01

... and Development (HFM-40), Center for Biologics Evaluation and Research (CBER), Food and Drug... Drug Information, Center for Drug Evaluation and Research, Food and Drug Administration, 10903 New..., Center for Drug Evaluation and Research, Food and Drug Administration, 10903 New Hampshire Ave., Bldg. 51...

Evaluation of a Research Mentorship Program in Community Care

ERIC Educational Resources Information Center

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

How Does Research Evaluation Impact Educational Research? Exploring Intended and Unintended Consequences of Research Assessment in the United Kingdom, 1986-2014

ERIC Educational Resources Information Center

Marques, Marcelo; Powell, Justin J. W.; Zapp, Mike; Biesta, Gert

2017-01-01

Research evaluation systems in many countries aim to improve the quality of higher education. Among the first of such systems, the UK's Research Assessment Exercise (RAE) dating from 1986 is now the Research Excellence Framework (REF). Highly institutionalised, it transforms research to be more accountable. While numerous studies describe the…

The impact of consumer involvement in research: an evaluation of consumer involvement in the London Primary Care Studies Programme.

PubMed

Wyatt, Katrina; Carter, Mary; Mahtani, Vinita; Barnard, Angela; Hawton, Annie; Britten, Nicky

2008-06-01

The value of consumer involvement in health services research is widely recognized. While there is a growing body of evidence about the principles of good consumer involvement, there is little research about the effect that involvement can have on the research. This evaluation assessed the level and impact of consumer involvement in the London Primary Care Studies Programme (LPCSP), all of whose individual projects had to demonstrate substantial involvement as a condition of funding. To evaluate consumer involvement in the LPSCP and understand what impact consumers had on the research process and outcomes. A multi-method case study approach was undertaken, using survey techniques, interviews, focus groups, observation and scrutiny of written documents. The overall data set comprised 61 questionnaires, 44 semi-structured interviews, 2 focus groups and 15 hours of observation of meetings. Eleven primary care-based research projects which together made up the LPCSP. An in-depth description of consumer involvement in the Programme was produced. Nine projects had consumers as co-applicants, four projects had been completed before the evaluation began and one was still ongoing at the time of the evaluation. Of the eight projects which have produced final reports, all met their aims and objectives. Consumers had had an additional impact in the research, in the initial design of the study, in recruitment of the research subjects, in developing data collection tools, in collecting the data, in analysis and disseminating the findings. Consumer involvement in National Health Service research is a relatively recent policy development and while there is an increasing amount of literature about how and why consumers should be involved in research, there is less evidence about the impact of such involvement. This evaluation provides evidence about the impact that consumers have not only on the research process but also on the outcomes of the research.

Development and evaluation of a study design typology for human research.

PubMed

Carini, Simona; Pollock, Brad H; Lehmann, Harold P; Bakken, Suzanne; Barbour, Edward M; Gabriel, Davera; Hagler, Herbert K; Harper, Caryn R; Mollah, Shamim A; Nahm, Meredith; Nguyen, Hien H; Scheuermann, Richard H; Sim, Ida

2009-11-14

A systematic classification of study designs would be useful for researchers, systematic reviewers, readers, and research administrators, among others. As part of the Human Studies Database Project, we developed the Study Design Typology to standardize the classification of study designs in human research. We then performed a multiple observer masked evaluation of active research protocols in four institutions according to a standardized protocol. Thirty-five protocols were classified by three reviewers each into one of nine high-level study designs for interventional and observational research (e.g., N-of-1, Parallel Group, Case Crossover). Rater classification agreement was moderately high for the 35 protocols (Fleiss' kappa = 0.442) and higher still for the 23 quantitative studies (Fleiss' kappa = 0.463). We conclude that our typology shows initial promise for reliably distinguishing study design types for quantitative human research.

New pathways in the evaluation of programmes for men who perpetrate violence against their female partners.

PubMed

Wojnicka, Katarzyna; Scambor, Christian; Kraus, Heinrich

2016-08-01

Today, evaluation research in the field of intervention programmes for men who perpetrate violence against their female partners still makes a fragmentary impression. Across Europe various evaluation studies have been performed. However, the methodologies applied are too heterogeneous to allow the combination of the results in a meta-analytical way. In this paper we propose a future pathway for organising outcome evaluation studies of domestic violence perpetrator programmes in community settings, so that today's problems in this field can be overcome. In a pragmatic framework that acknowledges the limited pre-conditions for evaluation studies in the area of domestic violence perpetrator programmes as it is today, feasible approaches for outcome evaluation are outlined, with recent developments in the field taken as starting points. The framework for organising future evaluation studies of work with perpetrators of domestic violence is presented together with a strategy to promote this framework. International networks of practitioners and researchers play a central role in this strategy through upskilling the area of practical work, preparing the ground for evaluation research and improving cooperation between practitioners and researchers. This paper is based on the results of the European funded project IMPACT (under the Daphne-III-funding programme of the European Commission). Copyright © 2016 Elsevier Ltd. All rights reserved.

A Study of Developing an Attitude Scale towards Authentic Learning Environments and Evaluation

ERIC Educational Resources Information Center

Çetinkaya, Murat

2018-01-01

The aim of the research is to improve a valid and reliable attributing scale which identifies authentic learning environments and evaluation attributes of the science teacher candidates. The study has been designed on the base of validity and reliability of the scale developed to evaluate the authentic learning environments. The research group is…

The Critical Research Evaluation Tool (CRET): A Teaching and Learning Tool to Evaluate Research for Cultural Competence.

PubMed

Love, Katie L

The aim of this study was to present the Critical Research Evaluation Tool (CRET) which teaches evaluation of the researchers' worldview, applicability to multicultural populations, and ethics surrounding potential harms to communities. To provide best cultural care nurses' need to understand how historical/social/political experiences impact health and also influence research. The Student using the CRET reported receiving a strong foundation in research fundamentals, gaining a better understanding of critical frameworks in research, and learning more about themselves and reflecting on their own privileges and biases. The CRET provides nursing students and nursing faculty with a tool for examining diversity and ultimately decreasing health disparity.

Taking stock of four decades of quantitative research on stakeholder participation and evaluation use: a systematic map.

PubMed

Daigneault, Pierre-Marc

2014-08-01

Stakeholder participation and evaluation use have attracted a lot of attention from practitioners, theorists and researchers. A common hypothesis is that participation is positively associated with evaluation use. Whereas the number of empirical studies conducted on this topic is impressive, quantitative research has held a minority position within this scientific production. This study mobilizes systematic review methods to 'map' the empirical literature that has quantitatively studied participation and use. The goal is to take stock and assess the strength of evidence of this literature (but not to synthesize the findings) and, based on this assessment, to provide directions for future research. Copyright © 2014 Elsevier Ltd. All rights reserved.

Useful, Used, and Peer Approved: The Importance of Rigor and Accessibility in Postsecondary Research and Evaluation. WISCAPE Viewpoints

ERIC Educational Resources Information Center

Vaade, Elizabeth; McCready, Bo

2012-01-01

Traditionally, researchers, policymakers, and practitioners have perceived a tension between rigor and accessibility in quantitative research and evaluation in postsecondary education. However, this study indicates that both producers and consumers of these studies value high-quality work and clear findings that can reach multiple audiences. The…

[Reconstituting evaluation methods based on both qualitative and quantitative paradigms].

PubMed

Miyata, Hiroaki; Okubo, Suguru; Yoshie, Satoru; Kai, Ichiro

2011-01-01

Debate about the relationship between quantitative and qualitative paradigms is often muddled and confusing and the clutter of terms and arguments has resulted in the concepts becoming obscure and unrecognizable. In this study we conducted content analysis regarding evaluation methods of qualitative healthcare research. We extracted descriptions on four types of evaluation paradigm (validity/credibility, reliability/credibility, objectivity/confirmability, and generalizability/transferability), and classified them into subcategories. In quantitative research, there has been many evaluation methods based on qualitative paradigms, and vice versa. Thus, it might not be useful to consider evaluation methods of qualitative paradigm are isolated from those of quantitative methods. Choosing practical evaluation methods based on the situation and prior conditions of each study is an important approach for researchers.

Experiences from a pilot study on how to conduct a qualitative multi-country research project regarding use of antibiotics in Southeast Europe.

PubMed

Kaae, Susanne; Sporrong, Sofia Kälvemark; Traulsen, Janine Morgall; Wallach Kildemoes, Helle; Nørgaard, Lotte Stig; Jakupi, Arianit; Raka, Denis; Gürpinar, Emre Umut; Alkan, Ali; Hoxha, Iris; Malaj, Admir; Cantarero, Lourdes Arevalo

2016-01-01

In 2014, a qualitative multi-country research project was launched to study the reasons behind the high use of antibiotics in regions of Southeast Europe by using previously untrained national interviewers (who were engaged in other antibiotic microbial resistance-related investigations) to conduct qualitative interviews with local patients, physicians and pharmacists. Little knowledge exists about how to implement qualitative multi-country research collaborations involving previously untrained local data collectors. The aim of this paper was therefore to contribute to the knowledge regarding how to conduct these types of research projects by evaluating a pilot study of the project. Local data collectors conducted the study according to a developed protocol and evaluated the study with the responsible researcher-team from University of Copenhagen. The pilot study focused on 'local ownership', 'research quality' and 'feasibility' with regard to successful implementation and evaluation. The evaluation was achieved by interpreting 'Skype' and 'face to face' meetings and email correspondence by applying 'critical common sense'. Local data collectors achieved a sense of joint ownership. Overall, the protocol worked well. Several minor challenges pertaining to research quality and feasibility were identified, in particular obtaining narratives when conducting interviews and recruiting patients for the study. Furthermore, local data collectors found it difficult to allocate sufficient time to the project. Solutions were discussed and added to the protocol. Despite the challenges, it was possible to achieve an acceptable scientific level of research when conducting qualitative multi-country research collaboration under the given circumstances. Specific recommendations to achieve this are provided by the authors.

An Evaluative Case Study: The Influence of Institutional Policies, Procedures, and Practices on Completion of Nontraditional Transfer Students at a Private, Religious-Based, Doctoral Degree-Granting, Moderate Research University

ERIC Educational Resources Information Center

Pack, Elizabeth Myra

2017-01-01

The purpose of this single, intrinsic, evaluative case study was to examine the problem of nontraditional transfer student completion at a private, religious-based, doctoral degree-granting, moderate research university in North Carolina. The following research questions guided the study: (a) How do institutional policies, procedures, and…

Evaluation of Models of the Reading Process.

ERIC Educational Resources Information Center

Balajthy, Ernest

A variety of reading process models have been proposed and evaluated in reading research. Traditional approaches to model evaluation specify the workings of a system in a simplified fashion to enable organized, systematic study of the system's components. Following are several statistical methods of model evaluation: (1) empirical research on…

Research notes : roadway design treatments for rural to urban transitions.

DOT National Transportation Integrated Search

2008-12-01

An ODOT Research study, lead by Karen Dixon at Oregon State University, reviewed research evaluating potential traffic calming strategies for rural-to-urban transitions on high speed highways. Driving simulator evaluations were conducted to assess se...

Introducing a New Learning and Teaching Evaluation Planning Framework for Small Internally Funded Projects in Higher Education

ERIC Educational Resources Information Center

Huber, Elaine

2017-01-01

Scholarly evaluation practices in learning and teaching projects are under-reported in the literature. In order for robust evaluative measures to be implemented, a project requires a well-designed evaluation plan. This research study describes the development of a practical evaluation planning framework through an action research approach, using…

Some Observations on the Relationships Between Research Productivity and Student Evaluations of Courses and Teaching.

ERIC Educational Resources Information Center

Stallings, William A.; Singhal, Sushila

"Does the good researcher tend to be a good teacher, and vice versa?" University administrators contend that teaching and research are equally important, though students claim that researchers neglect teaching and professors claim that only their research efforts are rewarded. In this study, course and instructor evaluations were defined…

Qualitative Evaluation Methods in Ethics Education: A Systematic Review and Analysis of Best Practices.

PubMed

Watts, Logan L; Todd, E Michelle; Mulhearn, Tyler J; Medeiros, Kelsey E; Mumford, Michael D; Connelly, Shane

2017-01-01

Although qualitative research offers some unique advantages over quantitative research, qualitative methods are rarely employed in the evaluation of ethics education programs and are often criticized for a lack of rigor. This systematic review investigated the use of qualitative methods in studies of ethics education. Following a review of the literature in which 24 studies were identified, each study was coded based on 16 best practices characteristics in qualitative research. General thematic analysis and grounded theory were found to be the dominant approaches used. Researchers are effectively executing a number of best practices, such as using direct data sources, structured data collection instruments, non-leading questioning, and expert raters. However, other best practices were rarely present in the courses reviewed, such as collecting data using multiple sources, methods, raters, and timepoints, evaluating reliability, and employing triangulation analyses to assess convergence. Recommendations are presented for improving future qualitative research studies in ethics education.

An evaluation of the interaction of place and community-based participatory research as a research methodology in the implementation of a sexually transmitted infection intervention for Greenlandic youth.

PubMed

Rink, Elizabeth

2016-01-01

Newly emerging research suggests that the actual physical location of a study and the geographic context in which a study is implemented influences the types of research methods most appropriate to use in a study as well as the study's research outcomes. This article presents a reflection on the extent to which place influenced the use of community-based participatory research (CBPR) as a research methodology in the implementation of an intervention to address sexually transmitted infections in Greenland. An evaluation of the interaction between place and CBPR suggests that the physicality of place influenced the intervention's successes and challenges. Future research that uses CBPR as a research methodology in sexual and reproductive health research in the Arctic warrants situating the research design, implementation and outcomes within the context of place.

Evaluation of English Achievement Test: A Comparison between High and Low Achievers amongst Selected Elementary School Students of Pakistan

ERIC Educational Resources Information Center

Haider, Zubair; Latif, Farah; Akhtar, Samina; Mushtaq, Maria

2012-01-01

Validity, reliability and item analysis are critical to the process of evaluating the quality of an educational measurement. The present study evaluates the quality of an assessment constructed to measure elementary school student's achievement in English. In this study, the survey model of descriptive research was used as a research method.…

Review of Research Reporting Guidelines for Radiology Researchers.

PubMed

Cronin, Paul; Rawson, James V

2016-05-01

Prior articles have reviewed reporting guidelines and study evaluation tools for clinical research. However, only some of the many available accepted reporting guidelines at the Enhancing the QUAlity and Transparency Of health Research Network have been discussed in previous reports. In this paper, we review the key Enhancing the QUAlity and Transparency Of health Research reporting guidelines that have not been previously discussed. The study types include diagnostic and prognostic studies, reliability and agreement studies, observational studies, analytical and descriptive, experimental studies, quality improvement studies, qualitative research, health informatics, systematic reviews and meta-analyses, economic evaluations, and mixed methods studies. There are also sections on study protocols, and statistical analyses and methods. In each section, there is a brief overview of the study type, and then the reporting guideline(s) that are most applicable to radiology researchers including radiologists involved in health services research are discussed. Copyright © 2016 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

Health services research evaluation principles. Broadening a general framework for evaluating health information technology.

PubMed

Sockolow, P S; Crawford, P R; Lehmann, H P

2012-01-01

Our forthcoming national experiment in increased health information technology (HIT) adoption funded by the American Recovery and Reinvestment Act of 2009 will require a comprehensive approach to evaluating HIT. The quality of evaluation studies of HIT to date reveals a need for broader evaluation frameworks that limits the generalizability of findings and the depth of lessons learned. Develop an informatics evaluation framework for health information technology (HIT) integrating components of health services research (HSR) evaluation and informatics evaluation to address identified shortcomings in available HIT evaluation frameworks. A systematic literature review updated and expanded the exhaustive review by Ammenwerth and deKeizer (AdK). From retained studies, criteria were elicited and organized into classes within a framework. The resulting Health Information Technology Research-based Evaluation Framework (HITREF) was used to guide clinician satisfaction survey construction, multi-dimensional analysis of data, and interpretation of findings in an evaluation of a vanguard community health care EHR. The updated review identified 128 electronic health record (EHR) evaluation studies and seven evaluation criteria not in AdK: EHR Selection/Development/Training; Patient Privacy Concerns; Unintended Consequences/ Benefits; Functionality; Patient Satisfaction with EHR; Barriers/Facilitators to Adoption; and Patient Satisfaction with Care. HITREF was used productively and was a complete evaluation framework which included all themes that emerged. We can recommend to future EHR evaluators that they consider adding a complete, research-based HIT evaluation framework, such as HITREF, to their evaluation tools suite to monitor HIT challenges as the federal government strives to increase HIT adoption.

Primary prevention research: a preliminary review of program outcome studies.

PubMed

Schaps, E; Churgin, S; Palley, C S; Takata, B; Cohen, A Y

1980-07-01

This article reviews 35 drug abuse prevention program evaluations employing drug-specific outcome measures. Many of these evaluations assessed the effects of "new generation" prevention strategies: affective, peer-oriented, and multidimensional approaches. Only 14 studies evaluated purely informational programs. Evaluations were analyzed to ascertain (1) characteristics of the programs under study, (2) characteristics of the research designs, and (3) patterns among findings. This review provides some evidence that the newer prevention strategies may produce more positive and fewer negative outcomes than did older drug information approaches. Over 70% of the programs using the newer strategies produced some positive effects; only 29% showed negative effects. In contrast, 46% of informational programs showed positive effects; 46% showed negative effects. These findings must be approached with great caution, since the research was frequently scientifically inadequate, and since rigor of research was negatively correlated with intensity and duration of program services.

An Evaluation Framework and Instrument for Evaluating e-Assessment Tools

ERIC Educational Resources Information Center

Singh, Upasana Gitanjali; de Villiers, Mary Ruth

2017-01-01

e-Assessment, in the form of tools and systems that deliver and administer multiple choice questions (MCQs), is used increasingly, raising the need for evaluation and validation of such systems. This research uses literature and a series of six empirical action research studies to develop an evaluation framework of categories and criteria called…

Academic and Educational Development: Research, Evaluation and Changing Practice in Higher Education. Staff and Educational Development Series.

ERIC Educational Resources Information Center

Macdonald, Ranald; Wisdom, James

This practice-oriented book brings together research and evaluation approaches and supporting case studies from educational researchers and teachers. The emphasis is on changing practice in higher education and the research that underpins desirable development. Following an introduction, chapter 1 presents Educational Development Changing Practice…

Citation Ranking versus Peer Evaluation of Senior Faculty Research Performance: A Case Study of Kurdish Scholarship.

ERIC Educational Resources Information Center

Meho, Lokman I.; Sonnenwald, Diane H.

2000-01-01

Analyzes the relationship between citation ranking and peer evaluation in assessing senior faculty research performance. Describes a study of faculty specializing in Kurdish studies that investigated to what degree citation ranking correlates with data from citation content analysis, book reviews, and peer ranking. (Contains 72 references.)…

Evaluating Research Administration: Methods and Utility

ERIC Educational Resources Information Center

Marina, Sarah; Davis-Hamilton, Zoya; Charmanski, Kara E.

2015-01-01

Three studies were jointly conducted by the Office of Research Administration and Office of Proposal Development at Tufts University to evaluate the services within each respective office. The studies featured assessments that used, respectively, (1) quantitative metrics; (2) a quantitative satisfaction survey with limited qualitative questions;…

[Participation, knowledge production, and evaluative research: participation by different actors in a mental health study].

PubMed

Furtado, Juarez Pereira; Campos, Rosana Onocko

2008-11-01

This article reflects on the interrelations between participation, knowledge production, and public policy evaluation in light of issues from our own experience with evaluative research on a municipal network of Psychosocial Care Centers (CAPS) in Brazil. The article discusses the coordination of the complex process and the potentials and limits of partnerships for conducting qualitative evaluative studies in mental health with participation by different social actors. The authors conclude that qualitative evaluative research aligned with the perspective of including different points of view representing various segments is the best approach for understanding the numerous spin-offs from the implementation of services linked to the Brazilian psychiatric reform movement, given the inherent specificities of the mental health field.

Why do local authorities undertake controlled evaluations of health impact? A qualitative case study of interventions in housing.

PubMed

Milton, S; Petticrew, M; Green, J

2014-12-01

A significant amount of literature documents the challenges of undertaking evaluative research on the public health impacts of interventions in the non-health sector. However, few studies have investigated why such studies are undertaken despite the undoubted challenges. Taking housing as a case study, the authors aimed to identify the factors contributing to successful evaluative research in the non-health sector. Qualitative interview study. Semi-structured interviews with 16 investigators involved in seven successful experimental studies of housing interventions across the UK, analysed using thematic content analysis. Intervention studies were undertaken when existing collaborative links enabled 'windows of opportunity' to be exploited. Although different 'cultures of evidence' were reported across the collaborating teams, these did not necessarily map onto the public health research/non-academic divide, and did not undermine collaborative work when all parties could gain from taking part in the research. Focussing on success, rather than failure, suggests that to encourage the uptake of evaluative evidence in the non-health sector, efforts might be better directed at fostering opportunities for partnership building rather than simply on educating non-health partners in the principles of academic research. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

VIPER: Chronic Pain after Amputation: Inflammatory Mechanisms, Novel Analgesic Pathways, and Improved Patient Safety

DTIC Science & Technology

2017-10-01

Through analysis of data obtained in the Molecular Signatures of Chronic Pain Subtypes study termed Veterans Integrated Pain Evaluation Research...immune cells (macrophages) to chronic pain while also evaluating novel analgesics in relevant animal models. The current proposal also attempts to...analysis of data obtained in the Molecular Signatures of Chronic Pain Subtypes study termed Veterans Integrated Pain Evaluation Research (VIPER

The MIXED framework: A novel approach to evaluating mixed-methods rigor.

PubMed

Eckhardt, Ann L; DeVon, Holli A

2017-10-01

Evaluation of rigor in mixed-methods (MM) research is a persistent challenge due to the combination of inconsistent philosophical paradigms, the use of multiple research methods which require different skill sets, and the need to combine research at different points in the research process. Researchers have proposed a variety of ways to thoroughly evaluate MM research, but each method fails to provide a framework that is useful for the consumer of research. In contrast, the MIXED framework is meant to bridge the gap between an academic exercise and practical assessment of a published work. The MIXED framework (methods, inference, expertise, evaluation, and design) borrows from previously published frameworks to create a useful tool for the evaluation of a published study. The MIXED framework uses an experimental eight-item scale that allows for comprehensive integrated assessment of MM rigor in published manuscripts. Mixed methods are becoming increasingly prevalent in nursing and healthcare research requiring researchers and consumers to address issues unique to MM such as evaluation of rigor. © 2017 John Wiley & Sons Ltd.

Current Research: Measurement and Evaluation of the Collection.

ERIC Educational Resources Information Center

Mancall, Jacqueline C.

1982-01-01

Reviews the literature on the evaluation of library collections, discusses the research specifically on collection evaluation in school libraries, and draws attention to the types of studies that are needed in the school library media field. A 22-item reference list is included. (JL)

Invited commentary: Evaluating epidemiologic research methods--the importance of response rate calculation.

PubMed

Harris, M Anne

2010-09-15

Epidemiologic research that uses administrative records (rather than registries or clinical surveys) to identify cases for study has been increasingly restricted because of concerns about privacy, making unbiased population-based research less practicable. In their article, Nattinger et al. (Am J Epidemiol. 2010;172(6):637-644) present a method for using administrative data to contact participants that has been well received. However, the methods employed for calculating and reporting response rates require further consideration, particularly the classification of untraceable cases as ineligible. Depending on whether response rates are used to evaluate the potential for bias to influence study results or to evaluate the acceptability of the method of contact, different fractions may be considered. To improve the future study of epidemiologic research methods, a consensus on the calculation and reporting of study response rates should be sought.

[How can the impact of Health Technology Assessment (HTA) in the Austrian healthcare system be assessed? Design of a conceptual framework].

PubMed

Schumacher, I; Zechmeister, I

2012-04-01

In Austria research in Health Technology Assessment (HTA) has been conducted since the 1990s. Research in HTA aims at supporting an adequate and efficient use of health care resources in order to sustain a publicly financed and solidary health care system. Ultimately, HTA research should result in better health of the population. Research results should provide independent information for decision makers. For legitimizing further research resources and for prioritizing future HTA research and guaranteeing the value of future research, HTA research needs itself to undergo evaluation. Aim of the study is to design a conceptual framework for evaluating the impact of HTA research in Austria on the basis of the existing literature. An already existing review which presents methods and concepts how to evaluate HTA-impact was updated by a systematic research including literature of the years 2004-January 2010. Results were analysed in regard to 4 categories: definition of the term impact, target groups and system levels, operationalisation of indicators and evaluation methods. Overall, 19 publications were included. Referring to the 4 categories, an explanation of impact has to take into account HTAs multidisciplinary setting and needs a context related definition. Target groups, system levels, indicators and methods depend on the impact defined. Studies investigated direct and indirect impact and were focused on different target groups like physicians, nurses and decision makers on the micro-, and meso level, as well as politicians and reimbursement institutions on the macro level. Except for one reference all studies applied already known and mostly qualitative methods for measuring the impact of HTA research. Thus, an appropriate pool of instruments seems to be available. There is a lack of information about validity of applied methods and indicators. By adapting adequate methods and concepts a conceptual framework for the Austrian HTA-Impact evaluation has been designed. The paper presents an overview of existing methods for the evaluation of the HTA research. This has been used to identify useful approaches for measuring the HTA-impact in Austria. By providing a context sensitive framework for impact evaluation in Austria the Austrian HTA-research contributes to the international trend of impact-evaluation. © Georg Thieme Verlag KG Stuttgart · New York.

[Hospital biomedical research through the satisfaction of a Health Research Institute professionals].

PubMed

Olmedo, C; Plá, R; Bellón, J M; Bardinet, T; Buño, I; Bañares, R

2015-01-01

A Health Research Institute is a powerful strategic commitment to promote biomedical research in hospitals. To assess user satisfaction is an essential quality requirement. The aim of this study is to evaluate the professional satisfaction in a Health Research Institute, a hospital biomedical research centre par excellence. Observational study was conducted using a satisfaction questionnaire on Health Research Institute researchers. The explored dimensions were derived from the services offered by the Institute to researchers, and are structured around 4 axes of a five-year Strategic Plan. A descriptive and analytical study was performed depending on adjustment variables. Internal consistency was also calculated. The questionnaire was completed by 108 researchers (15% response). The most valued strategic aspect was the structuring Areas and Research Groups and political communication and dissemination. The overall rating was 7.25 out of 10. Suggestions for improvement refer to the need for help in recruitment, and research infrastructures. High internal consistency was found in the questionnaire (Cronbach alpha of 0.9). So far research policies in health and biomedical environment have not been sufficiently evaluated by professionals in our field. Systematic evaluations of satisfaction and expectations of key stakeholders is an essential tool for analysis, participation in continuous improvement and advancing excellence in health research. Copyright © 2015 SECA. Published by Elsevier Espana. All rights reserved.

Understanding the performance and impact of public knowledge translation funding interventions: protocol for an evaluation of Canadian Institutes of Health Research knowledge translation funding programs.

PubMed

McLean, Robert K D; Graham, Ian D; Bosompra, Kwadwo; Choudhry, Yumna; Coen, Stephanie E; Macleod, Martha; Manuel, Christopher; McCarthy, Ryan; Mota, Adrian; Peckham, David; Tetroe, Jacqueline M; Tucker, Joanne

2012-06-22

The Canadian Institutes of Health Research (CIHR) has defined knowledge translation (KT) as a dynamic and iterative process that includes the synthesis, dissemination, exchange, and ethically-sound application of knowledge to improve the health of Canadians, provide more effective health services and products, and strengthen the healthcare system. CIHR, the national health research funding agency in Canada, has undertaken to advance this concept through direct research funding opportunities in KT. Because CIHR is recognized within Canada and internationally for leading and funding the advancement of KT science and practice, it is essential and timely to evaluate this intervention, and specifically, these funding opportunities. The study will employ a novel method of participatory, utilization-focused evaluation inspired by the principles of integrated KT. It will use a mixed methods approach, drawing on both quantitative and qualitative data, and will elicit participation from CIHR funded researchers, knowledge users, KT experts, as well as other health research funding agencies. Lines of inquiry will include an international environmental scan, document/data reviews, in-depth interviews, targeted surveys, case studies, and an expert review panel. The study will investigate how efficiently and effectively the CIHR model of KT funding programs operates, what immediate outcomes these funding mechanisms have produced, and what impact these programs have had on the broader state of health research, health research uptake, and health improvement. The protocol and results of this evaluation will be of interest to those engaged in the theory, practice, and evaluation of KT. The dissemination of the study protocol and results to both practitioners and theorists will help to fill a gap in knowledge in three areas: the role of a public research funding agency in facilitating KT, the outcomes and impacts KT funding interventions, and how KT can best be evaluated.

Understanding the performance and impact of public knowledge translation funding interventions: Protocol for an evaluation of Canadian Institutes of Health Research knowledge translation funding programs

PubMed Central

2012-01-01

Background The Canadian Institutes of Health Research (CIHR) has defined knowledge translation (KT) as a dynamic and iterative process that includes the synthesis, dissemination, exchange, and ethically-sound application of knowledge to improve the health of Canadians, provide more effective health services and products, and strengthen the healthcare system. CIHR, the national health research funding agency in Canada, has undertaken to advance this concept through direct research funding opportunities in KT. Because CIHR is recognized within Canada and internationally for leading and funding the advancement of KT science and practice, it is essential and timely to evaluate this intervention, and specifically, these funding opportunities. Design The study will employ a novel method of participatory, utilization-focused evaluation inspired by the principles of integrated KT. It will use a mixed methods approach, drawing on both quantitative and qualitative data, and will elicit participation from CIHR funded researchers, knowledge users, KT experts, as well as other health research funding agencies. Lines of inquiry will include an international environmental scan, document/data reviews, in-depth interviews, targeted surveys, case studies, and an expert review panel. The study will investigate how efficiently and effectively the CIHR model of KT funding programs operates, what immediate outcomes these funding mechanisms have produced, and what impact these programs have had on the broader state of health research, health research uptake, and health improvement. Discussion The protocol and results of this evaluation will be of interest to those engaged in the theory, practice, and evaluation of KT. The dissemination of the study protocol and results to both practitioners and theorists will help to fill a gap in knowledge in three areas: the role of a public research funding agency in facilitating KT, the outcomes and impacts KT funding interventions, and how KT can best be evaluated. PMID:22726821

Diagnosing Alzheimer's disease: a systematic review of economic evaluations.

PubMed

Handels, Ron L H; Wolfs, Claire A G; Aalten, Pauline; Joore, Manuela A; Verhey, Frans R J; Severens, Johan L

2014-03-01

The objective of this study is to systematically review the literature on economic evaluations of interventions for the early diagnosis of Alzheimer's disease (AD) and related disorders and to describe their general and methodological characteristics. We focused on the diagnostic aspects of the decision models to assess the applicability of existing decision models for the evaluation of the recently revised diagnostic research criteria for AD. PubMed and the National Institute for Health Research Economic Evaluation database were searched for English-language publications related to economic evaluations on diagnostic technologies. Trial-based economic evaluations were assessed using the Consensus on Health Economic Criteria list. Modeling studies were assessed using the framework for quality assessment of decision-analytic models. The search retrieved 2109 items, from which eight decision-analytic modeling studies and one trial-based economic evaluation met all eligibility criteria. Diversity among the study objective and characteristics was considerable and, despite considerable methodological quality, several flaws were indicated. Recommendations were focused on diagnostic aspects and the applicability of existing models for the evaluation of recently revised diagnostic research criteria for AD. Copyright © 2014 The Alzheimer's Association. Published by Elsevier Inc. All rights reserved.

The evolution of an evaluation: a case study using the tribal participatory research model.

PubMed

Richmond, Lucinda S; Peterson, Donna J; Betts, Sherry C

2008-10-01

This article presents a case study of how the evaluation design for a dating violence prevention and/or youth development program for American Indian youth in Arizona evolved throughout the project. Particular attention is given to how the evaluation design was guided by the tribal participatory research model. A brief rationale for the project is presented along with literature on culturally competent evaluation and research with American Indians. A description of the project and the unique communities in which it was implemented is provided. The focus of the article is the process of how the evaluation plan changed and how various factors influenced this process (e.g., feedback from community stakeholders, conversations with funder, results of process evaluation, suggestions from literature, the authors' experience working in American Indian communities). The authors conclude with lessons learned for others to consider as they develop working relationships and evaluation plans in similar communities.

Collecting and Utilizing Evaluation Research for Public Good and on Behalf of African American Children

ERIC Educational Resources Information Center

Thomas, Veronica G.; McKie, Brooke K.

2006-01-01

A study indicates that researchers entrusted with evaluating the educational outcomes of African American children must engage their practice for the public good and on behalf of these students. The Howard University Evaluation Training Institute is used as a guide to describe the steps for conducting quality evaluations, and to highlight the…

Osteopathic manipulative treatment: A systematic review and critical appraisal of comparative effectiveness and health economics research.

PubMed

Steel, Amie; Sundberg, Tobias; Reid, Rebecca; Ward, Lesley; Bishop, Felicity L; Leach, Matthew; Cramer, Holger; Wardle, Jon; Adams, Jon

2017-02-01

In recent years, evidence has emerged regarding the effectiveness of osteopathic manipulative treatments (OMT). Despite growing evidence in this field, there is need for appropriate research designs that effectively reflect the person-centred system of care promoted in osteopathy and provide data which can inform policy decisions within the healthcare system. The purpose of this systematic review is to identify, appraise and synthesise the evidence from comparative effectiveness and economic evaluation research involving OMT. A database search was conducted using CINAHL, PubMed, PEDro, AMED, SCOPUS and OSTMED.DR, from their inception to May 2015. Two separate searches were undertaken to identify original research articles encompassing the economic evaluation and comparative effectiveness of OMT. Identified comparative effectives studies were evaluated using the Cochrane risk of bias tool and appraised using the Good Reporting of Comparative Effectiveness (GRACE) principles. Identified economic studies were assessed with the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) guidelines. Sixteen studies reporting the findings of comparative effectiveness (n = 9) and economic evaluation (n = 7) research were included. The comparative effectiveness studies reported outcomes for varied health conditions and the majority (n = 6) demonstrated a high risk of bias. The economic evaluations included a range of analyses and considerable differences in the quality of reporting were evident. Despite some positive findings, published comparative effectiveness and health economic studies in OMT are of insufficient quality and quantity to inform policy and practice. High quality, well-designed, research that aligns with international best practice is greatly needed to build a pragmatic evidence base for OMT. Copyright © 2016 Elsevier Ltd. All rights reserved.

Re-Mediating Practitioners' Practice for Equity in Higher Education: Evaluating the Effectiveness of Action Research

ERIC Educational Resources Information Center

Vines, Erin

2012-01-01

This study examines the influence of action research on California community college practitioners' attitudes, beliefs, and behavior using the Center for Urban Education's (CUE) Equity Scorecard tools and process. This developmental evaluation study began March 2011 and concluded April 2012. The pseudonym of the field site studied is Las Flores…

Historical Perspectives: A Review and Evaluation of 76 Studies of the Defense Research Enterprise, 1945-2015

DTIC Science & Technology

2016-08-01

MANAGEMENT FELLOW U.S. DEPARTMENT OF DEFENSE This report summarizes recommendations from 76 prior studies of the Department of Defense Research...Enterprise. A brief summary and evaluation of each study is provided, and recommendations are grouped according to management areas. Enduring themes...Prominent Trends in Historical Recommendations .................................................................................. 5 Knowledge Management

Content, Structure, and Usefulness of Juvenile Predisposition Psychological Evaluations

ERIC Educational Resources Information Center

Morin, Samantha L.; Cruise, Keith R.; Hinz, Holly; Holloway, Evan D.; Chapman, John F.

2015-01-01

Background: There is a dearth of research regarding the content and structure of juvenile predisposition psychological evaluations. Limited research suggests that key mental health domains are insufficiently represented and judges use evaluator recommendations regarding legal outcomes more often than clinical outcomes. Studies have not addressed…

Soft Research on a Hard Subject: Student Evaluations Reconsidered

ERIC Educational Resources Information Center

Soper, John C.

1973-01-01

Methods of evaluation of faculty classroom performance are considered. The author cites research studies which attempt to assess the validity of student evaluations of teachers. Data are presented suggesting that the students' perceptions of their teachers' abilities are not connected with what those students learn. (SM)

Design and Evaluation of a Personal Digital Assistant-based Research Platform for Cochlear Implants

PubMed Central

Ali, Hussnain; Lobo, Arthur P.; Loizou, Philipos C.

2014-01-01

This paper discusses the design, development, features, and clinical evaluation of a personal digital assistant (PDA)-based platform for cochlear implant research. This highly versatile and portable research platform allows researchers to design and perform complex experiments with cochlear implants manufactured by Cochlear Corporation with great ease and flexibility. The research platform includes a portable processor for implementing and evaluating novel speech processing algorithms, a stimulator unit which can be used for electrical stimulation and neurophysio-logic studies with animals, and a recording unit for collecting electroencephalogram/evoked potentials from human subjects. The design of the platform for real time and offline stimulation modes is discussed for electric-only and electric plus acoustic stimulation followed by results from an acute study with implant users for speech intelligibility in quiet and noisy conditions. The results are comparable with users’ clinical processor and very promising for undertaking chronic studies. PMID:23674422

Formative Qualitative Evaluation for "Exploratory" ITS Research.

ERIC Educational Resources Information Center

Murray, Tom

1993-01-01

Discusses evaluation methods applicable to exploratory research areas, provides an overview of qualitative and formative methods for exploratory research on intelligent tutoring systems (ITS) and describes an exploratory study in ITS knowledge acquisition which involved working with three educators to build an ITS for high school physics.…

A Course Model for Teaching Research Evaluation in Colleges of Pharmacy.

ERIC Educational Resources Information Center

Draugalis, JoLaine R.; Slack, Marion K.

1992-01-01

A University of Arizona undergraduate pharmacy course designed to develop student skills in evaluation of research has five parts: introduction to the scientific method; statistical techniques/data analysis review; research design; fundamentals of clinical studies; and practical applications. Prerequisites include biostatistics and drug…

Study design in medical research: part 2 of a series on the evaluation of scientific publications.

PubMed

Röhrig, Bernd; du Prel, Jean-Baptist; Blettner, Maria

2009-03-01

The scientific value and informativeness of a medical study are determined to a major extent by the study design. Errors in study design cannot be corrected afterwards. Various aspects of study design are discussed in this article. Six essential considerations in the planning and evaluation of medical research studies are presented and discussed in the light of selected scientific articles from the international literature as well as the authors' own scientific expertise with regard to study design. The six main considerations for study design are the question to be answered, the study population, the unit of analysis, the type of study, the measuring technique, and the calculation of sample size. This article is intended to give the reader guidance in evaluating the design of studies in medical research. This should enable the reader to categorize medical studies better and to assess their scientific quality more accurately.

Performing well in an evaluative situation: the roles of perceived competence and task-irrelevant interfering thoughts.

PubMed

Van Yperen, Nico W

2007-12-01

This research expands on previous research by arguing and demonstrating that high perceived competence buffers the detrimental effects of an evaluative situation. In Study 1 (n=75, 38.7% male), the situation (evaluative vs. non-evaluative) and perceived competence (high vs. low) were manipulated, whereas in Study 2 (n=42, 33.3% male), perceived competence relied on naturally occurring differences in perceived competence. The results of Study 1 indicate that people may underachieve in an evaluative situation. More importantly, in Study 2 it was demonstrated that such an evaluative situation had only a negative effect on test performance among individuals low in perceived competence. The occurrence of task-irrelevant interfering thoughts during task completion accounted for this inimical effect of an evaluative situation on test performance among these individuals.

Evaluation research in occupational health services: general principles and a systematic review of empirical studies.

PubMed

Hulshof, C T; Verbeek, J H; van Dijk, F J; van der Weide, W E; Braam, I T

1999-06-01

To study the nature and extent of evaluation research in occupational health services (OHSs). Literature review of evaluation research in OHSs. On the basis of a conceptual model of OHS evaluation, empirical studies are categorised into aspects of input, process, output, outcome, and OHS core activities. Many methods to evaluate OHSs or OHS activities exist, depending on the objective and object of evaluation. The amount of empirical studies on evaluation of OHSs or OHS activities that met the non-restrictive inclusion criteria, was remarkably limited. Most of the 52 studies were more descriptive than evaluative. The methodological quality of most studies was not high. A differentiated picture of the evidence of effectiveness of OHSs arises. Occupational health consultations and occupational rehabilitation are hardly studied despite much time spent on the consultation by occupational physicians in most countries. The lack of effectiveness and efficiency of the pre-employment examination should lead to its abandonment as a means of selection of personnel by OHSs. Periodic health monitoring or surveillance, and education on occupational health hazards can be carried out with reasonable process quality. Identification and evaluation of occupational health hazards by a workplace survey can be done with a high output quality, which, however, does not guarantee a favourable outcome. Although rigorous study designs are not always applicable or feasible in daily practice, much more effort should be directed at the scientific evaluation of OHSs and OHS instruments. To develop evidence-based occupational health care the quality of evaluation studies should be improved. In particular, process and outcome of consultation and rehabilitation activities of occupational physicians need to be studied more.

77 FR 15139 - Agency Information Collection Activities: Comment Request; Generic Survey Clearance for the...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-03-14

... order to conduct program- or portfolio-level evaluations, however, both experimental and quasi-experimental evaluation research studies on STEM education interventions require researchers to identify...

Ensuring Data Quality in Extension Research and Evaluation Studies

ERIC Educational Resources Information Center

Radhakrishna, Rama; Tobin, Daniel; Brennan, Mark; Thomson, Joan

2012-01-01

This article presents a checklist as a guide for Extension professionals to use in research and evaluation studies they carry out. A total of 40 statements grouped under eight data quality components--relevance, objectivity, validity, reliability, integrity, generalizability, completeness, and utility--are identified to ensure that research…

Framework for Teacher Evaluation: Examining the Relationship between Teacher Performance and Student Achievement

ERIC Educational Resources Information Center

Parker, Neelie B.

2017-01-01

This action research study examined the relationship between teacher performance and student achievement in reading language arts and mathematics. The study sought to determine if teacher evaluation methods used to determine teacher performance, had a relationship in improving student achievement. The researcher investigated the topic using…

EVALUATION AND INTERPRETATION OF MATERNAL TOXICITY IN SEGMENT II STUDIES: ISSUES, SOME ANSWERS AND DATA NEEDS

EPA Science Inventory

Rogers, J.M., and N. Chernoff. Reproductive Toxicology Division, NHEERL, Office of Research and Development, U.S. Environmental Protection Agency, Research Triangle Park, North Carolina, U.S.A. Evaluation and interpretation of maternal toxicity in Segment II studies: Issues, s...

Measuring the Measurements: A Study of Evaluation of Writing: An Annotated Bibliography.

ERIC Educational Resources Information Center

Scherer, Darlene Lienau

Intended to make the educational community aware of how research has defined acceptable practice in writing assessment, this annotated bibliography examines research about writing evaluation. Divided into five sections, the first section of the bibliography surveys some psychological and linguistic studies of the development of students' writing…

Use of the International Space Station as an Exercise Physiology Lab

NASA Technical Reports Server (NTRS)

Ploutz-Snyder, Lori

2013-01-01

The International Space Station (ISS) is now in its prime utilization phase with great opportunity to use the ISS as a lab. With respect to exercise physiology there is considerable research opportunity. Crew members exercise for up to 2 hours per day using a cycle ergometer, treadmill, and advanced resistive exercise device (ARED). There are several ongoing exercise research studies by NASA, ESA and CSA. These include studies related to evaluation of new exercise prescriptions (SPRINT), evaluation of aerobic capacity (VO2max), biomechanics (Treadmill Kinematics), energy expenditure during spaceflight (Energy), evaluation of cartilage (Cartilage), and evaluation of cardiovascular health (Vascular). Examples of how ISS is used for exercise physiology research will be presented.

A framework for developing research protocols for evaluation of microbial hazards and controls during production that pertain to the quality of agricultural water contacting fresh produce that may be consumed raw.

PubMed

Harris, Linda J; Bender, Jeff; Bihn, Elizabeth A; Blessington, Tyann; Danyluk, Michelle D; Delaquis, Pascal; Goodridge, Lawrence; Ibekwe, A Mark; Ilic, Sanja; Kniel, Kali; Lejeune, Jeffrey T; Schaffner, Donald W; Stoeckel, Don; Suslow, Trevor V

2012-12-01

Agricultural water may contact fresh produce during irrigation and/or when crop protection sprays (e.g., cooling to prevent sunburn, frost protection, and agrochemical mixtures) are applied. This document provides a framework for designing research studies that would add to our understanding of preharvest microbial food safety hazards and control measures pertaining to agricultural water. Researchers will be able to use this document to design studies, to anticipate the scope and detail of data required, and to evaluate previously published work. This document should also be useful for evaluating the strength of existing data and thus should aid in identifying future research needs. Use of this document by the research community may lead to greater consistency or comparability than currently exists among research studies, which may ultimately facilitate direct comparison of hazards and efficacy of controls among different commodities, conditions, and practices.

Evaluative studies in nuclear medicine research: positron computed tomography assessment. Final report, January 1, 1982-December 31, 1982

DOE Office of Scientific and Technical Information (OSTI.GOV)

Potchen, E.J.; Harris, G.I.; Gift, D.A. Reinhard, D.K.

Results are reported of the final phase of the study effort generally titled Evaluative Studies in Nuclear Medicine Research. The previous work is reviewed and extended to an assessment providing perspectives on medical applications of positron emission tomographic (PET) systems, their technological context, and the related economic and marketing environment. Methodologies developed and used in earlier phases of the study were continued, but specifically extended to include solicitation of opinion from commercial organizations deemed to be potential developers, manufacturers and marketers of PET systems. Several factors which influence the demand for clinical uses of PET are evaluated and discussed. Themore » recent Federal funding of applied research with PET systems is found to be a necessary and encouraging event toward a determination that PET either is a powerful research tool limited to research, or whether it also presents major clinical utility. A comprehensive, updated bibliography of current literature related to the development, applications and economic considerations of PET technology is appended.« less

Developing a Culture of Evaluative Inquiry: A Case Study

ERIC Educational Resources Information Center

Miller, Happy Lee

2012-01-01

Research has shown that few educational reform efforts have achieved significant, long-lasting improvement in student achievement. In order to accelerate growth in student achievement, many researchers have advocated the development of cultures of evaluative inquiry. In a culture of evaluative inquiry, teachers use data to identify instructional…

Research Issues in Evaluating Learning Pattern Development in Higher Education

ERIC Educational Resources Information Center

Richardson, John T. E.

2013-01-01

This article concludes the special issue of "Studies in Educational Evaluation" concerned with "Evaluating learning pattern development in higher education" by discussing research issues that have emerged from the previous contributions. The article considers in turn: stability versus variability in learning patterns; old versus new analytic…

78 FR 62637 - Proposed Information Collection Activity; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-10-22

...- Component Evaluation--Data Collection Related to the Design and Implementation Study. OMB No.: 0970-0398. Description: The Office of Data Analysis, Research, and Evaluation (HHS/ACF/ACYF/ODARE) in the Administration for Children, Youth and Families (ACYF) and the Office of Planning, Research, and Evaluation (HHS/ACF...

OFFICE OF RESEARCH AND DEVELOPMENT'S FOUR LAB STUDY: TOXICOLOGICCAL AND CHEMICAL EVALUATION OF COMPLEX MIXTURES OF DISINFECTION BY-PRODUCTS (DBPS) AND QUALITY ASSURANCE ACTIVITIES FOR A LARGE U. S. EPA MULTILABORATORY STUDY

EPA Science Inventory

Office of Research and Development's Four Lab Study: Toxicological and Chemical Evaluation of Complex Mixtures of Disinfection By-Products (DBPs), and Quality Assurance Activities for a Large U.S. EPA Multilaboratoty Study

Thomas J. Hughes, Project and QA Manager, Expe...

78 FR 7860 - Initial Research on the Long-Term Health Consequences of Exposure to Burn Pits in Iraq and...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-02-04

... design features. Existing research studies, such as the Million Veteran Program, the Cooperative Studies..., study designs, research and evaluation protocols, and results from burn pit emissions research. VA has... DEPARTMENT OF VETERANS AFFAIRS Initial Research on the Long-Term Health Consequences of Exposure...

Interviewer as instrument: accounting for human factors in evaluation research.

PubMed

Brown, Joel H

2006-04-01

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug, Alcohol, and Tobacco Education evaluation (77 districts, 118 schools). When applying the explicit observation technique (EOT)--the strategic and nonjudgmental disclosure of nonverbal human factor cues by the interviewer to the respondent during interview--data revealed the observation disclosure pattern. Here, respondents linked perceptions with policy or program implementation or effectiveness evidence. Although more research is needed, it is concluded that the EOT yields richer data when compared with traditional semistructured interviews and, thus, holds promise to enhance qualitative and evaluation research methods. Validity and reliability as well as qualitative and evaluation research considerations are discussed.

Research Risk for Persons With Psychiatric Disorders: A Decisional Framework to Meet the Ethical Challenge

PubMed Central

Yanos, Philip T.; Stanley, Barbara S.; Greene, Carolyn S.

2010-01-01

Objective There is a lack of consensus on how to evaluate the risk of research studies conducted with persons who have psychiatric disorders. The authors reviewed research on vulnerability, risk, and procedures to mitigate risk in studies with this population to help inform evaluation of such research. Methods Searches of MEDLINE (1966–2006), PsycINFO (1967–2006), and Google Scholar used combinations of the terms mental illness, vulnerable, psychiatric, schizophrenia, and depression combined with terms such as research risk, vulnerability, research harm, capacity, risk, and mitigation of risk. Articles were identified from reference lists, and additional searches used terms from identified articles. Results Evidence for two types of vulnerability—capacity based and power based—is presented, which supports the notion of vulnerability as a state, rather than a trait, among persons with psychiatric disorders. Three categories of risk are described—minimal risk, minor increment over minimal risk, and greater than minor increment. Evidence shows that many common types of studies pose risk in the first two categories when conducted with this population. The literature also describes procedures for reducing vulnerability and mitigating risk that should be considered in study evaluations. The authors offer a framework for evaluating the category of risk posed by a study. Conclusions Although more research is needed, there is sufficient evidence that many common types of research present minimal risk or only a minor increment over minimal risk for large segments of the population of persons with psychiatric disorders, as they do for persons in the general population. PMID:19252051

What We Do and Do Not Know about Teaching Medical Image Interpretation.

PubMed

Kok, Ellen M; van Geel, Koos; van Merriënboer, Jeroen J G; Robben, Simon G F

2017-01-01

Educators in medical image interpretation have difficulty finding scientific evidence as to how they should design their instruction. We review and comment on 81 papers that investigated instructional design in medical image interpretation. We distinguish between studies that evaluated complete offline courses and curricula, studies that evaluated e-learning modules, and studies that evaluated specific educational interventions. Twenty-three percent of all studies evaluated the implementation of complete courses or curricula, and 44% of the studies evaluated the implementation of e-learning modules. We argue that these studies have encouraging results but provide little information for educators: too many differences exist between conditions to unambiguously attribute the learning effects to specific instructional techniques. Moreover, concepts are not uniformly defined and methodological weaknesses further limit the usefulness of evidence provided by these studies. Thirty-two percent of the studies evaluated a specific interventional technique. We discuss three theoretical frameworks that informed these studies: diagnostic reasoning, cognitive schemas and study strategies. Research on diagnostic reasoning suggests teaching students to start with non-analytic reasoning and subsequently applying analytic reasoning, but little is known on how to train non-analytic reasoning. Research on cognitive schemas investigated activities that help the development of appropriate cognitive schemas. Finally, research on study strategies supports the effectiveness of practice testing, but more study strategies could be applicable to learning medical image interpretation. Our commentary highlights the value of evaluating specific instructional techniques, but further evidence is required to optimally inform educators in medical image interpretation.

Scientific and Ethical Reflections on Academic Corruption in Universities: On the Science Research Evaluation System in China's Universities

ERIC Educational Resources Information Center

Xiaochun, Wu; Dan, Jia

2007-01-01

A study of the science research activities in China's institutions of higher learning in recent years indicates that there is a major connection between the current instances of corruption in scientific research at colleges and universities and the evaluations system for scientific research implemented at many of the colleges and universities.…

Mediation Effect of Research Skills Proficiency on the Core Self-Evaluations--Research Engagement Relationship among Master of Education Students in Uganda

ERIC Educational Resources Information Center

Atibuni, Dennis Zami; Olema, David Kani; Ssenyonga, Joseph; Karl, Steffens; Kibanja, Grace Milly

2017-01-01

This study investigated the mediation effect of research skills proficiency on the relationship between core self-evaluations and research engagement among Master of Education students in Uganda. Questionnaire surveys including closed ended questions were administered to two cohorts of the students, 2011/2012 and 2012/2013, (N = 102). Results…

Research on Livable Community Evaluation Based on GIS

NASA Astrophysics Data System (ADS)

Yin, Zhangcai; Wu, Yang; Jin, Zhanghaonan; Zhang, Xu

2018-01-01

Community is the basic unit of the city. Research on livable community could provide a bottom-up research path for the realization of livable city. Livability is the total factor affecting the quality of community life. In this paper, livable community evaluation indexes are evaluated based on GIS and fuzzy comprehensive evaluation method. Then the sum-index and sub-index of community livability are both calculated. And community livable evaluation index system is constructed based on the platform of GIS. This study provides theoretical support for the construction and management of livable communities, so as to guide the development and optimization of city.

[Taking evaluation of post-marketing as point of cut-in to promote systematic research of traditional Chinese medicine].

PubMed

Wang, Yong-yan; Wang, Zhi-fei; Xie, Yan-ming

2014-09-01

Research on post-marketing Chinese medicine should be the systematic study from application to mechanism. Clinical evaluation is the basis of mechanism study, we can find the clue from clinical evaluation, then make a mechanism study to find the reason, then apply the results to clinic. So it is a virtuous circle. In order to achieve it, we cannot be limited to traditional Chinese medicine, we should form multi-disciplinary team under the direction of grand science thinking, try hard to put industry-university-research institute collaboration association to use, and if necessary, explore the new model of the whole nation system. An appropriate operation mechanism is very important.

Health information exchanges--Unfulfilled promise as a data source for clinical research.

PubMed

Parker, Carol; Weiner, Michael; Reeves, Mathew

2016-03-01

To determine the use of health information exchange organizations (HIEs) to support and conduct clinical research. This scoping review included US-based studies published between January 2003 and March 2014 that used data from an HIE to address at least one of three categories of research: clinical or epidemiological research, financial evaluation, or utilization of health services. Eligibility was not restricted to research on HIEs. Studies with research questions outside of the evaluation of HIEs themselves were sought. Eighteen articles met final study inclusion criteria from an initial list of 847 hits. Fifteen studies addressed a clinical or epidemiological research question, 6 addressed a financial consideration, and 8 addressed a utilization issue. Considerable overlap was found among the research categories: 13 articles addressed more than one category. Of the eighteen included studies, only two used HIE data to answer a research objective that was NOT specific to HIE use. Research designs were varied and ranged from observational studies, such as cohort and cross-sectional studies, to randomized trials. The 18 articles represent the involvement of a small number of HIEs; 7 of the studies were from a single HIE. This review demonstrates that HIE-provided information is available and used to answer clinical or epidemiological, financial, or utilization-based research questions; however, the majority of the studies using HIE data are done with the primary goal of evaluating the use and impact of HIEs on health care delivery and outcomes. As HIEs mature and become integrated parts of the health care industry, the authors anticipate that fewer studies will be published that describe or validate the role of HIEs, and more will use HIEs as multi-institutional data sources for conducting clinical research and improving health services and clinical outcomes. Articles identified in this review indicate the limited extent that HIE data are being used for clinical research outside of the evaluation of HIEs themselves, as well as the limited number of specific HIEs that are involved in generating published research. Significant barriers exist that prevent HIEs from developing into an invaluable resource for clinical research including technological infrastructure limitations, business processes limiting secondary use of data, and lack of participating provider support. Research to better understand challenges to developing the necessary infrastructure and policies to foster HIE engagement in research would be valuable as HIEs represent an opportunity to engage non-traditional health care provider research partners. Copyright © 2015. Published by Elsevier Ireland Ltd.

Using a mixed-methods design to examine nurse practitioner integration in British Columbia.

PubMed

Sangster-Gormley, Esther; Griffith, Janessa; Schreiber, Rita; Borycki, Elizabeth

2015-07-01

To discuss and provide examples of how mixed-methods research was used to evaluate the integration of nurse practitioners (NPs) into a Canadian province. Legislation enabling NPs to practise in British Columbia (BC) was enacted in 2005. This research evaluated the integration of NPs and their effect on the BC healthcare system. Data were collected using surveys, focus groups, participant interviews and case studies over three years. Data sources and methods were triangulated to determine how the findings addressed the research questions. The challenges and benefits of using the multiphase design are highlighted in the paper. The multiphase mixed-methods research design was selected because of its applicability to evaluation research. The design proved to be robust and flexible in answering research questions. As sub-studies within the multiphase design are often published separately, it can be difficult for researchers to find examples. This paper highlights ways that a multiphase mixed-methods design can be conducted for researchers unfamiliar with the process.

Evaluations of Sexual Assault Prevention Programs in Military Settings: A Synthesis of the Research Literature.

PubMed

Orchowski, Lindsay M; Berry-Cabán, Cristóbal S; Prisock, Kara; Borsari, Brian; Kazemi, Donna M

2018-03-01

The prevention of sexual assault (SA) in the U.S. military is a significant priority. This study applied the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to a literature search that identified research evaluating SA prevention programs conducted within military settings. Only six studies published between 2005 and 2016 met criteria for inclusion in the review. Studies demonstrated high heterogeneity in the: (1) conceptual framework of the prevention approach; (2) target population and timing of administration; (3) study recruitment methods; (4) methodological design; (5) method of delivery, program dosage and theory of change; and (6) outcome administration and efficacy. Scientific rigor according to the Oxford Center for Evidence-based Medicine was also variable. Several gaps in the research base were identified. Specifically, research evaluating SA prevention programs have only been conducted among U.S. Army and U.S. Navy samples. Most studies did not examine whether program participation was associated with reductions in rates of sexual violence. Studies also lacked utilization of a long-term follow-up period. Additionally, studies did not reflect the types of SA prevention programs currently being implemented in military settings. Taken together, further research is needed to enhance the evidence base for SA prevention in the military, and to evaluate the effectiveness of the approaches currently being conducted with service members.

Evaluation of Classroom Teachers' Opinions about In-Service Training (The Case of Mugla)

ERIC Educational Resources Information Center

Aykaç, Necdet; Yildirim, Kasim

2017-01-01

The current study aimed to evaluate the classroom teachers' opinions about in-service training process. Thus, the current study was designed as a descriptive case study. A total of 28 classroom teachers constituted the sample group of the research. The research process was carried out on the classroom teachers working in state elementary schools…

The Evaluation of the Studies Related to the New Curriculum of Physics Course: The Case of Turkey

ERIC Educational Resources Information Center

Ergin, Ismet

2013-01-01

The aim of this study is to state the points when choosing a method in studies concerning physics course new curriculum by evaluating researches whose topics are secondary physics course curriculum (in Turkey) in terms of subject, objective, method and consequences. 24 researches conducted within the lines of secondary physics course curriculum…

Medication Exposure in Pregnancy Risk Evaluation Program

PubMed Central

Andrade, Susan E.; Davis, Robert L.; Cheetham, T. Craig; Cooper, William O.; Li, De-Kun; Amini, Thushi; Beaton, Sarah J.; Dublin, Sascha; Hammad, Tarek A.; Pawloski, Pamala A.; Raebel, Marsha A.; Smith, David H.; Staffa, Judy A.; Toh, Sengwee; Dashevsky, Inna; Haffenreffer, Katherine; Lane, Kimberly; Platt, Richard; Scott, Pamela E.

2011-01-01

To describe a program to study medication safety in pregnancy, the Medication Exposure in Pregnancy Risk Evaluation Program (MEPREP). MEPREP is a multi-site collaborative research program developed to enable the conduct of studies of medication use and outcomes in pregnancy. Collaborators include the U.S. Food and Drug Administration and researchers at the HMO Research Network, Kaiser Permanente Northern and Southern California, and Vanderbilt University. Datasets have been created at each site linking healthcare data for women delivering an infant between January 1, 2001 and December 31, 2008 and infants born to these women. Standardized data files include maternal and infant characteristics, medication use, and medical care at 11 health plans within 9 states; birth certificate data were obtained from the state departments of public health. MEPREP currently involves more than 20 medication safety researchers and includes data for 1,221,156 children delivered to 933,917 mothers. Current studies include evaluations of the prevalence and patterns of use of specific medications and a validation study of data elements in the administrative and birth certificate data files. MEPREP can support multiple studies by providing information on a large, ethnically and geographically diverse population. This partnership combines clinical and research expertise and data resources to enable the evaluation of outcomes associated with medication use during pregnancy. PMID:22002179

Medication Exposure in Pregnancy Risk Evaluation Program.

PubMed

Andrade, Susan E; Davis, Robert L; Cheetham, T Craig; Cooper, William O; Li, De-Kun; Amini, Thushi; Beaton, Sarah J; Dublin, Sascha; Hammad, Tarek A; Pawloski, Pamala A; Raebel, Marsha A; Smith, David H; Staffa, Judy A; Toh, Sengwee; Dashevsky, Inna; Haffenreffer, Katherine; Lane, Kimberly; Platt, Richard; Scott, Pamela E

2012-10-01

To describe a program to study medication safety in pregnancy, the Medication Exposure in Pregnancy Risk Evaluation Program (MEPREP). MEPREP is a multi-site collaborative research program developed to enable the conduct of studies of medication use and outcomes in pregnancy. Collaborators include the U.S. Food and Drug Administration and researchers at the HMO Research Network, Kaiser Permanente Northern and Southern California, and Vanderbilt University. Datasets have been created at each site linking healthcare data for women delivering an infant between January 1, 2001 and December 31, 2008 and infants born to these women. Standardized data files include maternal and infant characteristics, medication use, and medical care at 11 health plans within 9 states; birth certificate data were obtained from the state departments of public health. MEPREP currently involves more than 20 medication safety researchers and includes data for 1,221,156 children delivered to 933,917 mothers. Current studies include evaluations of the prevalence and patterns of use of specific medications and a validation study of data elements in the administrative and birth certificate data files. MEPREP can support multiple studies by providing information on a large, ethnically and geographically diverse population. This partnership combines clinical and research expertise and data resources to enable the evaluation of outcomes associated with medication use during pregnancy.

A Mixed Methods Content Analysis of the Research Literature in Science Education

NASA Astrophysics Data System (ADS)

Schram, Asta B.

2014-10-01

In recent years, more and more researchers in science education have been turning to the practice of combining qualitative and quantitative methods in the same study. This approach of using mixed methods creates possibilities to study the various issues that science educators encounter in more depth. In this content analysis, I evaluated 18 studies from science education journals as they relate to the definition, design, and overall practice of using mixed methods. I scrutinized a purposeful sample, derived from 3 journals (the International Journal of Science Education, the Journal of Research in Science Teaching, and the Research in Science Education) in terms of the type of data collected, timing, priority, design, the mixing of the 2 data strands in the studies, and the justifications authors provide for using mixed methods. Furthermore, the articles were evaluated in terms of how well they met contemporary definitions for mixed methods research. The studies varied considerably in the use and understanding of mixed methods. A systematic evaluation of the employment of mixed methods methodology was used to identify the studies that best reflected contemporary definitions. A comparison to earlier content analyses of mixed methods research indicates that researchers' knowledge of mixed methods methodology may be increasing. The use of this strategy in science education research calls, however, for an improved methodology, especially concerning the practice of mixing. Suggestions are given on how to best use this approach.

Gear and Transmission Research at NASA Lewis Research Center

NASA Technical Reports Server (NTRS)

Townsend, Dennis P.

1997-01-01

This paper is a review of some of the research work of the NASA Lewis Research Center Mechanical Components Branch. It includes a brief review of the NASA Lewis Research Center and the Mechanical Components Branch. The research topics discussed are crack propagation of gear teeth, gear noise of spiral bevel and other gears, design optimization methods, methods we have investigated for transmission diagnostics, the analytical and experimental study of gear thermal conditions, the analytical and experimental study of split torque systems, the evaluation of several new advanced gear steels and transmission lubricants and the evaluation of various aircraft transmissions. The area of research needs for gearing and transmissions is also discussed.

Evaluating the Quality of Education at Dentistry School of Tehran University of Medical Sciences

PubMed Central

Farzianpour, Fereshteh; Monzavi, Abbas; Yassini, Esmaeil

2011-01-01

Background: Educational evaluation is a process which deals with data collection and assessment of academic activities’ progress. In this research, educational evaluation of Dentistry School of Tehran University of Medical Sciences, which trains students in undergraduate and residency courses, was studied. Methods: This descriptive study was done with a model of educational evaluation in ten steps and 13 fields including purposes and mission objectives, management and organization, academic board members, students, human resources and support, educational, research, health and treatment spaces, educational, diagnostic, research and laboratory tools, educational, research, health and treatment programs and courses, process of teaching and learning, evaluation and assessment, alumni, and patients satisfaction. Data were collected using observation, interviews, questionnaires, and checklists. Results: Results of the study were mainly qualitative and in some cases quantitative, based on defined optimal situation. The total mean of qualitative results of educational evaluation of dentistry school in all 13 fields was 55.98% which is relatively desirable. In the case of quantitative ones, results of some fields such as treatment quality of patients and education and learning of the students were relatively desirable (61.32% and 60.16% respectively). Conclusion: According to the results, educational goals and missions, educational and research facilities and spaces which were identified as the weakest areas need to be considered and paid more serious attention. PMID:22013466

Nondestructive evaluation of MoDOT bridge decks : pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Nondestructive evaluation of MoDOT bridge decks : pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition assessments. The primary nondestructive : testing/evaluation (NDT/NDE) technique utilized in this research was ground-coupled ground penetrating radar ...

Safety evaluation of centerline rumble strips

DOT National Transportation Integrated Search

2003-11-10

A study of centerline rumble strips was undertaken as part of the Massachusetts Highway Department Research Program. The objective of this research was to evaluate the effectiveness of centerline rumble strips in reducing crossover crashes and improv...

Evaluation of a program to increase evidence-based practice change.

PubMed

Larrabee, June H; Sions, Jacqueline; Fanning, Mary; Withrow, Mary Lynne; Ferretti, Andrea

2007-06-01

The study evaluated a nursing research program designed to achieve systematic evidence-based practice change. Specifically, change in nurse attitudes about use of research and research conduct, practice change projects, and nurse participation in research-related activities were evaluated. Evidence indicates that successful evidence-based practice change in an organization requires senior leadership support and a systematic program for practice change. Evaluation of program effectiveness provides evidence about opportunities for further improvement. Quantitative evaluation used a pretest-posttest design. The site was an academic medical center in rural West Virginia. Participants were registered nurses from all inpatients units, perioperative services, and emergency departments. Surveys used Alcock et al's Staff Nurses and Research Activities scale. Descriptive evaluation included the number of nurses who attended the workshop, practice change projects, scholarly products disseminated, and outcome of a Magnet review. First, knowledge about the availability of support services increased between 1999 and 2002 and was associated with higher attitude scores about research and research utilization. Second, registered nurses who reported participating in research-related activities had more positive scores on all attitudes than registered nurses who reported not participating. Nurse leaders may improve participation and attitudes about research and research utilization by internally marketing the support available for research-related activities.

Evaluation systems for clinical governance development: a comparative study.

PubMed

Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein

2014-01-01

Lack of scientific and confirmed researches and expert knowledge about evaluation systems for clinical governance development in Iran have made studies on different evaluation systems for clinical governance development a necessity. These studies must provide applied strategies to design criteria of implementing clinical governance for hospital's accreditation. This is a descriptive and comparative study on development of clinical governance models all over the world. Data have been gathered by reviewing related articles. Models have been studied in comprehensive review method. The evaluated models of clinical governance development were Australian, NHS, SPOCK and OPTIGOV. The final aspects extracted from these models were Responsiveness, Policies and Strategies, Organizational Structure, Allocating Resources, Education and Occupational Development, Performance Evaluation, External Evaluation, Patient Oriented Approach, Risk Management, Personnel's Participation, Information Technology, Human Resources, Research and Development, Evidence Based Medicine, Clinical Audit, Health Technology Assessment and Quality. These results are applicable for completing the present criteria which evaluating clinical governance application and provide practical framework to evaluate country's hospital on the basis of clinical governance elements.

78 FR 55068 - Request for Information To Inform the Title III Evaluation and Research Studies Agenda

Federal Register 2010, 2011, 2012, 2013, 2014

2013-09-09

... DEPARTMENT OF EDUCATION [Docket ID ED-2013-OELA-0117] Request for Information To Inform the Title III Evaluation and Research Studies Agenda AGENCY: Office of English Language Acquisition, Language..., Title III of the ESEA requires States to develop English language proficiency (ELP) standards that are...

77 FR 8856 - FIFRA Scientific Advisory Panel; Notice of Public Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2012-02-15

..., sources of research support. The EPA will evaluate the candidates financial disclosure form to assess... results of both in vivo and in vitro studies on chlorpyrifos have led some research groups to propose that..., there are epidemiology studies evaluating pre- and post-natal chlorpyrifos or other OP exposure in...

Community interventions providing care and support to orphans and vulnerable children: a review of evaluation evidence.

PubMed

Schenk, Katie D

2009-07-01

Children affected by HIV in their families and communities face multiple risks to their health, education and psychosocial wellbeing. Community interventions for children who have been orphaned or rendered vulnerable take many forms, including educational assistance, home-based care, legal protection and psychosocial support. Despite a recent influx of funding for programme implementation, there exists little evidence to inform policymakers about whether their investments are improving the lives of vulnerable children and meeting key benchmarks including the Millennium Development Goals. This paper reviews the current evidence base on evaluations of community interventions for orphans and vulnerable children (OVC) in high HIV-prevalence African settings, focusing on studies' methodologies. Sources reviewed include published research studies and evidence from the unpublished programmatic "grey literature" located through database and internet searches. A total of 21 studies, varying in scope and generalisability, were identified. Interventions reviewed address children's wellbeing through various strategies within their communities. Evaluation methodologies reflect quantitative and qualitative approaches, including surveys (with and without baseline or comparison data), costing studies, focus groups, interviews, case studies, and participatory review techniques. Varied study methodologies reflect diverse research questions, various intervention types, and the challenges associated with evaluating complex interventions; highlighting the need to broaden the research paradigm in order to build the evidence base by including quasi-experimental and process evaluation approaches, and seeking further insights through participatory qualitative methodologies and costing studies. Although findings overall indicate the value of community interventions in effecting measurable improvements in child and family wellbeing, the quality and rigour of evidence is varied. A strategic research agenda is urgently needed to inform resource allocation and programme management decisions. Immediate imperatives include building local technical capacity to conduct quantitative and qualitative evaluation research, and strengthening monitoring and evaluation systems to collect process and outcome data (including costing) on key support models. Donors and implementers must support the collection of sound empirical evidence to inform the development and scale-up of OVC programmes.

Scleroderma Research Foundation

MedlinePlus

... with suspected lung hypertension. Scleroderma Patients Needed for Research Study to Evaluate Internet Self-Management Program January-2017 ... year before a standard clinical test could. Clinical Research Study for Scleroderma with Interstitial Lung Disease (lung scarring) ...

A Study of Facilities and Infrastructure Planning, Prioritization, and Assessment at Federal Security Laboratories (Revised)

DTIC Science & Technology

2013-02-01

or funds authorized under Section 219(a) for projects costing no more than $4M. Research , Development, Test , and Evaluation (RDT&E) Appropriations...The RDT&E appropriation consists of the mission program budgets for all research , development, test and evaluation work performed by contractors...carry out an unspecified minor military construction project costing not more than $4,000,000. 9 f. Research , Development, Test , and Evaluation

Attitudes of affiliate faculty members toward medical student summative evaluation for clinical clerkships: a qualitative analysis.

PubMed

Wang, Karen E; Fitzpatrick, Caroline; George, David; Lane, Lindsey

2012-01-01

Summative evaluation of medical students is a critical component of the educational process. Despite extensive literature on evaluation, few studies have centered on affiliate faculty members' attitudes toward summative evaluation of students, though it has been suggested that these attitudes influence their effectiveness as evaluators. The objective is to examine affiliate faculty members' attitudes toward clinical clerkship evaluation using primarily qualitative research methods. The study used a nonexperimental research design and employed mixed methods. Data were collected through interviews, focus groups, and a questionnaire from 11 affiliate faculty members. Themes emerging from the data fell into three broad categories: (a) factors that influence grading, (b) consequences of negative evaluations, and (c) disconnections in the grading process. The quantitative portion of the study revealed important discrepancies supporting the use of qualitative methods. The study highlights faculty members' struggles with the evaluative process and emphasizes the need for improvements in evaluation tools and faculty development.

Making Research Delicious: An Evaluation of Nurses' Knowledge, Attitudes, and Practice Using the Great American Cookie Experiment With Mobile Device Gaming.

PubMed

Hayes Lane, Susan; Serafica, Reimund; Huffman, Carolyn; Cuddy, Alyssa

2016-01-01

In the current healthcare environment, nurses must have a basic understanding of research to lead change and implement evidence-based practice. The purpose of this study was to evaluate the effectiveness of an educational intervention formulated on the framework of the Great American Cookie Experiment measuring nurses' research knowledge, attitudes, and practice using mobile device gaming. This multisite quantitative study provides insight into promotion of research and information about best practices on innovative teaching strategies for nurses.

Traversing the many paths of workflow research: developing a conceptual framework of workflow terminology through a systematic literature review

PubMed Central

Novak, Laurie L; Johnson, Kevin B; Lorenzi, Nancy M

2010-01-01

The objective of this review was to describe methods used to study and model workflow. The authors included studies set in a variety of industries using qualitative, quantitative and mixed methods. Of the 6221 matching abstracts, 127 articles were included in the final corpus. The authors collected data from each article on researcher perspective, study type, methods type, specific methods, approaches to evaluating quality of results, definition of workflow and dependent variables. Ethnographic observation and interviews were the most frequently used methods. Long study durations revealed the large time commitment required for descriptive workflow research. The most frequently discussed technique for evaluating quality of study results was triangulation. The definition of the term “workflow” and choice of methods for studying workflow varied widely across research areas and researcher perspectives. The authors developed a conceptual framework of workflow-related terminology for use in future research and present this model for use by other researchers. PMID:20442143

Do College Students Notice Errors in Evidence When Critically Evaluating Research Findings?

ERIC Educational Resources Information Center

Rodriguez, Fernando; Ng, Annalyn; Shah, Priti

2016-01-01

The authors examined college students' ability to critically evaluate scientific evidence, specifically, whether first- and second-year students noticed when poor interpretations were drawn from research evidence. Fifty students evaluated a set of eight psychological studies, first in an informal context, then again in a critical-thinking context.…

Interviewer as Instrument: Accounting for Human Factors in Evaluation Research

ERIC Educational Resources Information Center

Brown, Joel H.

2006-01-01

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug,…

From "At Risk" to "At Promise": An Evaluation of an Early Reading First Project

ERIC Educational Resources Information Center

Zoll, Susan Marie

2012-01-01

This study demonstrates the impact of an Early Reading First intervention on preschool children's language and literacy development using an ex post facto, causal-comparative research design. The project's professional development model was evaluated to produce a process and outcome evaluation to answer two overarching research questions: (1) What…

The Evaluation of Industry Practical of Mechanical Engineering in Vocational Education: A CIPP Model Approach

NASA Astrophysics Data System (ADS)

Kamaludin, M.; Munawar, W.; Mahdan, D.; Simanjuntak, M. V.; Wendi, H. F.

2018-02-01

The learning system is not only studied on campus but also practicing in the world of work. Industry Practical aims to enable students to develop their skills in accordance with the real world of work. To know the success of the implementation of industry practical program then held evaluation. The evaluation of the program in this study used the CIPP evaluation approach (Context, Input, Process, Product). The purpose of this research is to know the extent of achievement and success of industry practical program at vocational school in Bandung with descriptive research method using mix method approach. The sample in this research is students majoring in mechanical engineering in the city of Bandung who have done industry practical.

Algorithms for detecting and predicting influenza outbreaks: metanarrative review of prospective evaluations

PubMed Central

Spreco, A; Timpka, T

2016-01-01

Objectives Reliable monitoring of influenza seasons and pandemic outbreaks is essential for response planning, but compilations of reports on detection and prediction algorithm performance in influenza control practice are largely missing. The aim of this study is to perform a metanarrative review of prospective evaluations of influenza outbreak detection and prediction algorithms restricted settings where authentic surveillance data have been used. Design The study was performed as a metanarrative review. An electronic literature search was performed, papers selected and qualitative and semiquantitative content analyses were conducted. For data extraction and interpretations, researcher triangulation was used for quality assurance. Results Eight prospective evaluations were found that used authentic surveillance data: three studies evaluating detection and five studies evaluating prediction. The methodological perspectives and experiences from the evaluations were found to have been reported in narrative formats representing biodefence informatics and health policy research, respectively. The biodefence informatics narrative having an emphasis on verification of technically and mathematically sound algorithms constituted a large part of the reporting. Four evaluations were reported as health policy research narratives, thus formulated in a manner that allows the results to qualify as policy evidence. Conclusions Awareness of the narrative format in which results are reported is essential when interpreting algorithm evaluations from an infectious disease control practice perspective. PMID:27154479

Current Status of the Matson Evaluation of Drug Side Effects (MEDS)

ERIC Educational Resources Information Center

Matson, Johnny L.; Cervantes, Paige E.

2013-01-01

The Matson Evaluation of Drug Side Effects (MEDS) is currently the best established and most researched measure of drug side effects in the intellectual disability (ID) literature. Initial research was conducted on its psychometric properties such as reliability and validity. More recent research studies have used the measure to determine the…

Trends in Autism Research: A Systematic Journal Analysis

ERIC Educational Resources Information Center

Graff, Heidi J.; Berkeley, Sheri; Evmenova, Anya S.; Park, Kristy L.

2014-01-01

Autism Spectrum Disorder (ASD) is a lifelong disability for which prevalence rates continue to increase. Persons with ASD vary widely in both severity of disability and services required. Therefore it is important to identify trends in research and evaluate progress in the field. The current study uses a journal analysis to evaluate research over…

Traveling beyond Dangerous Private and Universal Discourses: Radioactivity of Radical Hermeneutics and Objectivism in Educational Research

ERIC Educational Resources Information Center

Eryaman, Mustafa Yunus

2006-01-01

In this article, the author explores several definitions of reading and evaluating educational research texts without finding deep private meanings or developing objective, scientific, and instrumental norms for evaluating quality of educational research studies. Among these descriptions, the author emphasizes Gadamer's weak poststructural model…

Projected outcomes of a public-industry partnership for enhancing corn nitrogen research and datasets

USDA-ARS?s Scientific Manuscript database

Research is needed over a wide geographic range of soil and weather scenarios to evaluate methods and tools for corn N fertilizer applications. The objectives of this research were to conduct standardized corn N rate response field studies to evaluate the performance of multiple public-domain N deci...

The effects of stakeholder involvement on perceptions of an evaluation's credibility.

PubMed

Jacobson, Miriam R; Azzam, Tarek

2018-06-01

This article presents a study of the effects of stakeholder involvement on perceptions of an evaluation's credibility. Crowdsourced members of the public and a group of educational administrators read a description of a hypothetical program and two evaluations of the program: one conducted by a researcher and one conducted by program staff (i.e. program stakeholders). Study participants were randomly assigned versions of the scenario with different levels of stakeholder credibility and types of findings. Results showed that both samples perceived the researcher's evaluation findings to be more credible than the program staff's, but that this difference was significantly reduced when the program staff were described to be highly credible. The article concludes with implications for theory and research on evaluation dissemination and stakeholder involvement. Copyright © 2018 Elsevier Ltd. All rights reserved.

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

PubMed

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Reach, engagement, and effectiveness: a systematic review of evaluation methodologies used in health promotion via social networking sites.

PubMed

Lim, Megan S C; Wright, Cassandra J C; Carrotte, Elise R; Pedrana, Alisa E

2016-02-01

Issue addressed Social networking sites (SNS) are increasingly popular platforms for health promotion. Advancements in SNS health promotion require quality evidence; however, interventions are often not formally evaluated. This study aims to describe evaluation practices used in SNS health promotion. Methods A systematic review was undertaken of Medline, PsycINFO, Scopus, EMBASE, CINAHL Plus, Communication and Mass Media Complete, and Cochrane Library databases. Articles published between 2006 and 2013 describing any health promotion intervention delivered using SNS were included. Results Forty-seven studies were included. There were two main evaluation approaches: closed designs (n=23), which used traditional research designs and formal recruitment procedures; and open designs (n=19), which evaluated the intervention in a real-world setting, allowing unknown SNS users to interact with the content without enrolling in research. Closed designs were unable to assess reach and engagement beyond their research sample. Open designs often relied on weaker study designs with no use of objective outcome measures and yielded low response rates. Conclusions Barriers to evaluation included low participation rates, high attrition, unknown representativeness and lack of comparison groups. Acceptability was typically assessed among those engaged with the intervention, with limited population data available to accurately assess intervention reach. Few studies were able to assess uptake of the intervention in a real-life setting while simultaneously assessing effectiveness of interventions with research rigour. So what? Through use of quasi-experimental or well designed before-after evaluations, in combination with detailed engagement metrics, it is possible to balance assessment of effectiveness and reach to evaluate SNS health promotion.

Nuclear density evaluation on asphaltic concrete: final report.

DOT National Transportation Integrated Search

1967-04-01

This study was one of two studies designated as Research Project 62-1SB to evaluate the use of nuclear devices in highway construction. (1) The primary objective of this study was to evaluate a nuclear density device for obtaining densities on asphal...

Evaluation Policy in a Nonprofit Foundation: A Case Study Exploration of the Robert Wood Johnson Foundation

ERIC Educational Resources Information Center

Dillman, Lisa M.; Christie, Christina A.

2017-01-01

This study explores the relationship between evaluation policies and evaluation practice. Through document analysis, interviews, and a multiple case study, the research examined the explicit and implicit policies overarching the evaluation work commissioned by the Robert Wood Johnson Foundation (RWJF) and explored how these policies are…

Molasses versus grain: what the research says

USDA-ARS?s Scientific Manuscript database

This article summarizes the results of a three-tiered research approach (case study, two continuous culture fermenter studies, and two controlled research farm studies) to evaluate molasses as an alternative supplement source for grazing dairy cows. A two-year case study of a New York organic dairy ...

Design, Implementation and Evaluation of School-Based Sexual Health Education in Sub-Saharan Africa: A Qualitative Study of Researchers' Perspectives

ERIC Educational Resources Information Center

Sani, A. Sadiq; Abraham, Charles; Denford, Sarah; Mathews, Catherine

2018-01-01

This study investigated facilitators and challenges to designing, implementing and evaluating school-based sexual health education in sub-Saharan Africa, using interviews with intervention designers and researchers. At the pre-planning and planning stages, participants reported that facilitating factors included addressing the reproductive health…

Organising, Providing and Evaluating Technical Training for Early Career Researchers: A Case Study

ERIC Educational Resources Information Center

van Besouw, Rachel M.; Rogers, Katrine S.; Powles, Christopher J.; Papadopoulos, Timos; Ku, Emery M.

2013-01-01

This paper considers the importance of providing technical training opportunities for Early Career Researchers (ECRs) worldwide through the case study of a MATLAB training programme, which was proposed, organised, managed and evaluated by a team of five ECRs at the University of Southampton. The effectiveness of the programme in terms of the…

A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation

ERIC Educational Resources Information Center

Acosta, Joie D.; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S.

2016-01-01

Restorative practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this article describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI)…

Task-Based Language Teaching in Online Ab Initio Foreign Language Classrooms

ERIC Educational Resources Information Center

Lai, Chun; Zhao, Yong; Wang, Jiawen

2011-01-01

Task-based language teaching (TBLT) has been attracting the attention of researchers for more than 2 decades. Research on various aspects of TBLT has been accumulating, including the evaluation studies on the implementation of TBLT in classrooms. The evaluation studies on students' and teachers' reactions to TBLT in the online courses are starting…

Review of research on the health of caregiving grandparents.

PubMed

Grinstead, Linda Nicholson; Leder, Sharon; Jensen, Susan; Bond, Linda

2003-11-01

To provide a critical review of research literature on the health of grandparents raising grandchildren, and identify directions for future research. Approaches used to access the research studies for this review included a comprehensive search using relevant electronic databases and a thorough examination of the references in each published study. All studies but one were published after 1990. Samples consisted primarily of African-American and Caucasian grandmothers in the United States of America. Earlier studies tended to describe health and other related concepts while more recent studies began to examine relationships between concepts. Most of the studies had a cross-sectional design and only one evaluated interventions. Inconsistencies in the results of these studies were prevalent. Evaluation studies, longitudinal designs, and more varied study samples including cross-cultural comparisons are needed to advance knowledge about grandparent caregivers' health.

Green noise wall construction and evaluation.

DOT National Transportation Integrated Search

2011-09-01

This report details the research performed under Phase I of a research study titled Green Noise Wall Construction and Evaluation that looks into the feasibility of using green noise barriers as a noise mitigation option in Ohio. This phase incl...

Bridge A1187 : Missouri S&T nondestructive evaluation of bridge decks - pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Bridge A3406 : Missouri S&T nondestructive evaluation of bridge decks - pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Bridge A1479 : Missouri S&T nondestructive evaluation of bridge decks - pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Bridge A2966 : Missouri S&T nondestructive evaluation of bridge decks - pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Bridge A2111 : Missouri S&T nondestructive evaluation of bridge decks - pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Bridge A1297 : Missouri S&T nondestructive evaluation of bridge decks - pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Bridge A1193 : Missouri S&T nondestructive evaluation of bridge decks - pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Bridge A0569 : Missouri S&T nondestructive evaluation of bridge decks - pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Bridge K0197 : Missouri S&T nondestructive evaluation of bridge decks - pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Bridge A3017 : Missouri S&T nondestructive evaluation of bridge decks - pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Bridge A3405 : Missouri S&T nondestructive evaluation of bridge decks - pilot study.

DOT National Transportation Integrated Search

2014-03-01

This research has examined the use of nondestructive techniques for concrete bridge deck condition : assessments. The primary nondestructive testing/evaluation (NDT/NDE) technique utilized in this research : was ground-coupled ground penetrating rada...

Core Domains for Clinical Research in Acute Respiratory Failure Survivors: An International Modified Delphi Consensus Study.

PubMed

Turnbull, Alison E; Sepulveda, Kristin A; Dinglas, Victor D; Chessare, Caroline M; Bingham, Clifton O; Needham, Dale M

2017-06-01

To identify the "core domains" (i.e., patient outcomes, health-related conditions, or aspects of health) that relevant stakeholders agree are essential to assess in all clinical research studies evaluating the outcomes of acute respiratory failure survivors after hospital discharge. A two-round consensus process, using a modified Delphi methodology, with participants from 16 countries, including patient and caregiver representatives. Prior to voting, participants were asked to review 1) results from surveys of clinical researchers, acute respiratory failure survivors, and caregivers that rated the importance of 19 preliminary outcome domains and 2) results from a qualitative study of acute respiratory failure survivors' outcomes after hospital discharge, as related to the 19 preliminary outcome domains. Participants also were asked to suggest any additional potential domains for evaluation in the first Delphi survey. Web-based surveys of participants representing four stakeholder groups relevant to clinical research evaluating postdischarge outcomes of acute respiratory failure survivors: clinical researchers, clinicians, patients and caregivers, and U.S. federal research funding organizations. None. None. Survey response rates were 97% and 99% in round 1 and round 2, respectively. There were seven domains that met the a priori consensus criteria to be designated as core domains: physical function, cognition, mental health, survival, pulmonary function, pain, and muscle and/or nerve function. This study generated a consensus-based list of core domains that should be assessed in all clinical research studies evaluating acute respiratory failure survivors after hospital discharge. Identifying appropriate measurement instruments to assess these core domains is an important next step toward developing a set of core outcome measures for this field of research.

The implementation and evaluation of therapeutic touch in burn patients: an instructive experience of conducting a scientific study within a non-academic nursing setting.

PubMed

Busch, Martine; Visser, Adriaan; Eybrechts, Maggie; van Komen, Rob; Oen, Irma; Olff, Miranda; Dokter, Jan; Boxma, Han

2012-12-01

Evaluation of therapeutic touch (TT) in the nursing of burn patients; post hoc evaluation of the research process in a non-academic nursing setting. 38 burn patients received either TT or nursing presence. On admission, days 2, 5 and 10 of hospitalization, data were collected on anxiety for pain, salivary cortisol, and pain medication. Interviews with nurses were held concerning research in a non-academic setting. Anxiety for pain was more reduced on day 10 in the TT-group. The TT-group was prescribed less morphine on day 1 and 2. On day 2 cortisol level before dressing changes was higher in the TT-group. The situational challenges of this study led to inconsistencies in data collection and a high patient attrition rate, weakening its statistical power. Conducting an effect study within daily nursing practice should not be done with a nursing staff inexperienced in research. Analysis of the remaining data justifies further research on TT for burn patients with pain, anxiety for pain, and cortisol levels as outcomes. Administering and evaluating TT during daily care requires nurses experienced both in TT and research, thus leading to less attrition and missing data, increasing the power of future studies. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Clinical relevance vs. statistical significance: Using neck outcomes in patients with temporomandibular disorders as an example.

PubMed

Armijo-Olivo, Susan; Warren, Sharon; Fuentes, Jorge; Magee, David J

2011-12-01

Statistical significance has been used extensively to evaluate the results of research studies. Nevertheless, it offers only limited information to clinicians. The assessment of clinical relevance can facilitate the interpretation of the research results into clinical practice. The objective of this study was to explore different methods to evaluate the clinical relevance of the results using a cross-sectional study as an example comparing different neck outcomes between subjects with temporomandibular disorders and healthy controls. Subjects were compared for head and cervical posture, maximal cervical muscle strength, endurance of the cervical flexor and extensor muscles, and electromyographic activity of the cervical flexor muscles during the CranioCervical Flexion Test (CCFT). The evaluation of clinical relevance of the results was performed based on the effect size (ES), minimal important difference (MID), and clinical judgement. The results of this study show that it is possible to have statistical significance without having clinical relevance, to have both statistical significance and clinical relevance, to have clinical relevance without having statistical significance, or to have neither statistical significance nor clinical relevance. The evaluation of clinical relevance in clinical research is crucial to simplify the transfer of knowledge from research into practice. Clinical researchers should present the clinical relevance of their results. Copyright © 2011 Elsevier Ltd. All rights reserved.

Togetherness, Teamwork and Challenges: "Reflections on Building an Inclusive Research Network"

ERIC Educational Resources Information Center

Riches, Tanya N.; O'Brien, Patricia M.

2017-01-01

Background: This article presents a case study of the Centre for Disability Studies' Inclusive Research Network. The network is a dynamic group of around fifteen people who have intellectual and other disabilities, support workers and university researchers. Methods: The study was based upon an evaluation of the group's research practice, as…

Evaluating Management Strategies for Automated Test Systems/Equipment (ATS/E): An F-15 Case Study

DTIC Science & Technology

2005-03-01

ethnography , grounded theory , case study , phenomenological research , and narrative research (also known as bibliography from...Creswell, 2003:183). Example inquiry strategies identified by Creswell are: narrative , phenomenology , ethnography , case study , and grounded theory ...other managed systems. Methodology The researcher chose a qualitative research methodology and

Improving the Reporting Quality of Nonrandomized Evaluations of Behavioral and Public Health Interventions: The TREND Statement

PubMed Central

Des Jarlais, Don C.; Lyles, Cynthia; Crepaz, Nicole

2004-01-01

Developing an evidence base for making public health decisions will require using data from evaluation studies with randomized and nonrandomized designs. Assessing individual studies and using studies in quantitative research syntheses require transparent reporting of the study, with sufficient detail and clarity to readily see differences and similarities among studies in the same area. The Consolidated Standards of Reporting Trials (CONSORT) statement provides guidelines for transparent reporting of randomized clinical trials. We present the initial version of the Transparent Reporting of Evaluations with Nonrandomized Designs (TREND) statement. These guidelines emphasize the reporting of theories used and descriptions of intervention and comparison conditions, research design, and methods of adjusting for possible biases in evaluation studies that use nonrandomized designs. PMID:14998794

Evaluating Community-Based Participatory Research to Improve Community-Partnered Science and Community Health

PubMed Central

Hicks, Sarah; Duran, Bonnie; Wallerstein, Nina; Avila, Magdalena; Belone, Lorenda; Lucero, Julie; Magarati, Maya; Mainer, Elana; Martin, Diane; Muhammad, Michael; Oetzel, John; Pearson, Cynthia; Sahota, Puneet; Simonds, Vanessa; Sussman, Andrew; Tafoya, Greg; Hat, Emily White

2013-01-01

Background Since 2007, the National Congress of American Indians (NCAI) Policy Research Center (PRC) has partnered with the Universities of New Mexico and Washington to study the science of community-based participatory research (CBPR). Our goal is to identify facilitators and barriers to effective community–academic partnerships in American Indian and other communities, which face health disparities. Objectives We have described herein the scientific design of our National Institutes of Health (NIH)-funded study (2009–2013) and lessons learned by having a strong community partner leading the research efforts. Methods The research team is implementing a mixed-methods study involving a survey of principal investigators (PIs) and partners across the nation and in-depth case studies of CBPR projects. Results We present preliminary findings on methods and measures for community-engaged research and eight lessons learned thus far regarding partnership evaluation, advisory councils, historical trust, research capacity development of community partner, advocacy, honoring each other, messaging, and funding. Conclusions Study methodologies and lessons learned can help community–academic research partnerships translate research in communities. PMID:22982842

Evaluation of the adequacy of information from research on infant mortality in Recife, Pernambuco, Brazil.

PubMed

Oliveira, Conceição Maria de; Guimarães, Maria José Bezerra; Bonfim, Cristine Vieira do; Frias, Paulo Germano; Antonino, Verônica Cristina Sposito; Guimarães, Aline Luzia Sampaio; Medeiros, Zulma Maria

2018-03-01

This study is an evaluation of infant death research in Recife, Pernambuco (PE). It is a cross-sectional study with 120 variables grouped into six dimensions (prenatal, birth, child care, family characteristics, occurrence of death, and conclusion and recommendations), weighted by consensus technique. The research was classifiedas adequate, partially adequate or inadequate according to a composite indicator assessment (ICA). There was dissension on 11 variables (9 in prenatal dimension, one in labor and birth, and 1 in the conclusions and recommendations). Of the 568 deaths studied, 56.2% have adequate research. The occurrence of death was the best-evaluated dimension and prenatal the poorest. The preparation of the ICA enables professionals and managers of child health policies to identify bottlenecks in the investigation of infant deaths for better targeting of actions, and contributing to the discussion about surveillance in other cities and states.

An Investigation of Research-Based Teaching Practices through the Teacher Evaluations in Indiana Public Schools

ERIC Educational Resources Information Center

Sargent, Michael Steven

2014-01-01

The purpose of this study was to identify if a relationship existed between the implementation of professional evaluation processes and the use of research-based teaching practices, factoring in both perceptions of principals and practicing teachers. The variables of professional development on the evaluation model and the principal's years of…

A Survey of Immersive Technology For Maintenance Evaluations

DTIC Science & Technology

1998-04-01

image display system. Based on original work performed at the German National Computer Science and Mathematics Research Institute (GMD), and further...simulations, architectural walk- throughs, medical simulations, general research , entertainment applications and location based entertainment use...simulations. This study was conducted as part of a logistics research and development program Design Evaluation for Personnel, Training, and Human Factors

Culturally Competent Substance Abuse Prevention Research among Rural Native American Communities.

ERIC Educational Resources Information Center

Stubben, Jerry

A study examined the process of evaluating family-oriented substance abuse prevention efforts in three Native American communities. In general, the Native communities exhibited a lack of commitment to academic evaluation research due to concerns over who would gain from such research, how much value was placed on Indian opinions, the level of…

Business Education Students' Evaluation of the Benefits and Challenges Confronting Student Industrial Works Experience Scheme in Edo and Delta States

ERIC Educational Resources Information Center

Olumese, H. A.; Ediagbonya, Kennedy

2016-01-01

This research paper specifically investigated Business Education students' evaluation of the benefits and challenges confronting Student Industrial Works Experience Scheme (SIWES) in Edo and Delta States. Two research questions were raised to guide the study and were answered descriptively. The descriptive survey research design was adopted for…

Issues in evaluation: evaluating assessments of elderly people using a combination of methods.

PubMed

McEwan, R T

1989-02-01

In evaluating a health service, individuals will give differing accounts of its performance, according to their experiences of the service, and the evaluative perspective they adopt. The value of a service may also change through time, and according to the particular part of the service studied. Traditional health care evaluations have generally not accounted for this variability because of the approaches used. Studies evaluating screening or assessment programmes for the elderly have focused on programme effectiveness and efficiency, using relatively inflexible quantitative methods. Evaluative approaches must reflect the complexity of health service provision, and methods must vary to suit the particular research objective. Under these circumstances, this paper presents the case for the use of multiple triangulation in evaluative research, where differing methods and perspectives are combined in one study. Emphasis is placed on the applications and benefits of subjectivist approaches in evaluation. An example of combined methods is provided in the form of an evaluation of the Newcastle Care Plan for the Elderly.

Economic Evaluation of Environmental Health Interventions to Support Decision Making

PubMed Central

Hutton, Guy

2008-01-01

Environmental burden of disease represents one quarter of overall disease burden, hence necessitating greater attention from decision makers both inside and outside the health sector. Economic evaluation techniques such as cost-effectiveness analysis and cost-benefit analysis provide key information to health decision makers on the efficiency of environmental health interventions, assisting them in choosing interventions which give the greatest social return on limited public budgets and private resources. The aim of this article is to review economic evaluation studies in three environmental health areas—water, sanitation, hygiene (WSH), vector control, and air pollution—and to critically examine the policy relevance and scientific quality of the studies for selecting and funding public programmers. A keyword search of Medline from 1990–2008 revealed 32 studies, and gathering of articles from other sources revealed a further 18 studies, giving a total of 50 economic evaluation studies (13 WSH interventions, 16 vector control and 21 air pollution). Overall, the economic evidence base on environmental health interventions remains relatively weak—too few studies per intervention, of variable scientific quality and from diverse locations which limits generalisability of findings. Importantly, there still exists a disconnect between economic research, decision making and programmer implementation. This can be explained by the lack of translation of research findings into accessible documentation for policy makers and limited relevance of research findings, and the often low importance of economic evidence in budgeting decisions. These findings underline the importance of involving policy makers in the defining of research agendas and commissioning of research, and improving the awareness of researchers of the policy environment into which their research feeds. PMID:21572840

Mathematics interventions for children and adolescents with Down syndrome: a research synthesis.

PubMed

Lemons, C J; Powell, S R; King, S A; Davidson, K A

2015-08-01

Many children and adolescents with Down syndrome fail to achieve proficiency in mathematics. Researchers have suggested that tailoring interventions based on the behavioural phenotype may enhance efficacy. The research questions that guided this review were (1) what types of mathematics interventions have been empirically evaluated with children and adolescents with Down syndrome?; (2) do the studies demonstrate sufficient methodological rigor?; (3) is there evidence of efficacy for the evaluated mathematics interventions?; and (4) to what extent have researchers considered aspects of the behavioural phenotype in selecting, designing and/or implementing mathematics interventions for children and adolescents with Down syndrome? Nine studies published between 1989 and 2012 were identified for inclusion. Interventions predominantly focused on early mathematics skills and reported positive outcomes. However, no study met criteria for methodological rigor. Further, no authors explicitly considered the behavioural phenotype. Additional research using rigorous experimental designs is needed to evaluate the efficacy of mathematics interventions for children and adolescents with Down syndrome. Suggestions for considering the behavioural phenotype in future research are provided. © 2015 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Evaluating radiographers' diagnostic accuracy in screen-reading mammograms: what constitutes a quality study?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Debono, Josephine C, E-mail: josephine.debono@bci.org.au; Poulos, Ann E; Westmead Breast Cancer Institute, Westmead, New South Wales

The aim of this study was to first evaluate the quality of studies investigating the diagnostic accuracy of radiographers as mammogram screen-readers and then to develop an adapted tool for determining the quality of screen-reading studies. A literature search was used to identify relevant studies and a quality evaluation tool constructed by combining the criteria for quality of Whiting, Rutjes, Dinnes et al. and Brealey and Westwood. This constructed tool was then applied to the studies and subsequently adapted specifically for use in evaluating quality in studies investigating diagnostic accuracy of screen-readers. Eleven studies were identified and the constructed toolmore » applied to evaluate quality. This evaluation resulted in the identification of quality issues with the studies such as potential for bias, applicability of results, study conduct, reporting of the study and observer characteristics. An assessment of the applicability and relevance of the tool for this area of research resulted in adaptations to the criteria and the development of a tool specifically for evaluating diagnostic accuracy in screen-reading. This tool, with further refinement and rigorous validation can make a significant contribution to promoting well-designed studies in this important area of research and practice.« less

Evaluation of XV-15 tilt rotor aircraft for flying qualities research application

NASA Technical Reports Server (NTRS)

Radford, R. C.; Schelhorn, A. E.; Siracuse, R. J.; Till, R. D.; Wasserman, R.

1976-01-01

The results of a design review study and evaluation of the XV-15 Tilt Rotor Research Aircraft for flying qualities research application are presented. The objectives of the program were to determine the capability of the XV-15 aircraft and the V/STOLAND system as a safe, inflight facility to provide meaningful research data on flying qualities, flight control systems, and information display systems.

Using mixed methods to develop and evaluate complex interventions in palliative care research.

PubMed

Farquhar, Morag C; Ewing, Gail; Booth, Sara

2011-12-01

there is increasing interest in combining qualitative and quantitative research methods to provide comprehensiveness and greater knowledge yield. Mixed methods are valuable in the development and evaluation of complex interventions. They are therefore particularly valuable in palliative care research where the majority of interventions are complex, and the identification of outcomes particularly challenging. this paper aims to introduce the role of mixed methods in the development and evaluation of complex interventions in palliative care, and how they may be used in palliative care research. the paper defines mixed methods and outlines why and how mixed methods are used to develop and evaluate complex interventions, with a pragmatic focus on design and data collection issues and data analysis. Useful texts are signposted and illustrative examples provided of mixed method studies in palliative care, including a detailed worked example of the development and evaluation of a complex intervention in palliative care for breathlessness. Key challenges to conducting mixed methods in palliative care research are identified in relation to data collection, data integration in analysis, costs and dissemination and how these might be addressed. the development and evaluation of complex interventions in palliative care benefit from the application of mixed methods. Mixed methods enable better understanding of whether and how an intervention works (or does not work) and inform the design of subsequent studies. However, they can be challenging: mixed method studies in palliative care will benefit from working with agreed protocols, multidisciplinary teams and engaging staff with appropriate skill sets.

Developing nursing and midwifery research priorities: a Health Service Executive (HSE) North West study.

PubMed

Parlour, Randal; Slater, Paul

2014-06-01

The primary purpose of this study was to identify research priorities for nurses and midwives across the Health Service Executive (HSE) North West region. The rationale for the study was underlined during meetings of HSE North West Directors of Nursing and Midwifery in January 2011. It was agreed that a more strategic approach to generating synergy among nursing and midwifery research, evaluation, and evidence-based practice should be developed through the Nursing and Midwifery Planning and Development Unit. The research design was founded upon collaborative processes for consensus building that included the Delphi technique and nominal group technique. The study sample included a panel of experts. Data were collected between March 2011 and December 2011. Findings from this study validate the efficacy of the research methodology in enabling the effective identification of priority areas for research. These include: (a) an evaluation of the impact of postgraduate nursing and midwifery education programs focusing upon patient, professional, and organizational outcomes; (b) development and evaluation of an effective culture of nurse- and midwife-led audit across all services within a Regional Health Trust in Ireland; (c) an examination of the efficacy of approaches to clinical supervision within the context of the Irish health system; (d) an evaluation of the impact of an Advanced Nurse Practitioner role in supporting the effective management of long-term conditions within the context of Regional Health Trust primary care settings in Ireland; and (e) Supporting and developing an ethical framework for nursing and midwifery research within a Regional Health Trust in Ireland. It is anticipated that future work, outlined within this paper, will lead to important improvements in patient care and outcomes. Furthermore, this study provides evidence that a strong nursing and midwifery research agenda can be established upon genuine collaborations and partnerships across varying levels of research knowledge and skills, but with a shared purpose and shared values. © 2014 Sigma Theta Tau International.

Exploring academics' views on designs, methods, characteristics and outcomes of inclusive health research with people with intellectual disabilities: a modified Delphi study

PubMed Central

Frankena, T K; Naaldenberg, J; Cardol, M; Meijering, J V; Leusink, G; van Schrojenstein Lantman-de Valk, H M J

2016-01-01

Background The British Medical Journal's (BMJ's) patient revolution strives for collaboration with patients in healthcare and health research. This paper studies collaboration with people with intellectual disabilities (ID) in health research, also known as inclusive health research. Currently, transparency and agreement among academics is lacking regarding its main aspects, preventing upscaling of the patient revolution. Objective This study aims to gain agreement among academics on 3 aspects of inclusive health research for people with ID: (1) designs and methods, (2) most important characteristics and (3) outcomes. Design A Delphi study was conducted with academics with experience in inclusive (health) research and on people with ID. The study consisted of 2 sequential questionnaire rounds (n=24; n=17), followed by in-depth interviews (n=10). Results Academics agreed on (1) a collaborative approach to be most suitable to inclusive health research, (2) characteristics regarding the accessibility and facilitation of inclusive health research, and (3) several outcomes of inclusive health research for people with ID and healthcare. Other characteristics agreed on included: atmosphere, relationship, engagement, partnership and power. It was stressed that these characteristics ensure meaningful inclusion. Interviewed academics voiced the need for a tool supporting the facilitation and evaluation of inclusive health research. There was ambiguity as to what this tool should comprise and the extent to which it was possible to capture the complex process of inclusive health research. Discussion and conclusions This study underlines the need for transparency, facilitation and evaluation of inclusive health research. The need for in-depth interviews after 2 Delphi rounds underlines its complexity and context dependence. To increase process transparency, future research should focus on gaining insight into inclusive health research in its context. A tool could be developed to facilitate and evaluate inclusive health research. This tool will be partially applicable to participatory research in general and thereby upscale the patient revolution. PMID:27540101

Systematic review of youth mental health service integration research.

PubMed

Kinchin, Irina; Tsey, Komla; Heyeres, Marion; Cadet-James, Yvonne

2016-01-01

Quality mental health care is based on the integration of care across organisations and disciplines. The aims of this study were, first, to assess the extent, characteristics and reported outcomes of publications concerned with youth mental health service integration in Australia and internationally; and second, to investigate the study design quality of evaluative interventions and determine whether the studies report on the cost-effectiveness of the integration in order to inform the reform of youth mental health services by Queensland Health. A systematic search of the peer-reviewed literature and a narrative synthesis were undertaken of English language publications from 21 electronic databases. Inclusion criteria were: published 1998-2014 (inclusive); peer-reviewed research; focused on mental health services integration; reported data for youth aged 12-25 years. The methodological quality of evaluative interventions was assessed using the Quality Assessment Tool for Quantitative Studies developed by the Effective Public Health Practice Project (EPHPP). Twenty-five studies met the inclusion criteria: one (4%) was classified as a measurement research, 13 (52%) as descriptive, and 11 (44%) as interventions including five (45%) evaluative interventions. Four out of the five evaluative interventions reported positive effects of youth mental health service integration. Particular problems included ambiguity of definitions, absence of economic or cost analyses and insufficient consumer involvement. The methodological quality of the interventions was variable with, on average, a moderate level of selection bias and study design. Despite a slight increase in the number of studies in the last couple of years, there are important gaps in the evidence base for youth mental health service integration processes. The relatively small number of evaluative studies and lack of economic evaluations point to the need for additional research in this important area.

The TIPS Evaluation Project: A Theory-Driven Approach to Dissemination Research.

ERIC Educational Resources Information Center

Mulvey, Kevin P.; Hayashi, Susan W.; Hubbard, Susan M.; Kopstien, Andrea; Huang, Judy Y.

2003-01-01

Introduces the special section that focuses on four major studies under the treatment improvement protocols (TIPs) evaluation project. Provides an overview of each article, and addresses the value of using a theory-driven approach to dissemination research. (SLD)

78 FR 36160 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-06-17

... Operations, Management, Evaluation, and Research. OMB Control Number: 0596-0110. Summary of Collection: The... Survey Techniques for Operations, Management, Evaluation and Research (CUSTOMER) study combines several... Agriculture, Office of Information and Regulatory Affairs, Office of Management and Budget (OMB), New...

Research note : field control of asphalt concrete paving mixtures.

DOT National Transportation Integrated Search

1995-01-01

The goal of this study was to develop information and evaluate new methods for controlling quality of the AC mixture in the mat. Specifically, this research project evaluated a gyratory compactor in the field laboratory to determine mix quality. Spec...

Evaluation of bonded concrete overlays over asphalt under accelerated loading : research project capsule.

DOT National Transportation Integrated Search

2014-05-01

The overall objective of this research study is to evaluate the structural performance and loadcarrying : capacity of bonded concrete overlay pavement structures through accelerated pavement : testing and document the experience of mix design and con...

A review of consumer involvement in evaluations of case management: consistency with a recovery paradigm.

PubMed

Marshall, Sarah L; Crowe, Trevor P; Oades, Lindsay G; Deane, Frank F; Kavanagh, David J

2007-03-01

This Open Forum examines research on case management that draws on consumer perspectives. It clarifies the extent of consumer involvement and whether evaluations were informed by recovery perspectives. Searches of three databases revealed 13 studies that sought to investigate consumer perspectives. Only one study asked consumers about experiences of recovery. Most evaluations did not adequately assess consumers' views, and active consumer participation in research was rare. Supporting an individual's recovery requires commitment to a recovery paradigm that incorporates traditional symptom reduction and improved functioning, with broader recovery principles, and a shift in focus from illness to well-being. It also requires greater involvement of consumers in the implementation of case management and ownership of their own recovery process, not just in research that evaluates the practice.

Development and pilot testing of an online module for ethics education based on the Nigerian National Code for Health Research Ethics.

PubMed

Ogunrin, Olubunmi A; Ogundiran, Temidayo O; Adebamowo, Clement

2013-01-02

The formulation and implementation of national ethical regulations to protect research participants is fundamental to ethical conduct of research. Ethics education and capacity are inadequate in developing African countries. This study was designed to develop a module for online training in research ethics based on the Nigerian National Code of Health Research Ethics and assess its ease of use and reliability among biomedical researchers in Nigeria. This was a three-phased evaluation study. Phase one involved development of an online training module based on the Nigerian Code of Health Research Ethics (NCHRE) and uploading it to the Collaborative Institutional Training Initiative (CITI) website while the second phase entailed the evaluation of the module for comprehensibility, readability and ease of use by 45 Nigerian biomedical researchers. The third phase involved modification and re-evaluation of the module by 30 Nigerian biomedical researchers and determination of test-retest reliability of the module using Cronbach's alpha. The online module was easily accessible and comprehensible to 95% of study participants. There were significant differences in the pretest and posttest scores of study participants during the evaluation of the online module (p = 0.001) with correlation coefficients of 0.9 and 0.8 for the pretest and posttest scores respectively. The module also demonstrated excellent test-retest reliability and internal consistency as shown by Cronbach's alpha coefficients of 0.92 and 0.84 for the pretest and posttest respectively. The module based on the Nigerian Code was developed, tested and made available online as a valuable tool for training in cultural and societal relevant ethical principles to orient national and international biomedical researchers working in Nigeria. It would complement other general research ethics and Good Clinical Practice modules. Participants suggested that awareness of the online module should be increased through seminars, advertisement on government websites and portals used by Nigerian biomedical researchers, and incorporation of the Code into the undergraduate medical training curriculum.

Longitudinal construct validity: establishment of clinical meaning in patient evaluative instruments.

PubMed

Liang, M H

2000-09-01

Although widely used and reported in research for the evaluation of groups, measures of health status and health-related quality of life have had little application in clinical practice for the assessment of individual patients. One of the principal barriers is the demonstration that these measures add clinically significant information to measures of function or symptoms alone. Here, we review the methods for evaluation of construct validity in longitudinal studies and make recommendations for nomenclature, reporting of study results, and future research agenda. Analytical review. The terms "sensitivity" and "responsiveness" have been used interchangeably, and there are few studies that evaluate the extent to which health status or health-related quality-of life measures capture clinically important changes ("responsiveness"). Current methods of evaluating responsiveness are not standardized or evaluated. Approaches for the assessment of a clinically significant or meaningful change are described; rather than normative information, however, standardized transition questions are proposed. They would be reported routinely and as separate axes of description to capture individual perceptions. Research in methods to assess the subject's evaluation of the importance and magnitude of a measured change are critical if health status and health-related quality-of-life measures are to have an impact on patient care.

[Evidence-based Chinese medicine：theory and practice].

PubMed

Zhang, Jun-Hua; Li, You-Ping; Zhang, Bo-Li

2018-01-01

The introduction and popularization of evidence-based medicine has opened up a new research field of clinical efficacy evaluation of traditional Chinese medicine(TCM), produced new research ideas and methods, and promoted the progress of clinical research of TCM. After about 20 years assiduous study and earnest practice, the evidence based evaluation method and technique, which conforms to the characteristics of TCM theory and practice, has been developing continuously. Evidence-based Chinese medicine (EBCM) has gradually formed and become an important branch of evidence-based medicine. The basic concept of evidence-based Chinese medicine: EBCM is an applied discipline, following the theory and methodology of evidence-based medicine, to collect, evaluate, produce, transform the evidence of effectiveness, safety and economy of TCM, to reveal the feature and regular pattern of TCM taking effect, and to guide the development of clinical guidelines, clinical pathways and health decisions. The effects and achievements of EBCM development: secondary studies mainly based on systematic review/Meta-analysis were extensively carried out; clinical efficacy studies mainly relying on randomized controlled trials grew rapidly; clinical safety evaluations based on real world study have been conducted; methodological researches mainly focused on study quality control deepened gradually; internationalization researches mainly on report specifications have got some breakthroughs; standardization researches based on treatment specification were strengthened gradually; the research team and talents with the characteristics of inter-disciplinary have been steadily increased. A number of high-quality research findings have been published at international well-known journals; the clinical efficacy and safety evidence of TCM has been increased; the level of clinical rational use of TCM has been improved; a large number of Chinese patent medicines with big market have been cultured. The future missions of EBCM mainly consist of four categories (scientific research, methodology and standard, platform construction and personnel training) with nine tasks. ①Carry out systematic reviews to systematically collect clinical trial reports of TCM and establish database of clinical evidence of TCM; ②Carry out evidence transformation research to lay the foundation for the development of clinical diagnosis and treatment guidelines, clinical pathways of TCM, and for the screening of basic drug list and medical insurance list, and for the policy-making relevant to TCM; ③Conduct researches to evaluate the advantages and effective regular patterns of TCM and form the evidence chain of TCM efficacy; ④Carry out researches for the safety evaluation of TCM, and provide evidence supporting the rational and safe use of TCM in clinical practice; ⑤Conduct researches on methodology of EBCM and provide method for developing high quality evidence; ⑥Carry out researches to develop standards and norms of TCM, and to form methods, standards, specifications and technical systems; ⑦Establish data management platform for evidence-based evaluation of TCM, and promote data sharing; ⑧Build international academic exchange platform to promote international cooperation and mutual recognition of EBCM research; ⑨Carry out education and popularization activities of evidence-based evaluation methods, and train undergraduate students, graduate students, clinical healthcare providers and practitioners of TCM. The development of EBCM, as it was, not only promoted the transformation of clinical research and decision-making mode of TCM, contributed to the modernization and internationalization of TCM, but also enriched the connotation of Evidence-based Medicine. Copyright© by the Chinese Pharmaceutical Association.

A Quantitative Analysis of Countries' Research Strengths

ERIC Educational Resources Information Center

Saxena, Anurag; Brazer, S. David; Gupta, B. M.

2009-01-01

This study employed a multidimensional analysis to evaluate transnational patterns of scientific research to determine relative research strengths among widely varying nations. Findings from this study may inform national policy with regard to the most efficient use of scarce national research resources, including government and private funding.…

Building research capacity and productivity among advanced practice nurses: an evaluation of the Community of Practice model.

PubMed

Gullick, Janice G; West, Sandra H

2016-03-01

The aim of this study was to evaluate Wenger's Community of Practice as a framework for building research capacity and productivity. While research productivity is an expected domain in influential models of advanced nursing practice, internationally it remains largely unmet. Establishment of nursing research capacity precedes productivity and consequently, there is a strong imperative to identify successful capacity-building models for nursing-focussed research in busy clinical environments. Prospective, longitudinal, qualitative descriptive design was used in this study. Bruyn's participant observation framed evaluation of a Community of Practice comprising 25 advanced practice nurses. Data from focus groups, education evaluations, blog/email transcripts and field observations, collected between 2007 and 2014, were analysed using a qualitative descriptive method. The Community of Practice model invited differing levels of participation, allowed for evolution of the research community and created a rhythm of research-related interactions and enduring research relationships. Participants described the value of research for their patients and families and the significance of the developing research culture in providing richness to their practice and visibility of their work to multidisciplinary colleagues. Extensive examples of research dissemination and enrolment in doctoral programmes further confirmed this value. A Community of Practice framework is a powerful model enabling research capacity and productivity evidenced by publication. In developing a solid foundation for a nursing research culture, it should be recognized that research skills, confidence and growth develop over an extended period of time and success depends on skilled coordination and leadership. © 2015 John Wiley & Sons Ltd.

Inter-rater agreement in evaluation of disability: systematic review of reproducibility studies

PubMed Central

Barth, Jürgen; de Boer, Wout E L; Busse, Jason W; Hoving, Jan L; Kedzia, Sarah; Couban, Rachel; Fischer, Katrin; von Allmen, David Y; Spanjer, Jerry

2017-01-01

Objectives To explore agreement among healthcare professionals assessing eligibility for work disability benefits. Design Systematic review and narrative synthesis of reproducibility studies. Data sources Medline, Embase, and PsycINFO searched up to 16 March 2016, without language restrictions, and review of bibliographies of included studies. Eligibility criteria Observational studies investigating reproducibility among healthcare professionals performing disability evaluations using a global rating of working capacity and reporting inter-rater reliability by a statistical measure or descriptively. Studies could be conducted in insurance settings, where decisions on ability to work include normative judgments based on legal considerations, or in research settings, where decisions on ability to work disregard normative considerations.Teams of paired reviewers identified eligible studies, appraised their methodological quality and generalisability, and abstracted results with pretested forms. As heterogeneity of research designs and findings impeded a quantitative analysis, a descriptive synthesis stratified by setting (insurance or research) was performed. Results From 4562 references, 101 full text articles were reviewed. Of these, 16 studies conducted in an insurance setting and seven in a research setting, performed in 12 countries, met the inclusion criteria. Studies in the insurance setting were conducted with medical experts assessing claimants who were actual disability claimants or played by actors, hypothetical cases, or short written scenarios. Conditions were mental (n=6, 38%), musculoskeletal (n=4, 25%), or mixed (n=6, 38%). Applicability of findings from studies conducted in an insurance setting to real life evaluations ranged from generalisable (n=7, 44%) and probably generalisable (n=3, 19%) to probably not generalisable (n=6, 37%). Median inter-rater reliability among experts was 0.45 (range intraclass correlation coefficient 0.86 to κ−0.10). Inter-rater reliability was poor in six studies (37%) and excellent in only two (13%). This contrasts with studies conducted in the research setting, where the median inter-rater reliability was 0.76 (range 0.91-0.53), and 71% (5/7) studies achieved excellent inter-rater reliability. Reliability between assessing professionals was higher when the evaluation was guided by a standardised instrument (23 studies, P=0.006). No such association was detected for subjective or chronic health conditions or the studies’ generalisability to real world evaluation of disability (P=0.46, 0.45, and 0.65, respectively). Conclusions Despite their common use and far reaching consequences for workers claiming disabling injury or illness, research on the reliability of medical evaluations of disability for work is limited and indicates high variation in judgments among assessing professionals. Standardising the evaluation process could improve reliability. Development and testing of instruments and structured approaches to improve reliability in evaluation of disability are urgently needed. PMID:28122727

A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation.

PubMed

Acosta, Joie D; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S

2016-01-01

Restorative Practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this paper describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI) in 14 middle schools in Maine to assess whether RPI impacts both positive developmental outcomes and problem behaviors and whether the effects persist during the transition from middle to high school. The two-year RPI intervention began in the 2014-2015 school year. The study's rationale and theoretical concerns are discussed along with methodological concerns including teacher professional development. The theoretical rationale and description of the methods from this study may be useful to others conducting rigorous research and evaluation in this area.

Study on index system of GPS interference effect evaluation

NASA Astrophysics Data System (ADS)

Zhang, Kun; Zeng, Fangling; Zhao, Yuan; Zeng, Ruiqi

2018-05-01

Satellite navigation interference effect evaluation is the key technology to break through the research of Navigation countermeasure. To evaluate accurately the interference degree and Anti-jamming ability of GPS receiver, this text based on the existing research results of Navigation interference effect evaluation, build the index system of GPS receiver effectiveness evaluation from four levels of signal acquisition, tracking, demodulation and positioning/timing and establish the model for each index. These indexes can accurately and quantitatively describe the interference effect at all levels.

The Presentation of Proper Indicators for Evaluation of WHO Collaboration Centres' Activities in Iran.

PubMed

Ardakani, S Motevallizadeh; Zakiani, Sh

2012-01-01

There are thirteen WHO collaborating centres in Iran which no mechanism or model has ever been foreseen for the evaluation of them. This original research is innovative in Iran, which has been offered by the researcher through a joint research project with WHO. The aforesaid model has been approved by the International Relation Department of Ministry of Health& education. This was done to develop model and indicators for evaluation of WHOCC's activities in Iran, which includes online survey, reports, literature reviews and website searches, published literature in another country, documents in Undersecretary for Research and Technology of Iranian Ministry of Health and Medical Education. We studied collaboration centres in other countries and then compared these indicators together and presented a proper indicators for evaluation of WHOCC' activities in Iran. Evaluation of WHOCC's activities could be used as a mean for implementing policies and promoting knowledge production. Evaluation of WHOCC' activities is country's requirements.

DOE/DOT Crude Oil Characterization Research Study, Task 2 Test Report on Evaluating Crude Oil Sampling and Analysis Methods

DOE Office of Scientific and Technical Information (OSTI.GOV)

Lord, David; Allen, Ray; Rudeen, David

The Crude Oil Characterization Research Study is designed to evaluate whether crude oils currently transported in North America, including those produced from "tight" formations, exhibit physical or chemical properties that are distinct from conventional crudes, and how these properties associate with combustion hazards with may be realized during transportation and handling.

An alternative model for postdoctoral education of nurses engaged in research with potentially vulnerable populations.

PubMed

Gennaro, Susan; Deatrick, Janet A; Dobal, May T; Jemmott, Loretta Sweet; Ball, Katherine R

2007-01-01

Post-doctoral education has become a necessity for new nursing doctoral graduates. However, post-doctoral positions are limited and nurse scientists may face barriers that make non-traditional programs necessary. This study describes the outcomes of the Summer Nursing Research Institute (SNRI), an alternative post-doctoral educational program, reports formative perceptions of SNRI participants, and illustrates the efficacy and limitations of the model with selected summative research related outcomes. Participants between 1997 and 2006 were asked to evaluate the experience while attending the Institute (formative evaluation) and an overall summative evaluation was also conducted. Evaluations indicate that participants gained knowledge, skills, and networking abilities in terms of conducting research with vulnerable populations. A program like the SNRI can be successful in widening the research pipeline, in imparting knowledge, and in fostering positive attitudes as well as in improving research skills.

Taking financial relationships into account when assessing research.

PubMed

Resnik, David B; Elliott, Kevin C

2013-01-01

Many scientific journals, government agencies, and universities require disclosure of sources of funding and financial interests related to research, such as stock ownership, consulting arrangements with companies, and patents. Although disclosure has become one of the central approaches for responding to financial conflicts of interest (COIs) in research, critics contend that information about financial COIs does not serve as a reliable indicator of research credibility, and therefore, studies should be evaluated solely based on their scientific merits. We argue that, while it is indeed important to evaluate studies on their scientific merits, it is often difficult to detect significant influences of financial relationships that affect research credibility. Moreover, at least five factors can be examined to determine whether financial relationships are likely to enhance, undermine, or have no impact on the credibility of research. These include as follows: whether sponsors, institutions, or researchers have a significant financial stake in the outcome of a study; whether the financial interests of the sponsors, institutions, or researchers coincide with the goal of conducting research that is objective and reliable; whether the sponsor, institution, or researchers have a history of biasing research in order to promote their financial goals; how easy it is to manipulate the research in order to achieve financial goals; and whether oversight mechanisms are in place which are designed to minimize bias. Since these factors vary from case to case, evaluating the impact of financial relationships depends on the circumstances. In some situations, one may decide that the financial relationships significantly undermine the study's credibility; in others, one may decide that they have no impact on credibility or even enhance it.

Systematic review: handwashing behaviour in low- to middle-income countries: outcome measures and behaviour maintenance.

PubMed

Vindigni, Stephen M; Riley, Patricia L; Jhung, Michael

2011-04-01

To describe global approaches to handwashing research in low- and middle-income communities, schools and health care settings using behavioural outcome measurement and temporal study design. Peer-reviewed and grey literature was screened for handwashing studies that evaluated behaviour change. Relevant articles were assessed by their research approach, including the investigator's selected outcome measure and time frame of various study components (e.g., formative research, intervention and evaluation). The initial search yielded 527 relevant articles. After application of exclusion criteria, we identified 27 unique studies (30 total articles). Of the 27 articles, most were focused in the community setting. Fifteen (56%) documented observed handwashing behaviour, while 18 (67%) used proxy measures (e.g., soap presence, diarrhoea) and 14 (52%) used self-reported behaviour. Several studies used multiple outcome measures. While all studies had an evaluation of behaviour change, there was a dearth of studies that evaluated long-term maintenance of behaviour change after the intervention's conclusion. While the literature is replete with a variety of handwashing studies in community, school and health care settings, none have been able to definitively document long-term behaviour change, thereby challenging the sustainability of various interventions. Additionally, there is a need to better understand which research approach is most effective in promoting long-term behaviour compliance in global low- and middle-income settings. © 2011 Blackwell Publishing Ltd.

Reviews of Single Subject Research Designs: Applications to Special Education and School Psychology

ERIC Educational Resources Information Center

Nevin, Ann I., Ed.

2004-01-01

The authors of this collection of research reviews studied how single subject research designs might be a useful method to apply as part of being accountable to clients. The single subject research studies were evaluated in accordance with the following criteria: Was the study applied, behavioral, reliable, analytic, effective, and generalizable?…

Research and development of a field-ready protocol for sampling of phosgene from stationary source emissions: Diethylamine reagent studies. Research report, 11 July 1995--30 September 1996

DOE Office of Scientific and Technical Information (OSTI.GOV)

Steger, J.L.; Bursey, J.T.; Merrill, R.G.

1999-03-01

This report presents the results of laboratory studies to develop and evaluate a method for the sampling and analysis of phosgene from stationary sources of air emissions using diethylamine (DEA) in toluene as the collection media. The method extracts stack gas from emission sources and stabilizes the reactive gas for subsequent analysis. DEA was evaluated both in a benchtop study and in a laboratory train spiking study. This report includes results for both the benchtop study and the train spiking study. Benchtop studies to evaluate the suitability of DEA for collecting and analyzing phosgene investigated five variables: storage time, DEAmore » concentration, moisture/pH, phosgene concentration, and sample storage temperature. Prototype sampling train studies were performed to determine if the benchtop chemical studies were transferable to a Modified Method 5 sampling train collecting phosgene in the presence of clean air mixed with typical stack gas components. Four conditions, which varied the moisture and phosgene spike were evaluated in triplicate. In addition to research results, the report includes a detailed draft method for sampling and analysis of phosgene from stationary source emissions.« less

Research Studies in Business Education Completed in 1972

ERIC Educational Resources Information Center

Byrnside, O. J., Jr.

1973-01-01

Research studies are classified as economic, business education survey, curriculum, evaluation, teaching methods, guidance, teaching materials, teacher preparation, tests, and history of business education. (MU)

A Database Evaluation Based on Information Needs of Academic Social Scientists.

ERIC Educational Resources Information Center

Buterbaugh, Nancy Toth

This study evaluates two databases, "Historical Abstracts" and REESWeb, to determine their effectiveness in supporting academic social science research. While many performance evaluations gather quantitative data from isolated query and response transactions, this study is a qualitative evaluation of the databases in the context of…

Studying complex interventions: reflections from the FEMHealth project on evaluating fee exemption policies in West Africa and Morocco.

PubMed

Marchal, Bruno; Van Belle, Sara; De Brouwere, Vincent; Witter, Sophie

2013-11-08

The importance of complexity in health care policy-making and interventions, as well as research and evaluation is now widely acknowledged, but conceptual confusion reigns and few applications of complexity concepts in research design have been published. Taking user fee exemption policies as an entry point, we explore the methodological consequences of 'complexity' for health policy research and evaluation. We first discuss the difference between simple, complicated and complex and introduce key concepts of complex adaptive systems theory. We then apply these to fee exemption policies. We describe how the FEMHealth research project attempts to address the challenges of complexity in its evaluation of fee exemption policies for maternal care. We present how the development of a programme theory for fee exemption policies was used to structure the overall design. This allowed for structured discussions on the hypotheses held by the researchers and helped to structure, integrate and monitor the sub-studies. We then show how the choice of data collection methods and tools for each sub-study was informed by the overall design. Applying key concepts from complexity theory proved useful in broadening our view on fee exemption policies and in developing the overall research design. However, we encountered a number of challenges, including maintaining adaptiveness of the design during the evaluation, and ensuring cohesion in the disciplinary diversity of the research teams. Whether the programme theory can fulfil its claimed potential to help making sense of the findings is yet to be tested. Experience from other studies allows for some moderate optimism. However, the biggest challenge complexity throws at health system researchers may be to deal with the unknown unknowns and the consequence that complex issues can only be understood in retrospect. From a complexity theory point of view, only plausible explanations can be developed, not predictive theories. Yet here, theory-driven approaches may help.

Does fast or slow evaluation foster greater certainty?

PubMed

Tormala, Zakary L; Clarkson, Joshua J; Henderson, Marlone D

2011-03-01

This research investigates the effect of perceived evaluation duration--that is, the perceived time or speed with which one generates an evaluation--on attitude certainty. Integrating diverse findings from past research, the authors propose that perceiving either fast or slow evaluation can augment attitude certainty depending on specifiable factors. Across three studies, it is shown that when people express opinions, evaluate familiar objects, or typically trust their gut reactions, perceiving fast rather than slow evaluation generally promotes greater certainty. In contrast, when people form opinions, evaluate unfamiliar objects, or typically trust more thoughtful responses, perceiving slow rather than fast evaluation generally promotes greater certainty. Mediation analyses reveal that these effects stem from trade-offs between perceived rational thought and the perceived ease of retrieving an attitude. Implications for research on deliberative versus intuitive decision making are discussed.

Implementing health research through academic and clinical partnerships: a realistic evaluation of the Collaborations for Leadership in Applied Health Research and Care (CLAHRC).

PubMed

Rycroft-Malone, Jo; Wilkinson, Joyce E; Burton, Christopher R; Andrews, Gavin; Ariss, Steven; Baker, Richard; Dopson, Sue; Graham, Ian; Harvey, Gill; Martin, Graham; McCormack, Brendan G; Staniszewska, Sophie; Thompson, Carl

2011-07-19

The English National Health Service has made a major investment in nine partnerships between higher education institutions and local health services called Collaborations for Leadership in Applied Health Research and Care (CLAHRC). They have been funded to increase capacity and capability to produce and implement research through sustained interactions between academics and health services. CLAHRCs provide a natural 'test bed' for exploring questions about research implementation within a partnership model of delivery. This protocol describes an externally funded evaluation that focuses on implementation mechanisms and processes within three CLAHRCs. It seeks to uncover what works, for whom, how, and in what circumstances. This study is a longitudinal three-phase, multi-method realistic evaluation, which deliberately aims to explore the boundaries around knowledge use in context. The evaluation funder wishes to see it conducted for the process of learning, not for judging performance. The study is underpinned by a conceptual framework that combines the Promoting Action on Research Implementation in Health Services and Knowledge to Action frameworks to reflect the complexities of implementation. Three participating CLARHCS will provide in-depth comparative case studies of research implementation using multiple data collection methods including interviews, observation, documents, and publicly available data to test and refine hypotheses over four rounds of data collection. We will test the wider applicability of emerging findings with a wider community using an interpretative forum. The idea that collaboration between academics and services might lead to more applicable health research that is actually used in practice is theoretically and intuitively appealing; however the evidence for it is limited. Our evaluation is designed to capture the processes and impacts of collaborative approaches for implementing research, and therefore should contribute to the evidence base about an increasingly popular (e.g., Mode two, integrated knowledge transfer, interactive research), but poorly understood approach to knowledge translation. Additionally we hope to develop approaches for evaluating implementation processes and impacts particularly with respect to integrated stakeholder involvement.

Implementing health research through academic and clinical partnerships: a realistic evaluation of the Collaborations for Leadership in Applied Health Research and Care (CLAHRC)

PubMed Central

2011-01-01

Background The English National Health Service has made a major investment in nine partnerships between higher education institutions and local health services called Collaborations for Leadership in Applied Health Research and Care (CLAHRC). They have been funded to increase capacity and capability to produce and implement research through sustained interactions between academics and health services. CLAHRCs provide a natural 'test bed' for exploring questions about research implementation within a partnership model of delivery. This protocol describes an externally funded evaluation that focuses on implementation mechanisms and processes within three CLAHRCs. It seeks to uncover what works, for whom, how, and in what circumstances. Design and methods This study is a longitudinal three-phase, multi-method realistic evaluation, which deliberately aims to explore the boundaries around knowledge use in context. The evaluation funder wishes to see it conducted for the process of learning, not for judging performance. The study is underpinned by a conceptual framework that combines the Promoting Action on Research Implementation in Health Services and Knowledge to Action frameworks to reflect the complexities of implementation. Three participating CLARHCS will provide in-depth comparative case studies of research implementation using multiple data collection methods including interviews, observation, documents, and publicly available data to test and refine hypotheses over four rounds of data collection. We will test the wider applicability of emerging findings with a wider community using an interpretative forum. Discussion The idea that collaboration between academics and services might lead to more applicable health research that is actually used in practice is theoretically and intuitively appealing; however the evidence for it is limited. Our evaluation is designed to capture the processes and impacts of collaborative approaches for implementing research, and therefore should contribute to the evidence base about an increasingly popular (e.g., Mode two, integrated knowledge transfer, interactive research), but poorly understood approach to knowledge translation. Additionally we hope to develop approaches for evaluating implementation processes and impacts particularly with respect to integrated stakeholder involvement. PMID:21771329

Evaluating institutional capacity for research ethics in Africa: a case study from Botswana.

PubMed

Hyder, Adnan A; Zafar, Waleed; Ali, Joseph; Ssekubugu, Robert; Ndebele, Paul; Kass, Nancy

2013-07-30

The increase in the volume of research conducted in Low and Middle Income Countries (LMIC), has brought a renewed international focus on processes for ethical conduct of research. Several programs have been initiated to strengthen the capacity for research ethics in LMIC. However, most such programs focus on individual training or development of ethics review committees. The objective of this paper is to present an approach to institutional capacity assessment in research ethics and application of this approach in the form of a case study from an institution in Africa. We adapted the Octagon model originally used by the Swedish International Development Cooperation Agency to assess an organization along eight domains in research ethics: basic values and identity; structure and organization; ability to carry out activities; relevance of activities to stated goals; capacity of staff and management; administrative, financing and accounting systems; its relations with target groups; and the national context. We used a mixed methods approach to collect empirical data at the University of Botswana from March to December 2010. The overall shape of the external evaluation Octagon suggests that strengths of the University of Botswana are in the areas of structure, relevance, production and identity; while the university still needs more work in the areas of systems of finance, target groups, and environment. The Octagons also show the similarities and discrepancies between the 'external' and 'internal' evaluations and provide an opportunity for exploration of these different assessments. For example, the discrepant score for 'identity' between internal and external evaluations allows for an exploration of what constitutes a strong identity for research ethics at the University of Botswana and how it can be strengthened. There is a general lack of frameworks for evaluating research ethics capacity in LMICs. We presented an approach that stresses evaluation from both internal and external perspectives. This case study highlights the university's rapid progress in developing research ethics capacity and points to some notable areas for improvement. We believe that such an empirically-driven and participatory assessment allows a more holistic measurement and promotion of institutional capacity strengthening for research ethics in LMICs.

Evaluating institutional capacity for research ethics in Africa: a case study from Botswana

PubMed Central

2013-01-01

Background The increase in the volume of research conducted in Low and Middle Income Countries (LMIC), has brought a renewed international focus on processes for ethical conduct of research. Several programs have been initiated to strengthen the capacity for research ethics in LMIC. However, most such programs focus on individual training or development of ethics review committees. The objective of this paper is to present an approach to institutional capacity assessment in research ethics and application of this approach in the form of a case study from an institution in Africa. Methods We adapted the Octagon model originally used by the Swedish International Development Cooperation Agency to assess an organization along eight domains in research ethics: basic values and identity; structure and organization; ability to carry out activities; relevance of activities to stated goals; capacity of staff and management; administrative, financing and accounting systems; its relations with target groups; and the national context. We used a mixed methods approach to collect empirical data at the University of Botswana from March to December 2010. Results The overall shape of the external evaluation Octagon suggests that strengths of the University of Botswana are in the areas of structure, relevance, production and identity; while the university still needs more work in the areas of systems of finance, target groups, and environment. The Octagons also show the similarities and discrepancies between the 'external' and 'internal' evaluations and provide an opportunity for exploration of these different assessments. For example, the discrepant score for 'identity' between internal and external evaluations allows for an exploration of what constitutes a strong identity for research ethics at the University of Botswana and how it can be strengthened. Conclusions There is a general lack of frameworks for evaluating research ethics capacity in LMICs. We presented an approach that stresses evaluation from both internal and external perspectives. This case study highlights the university's rapid progress in developing research ethics capacity and points to some notable areas for improvement. We believe that such an empirically-driven and participatory assessment allows a more holistic measurement and promotion of institutional capacity strengthening for research ethics in LMICs. PMID:23899301

Evaluation of the Content Literacy Continuum: Report on Program Impacts, Program Fidelity, and Contrast. Final Report. NCEE 2013-4001

ERIC Educational Resources Information Center

Corrin, William; Lindsay, James J.; Somers, Marie-Andree; Myers, Nathan E.; Meyers, Coby V.; Condon, Christopher A.; Smith, Janell K.

2012-01-01

This report presents the findings of a rigorous experimental impact evaluation and implementation study of one such intervention, the Content Literacy Continuum (CLC), developed by researchers at the University of Kansas Center for Research on Learning. This evaluation of CLC was conducted by three partnering organizations: REL Midwest, MDRC, and…

The Implementation and Evaluation of Teacher Training in Gaming Instruction for Secondary Science: An Action Research Project

ERIC Educational Resources Information Center

Sanders, Veronica

2016-01-01

This study implemented and evaluated gaming instruction as a professional development for science teachers at a Georgia high school. It was guided by four research questions that (a) assessed the impact of training in gaming instruction and evaluation of that training on science teachers' ability to use games; (b) examined evidence showing that…

The Value and Feasibility of Evaluation Research on Teacher Development: Contrasting Experiences in Sri Lanka and Mexico

ERIC Educational Resources Information Center

Tatto, M. T.

2002-01-01

This article discusses the value and feasibility of carrying out evaluation research on teacher development and uses as points of reference the author's experiences in two countries, Sri Lanka and Mexico. In Sri Lanka, an evaluation study was designed to understand the effectiveness and costs of teacher development at the elementary level linking…

Evaluating Social Programs; Theory, Practice, and Politics. Quantitative Studies in Social Relations Series.

ERIC Educational Resources Information Center

Rossi, Peter H., Ed.; Williams, Walter, Ed.

This book addresses itself to three questions which are crucial to effective social action and hence to the lives of those whom social programs are designed to improve: (1) why has so little high quality evaluative research been done? (2) what problems are involved in developing more evaluative research and using its results in policy making? and,…

Fellowship Effects in Graduate Education: Evaluating the Impact of the National Science Foundation's Graduate Research Fellowship Program. ASHE Annual Meeting Paper.

ERIC Educational Resources Information Center

Goldsmith, Sharon S.; Presley, Jennifer B.

This report results from an evaluation of the National Research Foundation's Graduate Research Fellowship program. The study sought to determine: (1) whether NSF fellows show evidence of more timely degree completion and early career success; (2) whether graduate fellows and minority graduate fellows experience similar education and career…

Head Start Evaluation and Research Center, University of Kansas. Final Report on Research Activities.

ERIC Educational Resources Information Center

Etzel, Barbara C.; And Others

This document is the final report to the Institute of Educational Development for Head Start Research Evaluation activities at the University of Kansas for 1966-67. It contains 16 separate reports of studies completed or in the process of completion. The subject matter of the reports contains 15 distinct topics and warrants individual abstracts.…

An Evaluation of Service Quality in Higher Education: Marmara and Nigde Omer Halisdemir Universities' Department of Education Students

ERIC Educational Resources Information Center

Ada, Sefer; Baysal, Z. Nurdan; Erkan, Senem Seda Sahenk

2017-01-01

The purpose of this research is to evaluate the quality service in higher education in Marmara and Nigde Omer Halisdemir Universities' department of education students. This study was prepared using a screening model from quantitative research methods. The sample of this research comprised 886 university students attending the higher education…

A Preliminary Rubric Design to Evaluate Mixed Methods Research

ERIC Educational Resources Information Center

Burrows, Timothy J.

2013-01-01

With the increase in frequency of the use of mixed methods, both in research publications and in externally funded grants there are increasing calls for a set of standards to assess the quality of mixed methods research. The purpose of this mixed methods study was to conduct a multi-phase analysis to create a preliminary rubric to evaluate mixed…

Research on antidepressants in India

PubMed Central

Avasthi, Ajit; Grover, Sandeep; Aggarwal, Munish

2010-01-01

Data suggests that antidepressants are useful in the management of depressive disorders, anxiety disorders, sexual dysfunction, eating disorders, impulse control disorders, enuresis, aggression and some personality disorders. Research focusing on the usefulness of antidepressants in India has more or less followed the trends seen in the West. Most of the studies conducted in India have evaluated various antidepressants in depression. In this article, we review studies conducted in India on various antidepressants. The data suggests that antidepressants have been evaluated mainly in the acute phase treatment and rare studies have evaluated the efficacy in continuation phase treatment. PMID:21836704

Recent research related to prediction of stall/spin characteristics of fighter aircraft

NASA Technical Reports Server (NTRS)

Nguyen, L. T.; Anglin, E. L.; Gilbert, W. P.

1976-01-01

The NASA Langley Research Center is currently engaged in a stall/spin research program to provide the fundamental information and design guidelines required to predict the stall/spin characteristics of fighter aircraft. The prediction methods under study include theoretical spin prediction techniques and piloted simulation studies. The paper discusses the overall status of theoretical techniques including: (1) input data requirements, (2) math model requirements, and (3) correlation between theoretical and experimental results. The Langley Differential Maneuvering Simulator (DMS) facility has been used to evaluate the spin susceptibility of several current fighters during typical air combat maneuvers and to develop and evaluate the effectiveness of automatic departure/spin prevention concepts. The evaluation procedure is described and some of the more significant results of the studies are presented.

Twenty years of Medicare and Medicaid: Covered populations, use of benefits, and program expenditures

PubMed Central

Gornick, Marian; Greenberg, Jay N.; Eggers, Paul W.; Dobson, Allen

1985-01-01

Marian Gornick is Director, Division of Beneficiary Studies, in the Office of Research, Health Care Financing Administration. She has been involved in research studies relating to Medicare and Medicaid since the programs were first implemented. Jay N. Greenberg is on the faculty of the Heller Graduate School, Brandeis University. Dr. Greenberg serves as the Associate Director for Research of the school's Health Policy Center. Paul W. Eggers is Chief, Program Evaluation Branch, in the Office of Research, Health Care Financing Administration (HCFA). Dr. Eggers’ research activities involve the evaluation of the impact of HCFA programs on the beneficiaries. Allen Dobson is Director, Office of Research, Health Care Financing Administration. Dr. Dobson is responsible for directing the planning and development of the Agency's research agenda. PMID:10311371

Examining Teacher Evaluation Validity and Leadership Decision Making within a Standards-Based Evaluation System

ERIC Educational Resources Information Center

Kimball, Steven M.; Milanowski, Anthony

2009-01-01

Purpose: The article reports on a study of school leader decision making that examined variation in the validity of teacher evaluation ratings in a school district that has implemented a standards-based teacher evaluation system. Research Methods: Applying mixed methods, the study used teacher evaluation ratings and value-added student achievement…

Planting Healthy Roots: Using Documentary Film to Evaluate and Disseminate Community-Based Participatory Research.

PubMed

Brandt, Heather M; Freedman, Darcy A; Friedman, Daniela B; Choi, Seul Ki; Seel, Jessica S; Guest, M Aaron; Khang, Leepao

2016-01-01

Documentary filmmaking approaches incorporating community engagement and awareness raising strategies may be a promising approach to evaluate community-based participatory research. The study purpose was 2-fold: (1) to evaluate a documentary film featuring the formation and implementation of a farmers' market and (2) to assess whether the film affected awareness regarding food access issues in a food-desert community with high rates of obesity. The coalition model of filmmaking, a model consistent with a community-based participatory research (CBPR) approach, and personal stories, community profiles, and expert interviews were used to develop a documentary film (Planting Healthy Roots). The evaluation demonstrated high levels of approval and satisfaction with the film and CBPR essence of the film. The documentary film aligned with a CBPR approach to document, evaluate, and disseminate research processes and outcomes.

Bilateral waste-water land-treatment research by China and the US EPA

DOE Office of Scientific and Technical Information (OSTI.GOV)

Leach, L.E.; Duan, Z.B.; Wang, S.T.

1991-01-01

The study was conducted to evaluate the rapid infiltration (R.I.) method of land treatment as a partial solution to wastewater treatment and reuse for the 0.45 billion cu m/yr (15.75 billion cu ft/yr) of safe irrigation water needed by the year 2000. Chinese environmental scientists and water supply managers are considering the use of the technology for diluting high concentrations of nitrate in the ground water while simultaneously recharging severely overdrafted aquifers. The wastewater used in the study contained synthetic organic compounds found on EPA's list of priority pollutants. During the development of EPA's Land Treatment Design Manuals, research wasmore » terminated before a thorough evaluation of the treatability of these compounds could be completed. Therefore, during the study, an evaluation of R.I. systems ability to treat selected priority pollutants as well as fecal coliform bacteria was carried out in the interest of RSKERL's research objectives. Even though the research was focused on operations to optimize the removal of various nitrogen species from primary effluent, the normal wastewater parameters of BOD, COD, SS, Total - P, and TOC were also studied. The volatile organic compounds most prominent in the wastewater, dichloroethene, dichloroethane, chloroform and carbon tetrachloride were also evaluated for treatability in the cooperative study.« less

Developmental Advising for Marginalized Community College Students: An Action Research Study

ERIC Educational Resources Information Center

Jones, Terrica S.

2013-01-01

The purpose of this action research study was to understand, evaluate, and improve the developmental advising practices used at a Washington State community college. This action research study endeavored to strengthen the developmental advising model originally designed to support the college's marginalized students. Guiding questions for the…

Paediatric health economic evaluations: a world view.

PubMed

Ungar, Wendy J

2007-01-01

As economic evaluation methods evolve, their applicability to special populations, such as children, has received increased scrutiny. The objective was to review paediatric health economic evaluations published over the last quarter century, comment on trends, discuss gaps between developed and developing nations, and point to future directions for research. Data compiled for the Paediatric Economic Database Evaluation (PEDE) project to 2003 were used to describe temporal and geographic trends and evaluate the frequency of intervention categories and conditions studied. The volume of paediatric health economic evaluations rose rapidly since 1980. Studies of infective/parasitic diseases, congenital anomalies and complications of pregnancy accounted for the majority. Prevention rather than treatment was emphasized. Most evaluations performed since 1998 (78%) were cost-effectiveness analyses. Cost-utility analyses were rare. The US produced half of all publications, with the U.K. contributing 12%. Economic evaluations from developing countries were uncommon, despite an urgent need for evidence-based decision-making in these regions. The interventions studied reflected local health priorities; HIV and malaria prevention were more commonly studied in developing nations, whereas treatments for asthma and birth malformations were more often evaluated in developed nations. Despite global initiatives to combat disease, developing nations rely on foreign research to inform implementation of local health programs. There is a need for better methods for data transfer and extrapolation. Future research must focus on paediatric models of costs and consequences and the development of tools to measure long-term effects.

A model for evaluating academic research centers: Case study of the Asian/Pacific Islander Youth Violence Prevention Center.

PubMed

Nishimura, Stephanie T; Hishinuma, Earl S; Goebert, Deborah A; Onoye, Jane M M; Sugimoto-Matsuda, Jeanelle J

2018-02-01

To provide one model for evaluating academic research centers, given their vital role in addressing public health issues. A theoretical framework is described for a comprehensive evaluation plan for research centers. This framework is applied to one specific center by describing the center's Logic Model and Evaluation Plan, including a sample of the center's activities. Formative and summative evaluation information is summarized. In addition, a summary of outcomes is provided: improved practice and policy; reduction of risk factors and increase in protective factors; reduction of interpersonal youth violence in the community; and national prototype for prevention of interpersonal youth violence. Research centers are important mechanisms to advance science and improve people's quality of life. Because of their more infrastructure-intensive and comprehensive approach, they also require substantial resources for success, and thus, also require careful accountability. It is therefore important to comprehensively evaluate these centers. As provided herein, a more systematic and structured approach utilizing logic models, an evaluation plan, and successful processes can provide research centers with a functionally useful method in their evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

Formative Ethnographic Research to Improve Evaluation of a Novel Water System in Ghana

PubMed Central

Alcorn, Ted E.; Opryszko, Melissa C.; Schwab, Kellogg J.

2011-01-01

The accessibility of potable water is fundamental to public health. A private for-profit company is installing kiosk-based drinking-water systems in rural and peri-urban villages in Ghana, and we evaluated their performance. Preceding an observational study to measure the effect of these kiosks on the incidence of water-related disease in recipient communities, we conducted ethnographic research to assess local water-related practices and the ways these practices would affect adoption of the new technology. We conducted fieldwork in two communities in Ghana and interviewed stakeholders throughout the water sector. Our findings illustrate the complexity of water-related behaviors and indicate several factors that may sustain disease transmission despite the presence of the new technology. This formative ethnographic research also improved the precision of our subsequent evaluation of the intervention by providing a site-specific, culturally-appropriate knowledge base. This study demonstrates the value of incorporating qualitative research techniques into evaluations of water-related projects. PMID:21540392

An ecological approach to evaluating a system of care program: dollars making sense.

PubMed

Green, Denise M; Twill, Sarah E; Nackerud, Larry; Holosko, Michael

2014-01-01

System of care (SOC) models in North America were developed in response to the needs of children with a severe emotional disturbance. Such children experience problems across life spheres including issues at home that put them at risk of abuse and neglect, difficulties at school including special education classification and dropping-out, and involvement with the juvenile courts. SOC evaluations and research suggests that an overreliance of evaluative research efforts on standardized scales and preconceived measurable outcomes have resulted in a loss of other important data. This study's confirmatory and holistic approach to evaluation illuminates important information concerning commonly ignored variables when using traditional evaluation models. The evaluative research study described focuses on three often overlooked behavioral variables in one SOC initiative, KidsNet Georgia, of Rockdale County, GA. These variables are: (a) using cohort analysis over time; (b) costing out services utilized; and (c) focusing on behavioral indicators and chance over time. The evaluative strategy, data collection, data, and cost analysis are discussed along with implications for practice with severe emotional disturbance youth and their families.

[Function of the present systematic evaluation in establishment of guidance for clinical practice].

PubMed

Yang, Jin-Hong; Hu, Jing; Yang, Feng-Chun; Zhang, Ning; Wang, Bing; Li, Xin

2012-07-01

Treatment of insomnia with acupuncture is taken as an example to explore the significance and problems existed in the present systematic evaluation in establishment of guidance for clinical practice. Fifteen articles on systematic evaluation of both English and Chinese were retrieved and studied carefully, their basic information was analyzed. Through study on the establishing process of the guidance of clinical practice, researches were focused on the possible significance of the articles to the guidance as well as the notes in the reuse of those articles since problem still existed. It is held that the systematic evaluation has great significance on the establishment of the guidance from the aspects of applicable people, recommended standards of diagnosis and therapeutic evaluation, extended recommendation and methodology. Great importance should also be attached to the direct application of the research result and understanding of the evaluation result. The data should be rechecked when necessary. Great guiding function can be found on the systematic evaluation of articles to the guidance. Moreover, if information needed to be taken into a full play, specific analysis should also be done on the concrete research targets.

Exploring Organizational Evaluation Capacity and Evaluation Capacity Building: A Delphi Study of Taiwanese Elementary and Junior High Schools

ERIC Educational Resources Information Center

Cheng, Shu-Huei; King, Jean A.

2017-01-01

Researchers have conducted numerous empirical studies on evaluation capacity (EC) and evaluation capacity building (ECB) in Western cultural settings. However, little is known about these practices in non-Western contexts. To that end, this study identified the major dimensions of EC and feasible ECB approaches in Taiwanese elementary and junior…

Individualized music for dementia: Evolution and application of evidence-based protocol.

PubMed

Gerdner, Linda A

2012-04-22

The theory-based intervention of individualized music has been evaluated clinically and empirically leading to advancement and refinement of an evidence-based protocol, currently in its 5th edition. An expanded version of the protocol was written for professional health care providers with a consumer version tailored for family caregivers. The underlying mid-range theory is presented along with a seminal study that was followed by further research in the United States, Canada, Great Britain, France, Sweden, Norway, Japan and Taiwan. Key studies are summarized. Given its efficacy when implemented by research staff, studies have advanced to testing the intervention under real-life conditions when implemented and evaluated by trained nursing assistants in long-term care facilities and visiting family members. In addition, one study evaluated the implementation of music by family members in the home setting. Initial research focused on agitation as the dependent variable with subsequent research indicating a more holistic response such as positive affect, expressed satisfaction, and meaningful interaction with others. The article advances by describing on-line programs designed to train health care professionals in the assessment, implementation and evaluation of individualized music. In addition, Gerdner has written a story for a picture book intended for children and their families (in press). The story models principles of individualized music to elicit positive memories, reduce anxiety and agitation, and promote communication. The article concludes with implications for future research.

Individualized music for dementia: Evolution and application of evidence-based protocol

PubMed Central

Gerdner, Linda A

2012-01-01

The theory-based intervention of individualized music has been evaluated clinically and empirically leading to advancement and refinement of an evidence-based protocol, currently in its 5th edition. An expanded version of the protocol was written for professional health care providers with a consumer version tailored for family caregivers. The underlying mid-range theory is presented along with a seminal study that was followed by further research in the United States, Canada, Great Britain, France, Sweden, Norway, Japan and Taiwan. Key studies are summarized. Given its efficacy when implemented by research staff, studies have advanced to testing the intervention under real-life conditions when implemented and evaluated by trained nursing assistants in long-term care facilities and visiting family members. In addition, one study evaluated the implementation of music by family members in the home setting. Initial research focused on agitation as the dependent variable with subsequent research indicating a more holistic response such as positive affect, expressed satisfaction, and meaningful interaction with others. The article advances by describing on-line programs designed to train health care professionals in the assessment, implementation and evaluation of individualized music. In addition, Gerdner has written a story for a picture book intended for children and their families (in press). The story models principles of individualized music to elicit positive memories, reduce anxiety and agitation, and promote communication. The article concludes with implications for future research. PMID:24175165

METHODOLOGICAL PLURALISM AND MIXED METHODOLOGY TO STRENGTHEN COMMUNITY PSYCHOLOGY RESEARCH: AN EXAMPLE FROM OXFORD HOUSE

PubMed Central

May, Emily M.; Hunter, Bronwyn A.; Jason, Leonard A.

2017-01-01

This article evaluates how a plurality of research methods has served a research program that has functioned in a much-needed area of research: the role of housing and recovery residences in addiction recovery. The review focuses on one mutually supportive recovery residence model, called Oxford House, which represents more than 1,700 democratic, self-governing residences. To date, there has been no comprehensive evaluation of the research methods used with Oxford House or any other recovery residence. In this article, research methods, including study designs and data analyses, are summarized for 114 peer-reviewed empirical studies that included data on Oxford Houses or Oxford House residents. This review of a pluralistic research program can inform community researchers about the value of recovery residences, the many ways in which recovery residences may be assessed, and the benefits of using multiple methods. Implications for future recovery residence research are discussed. PMID:28839344

METHODOLOGICAL PLURALISM AND MIXED METHODOLOGY TO STRENGTHEN COMMUNITY PSYCHOLOGY RESEARCH: AN EXAMPLE FROM OXFORD HOUSE.

PubMed

May, Emily M; Hunter, Bronwyn A; Jason, Leonard A

2017-01-01

This article evaluates how a plurality of research methods has served a research program that has functioned in a much-needed area of research: the role of housing and recovery residences in addiction recovery. The review focuses on one mutually supportive recovery residence model, called Oxford House, which represents more than 1,700 democratic, self-governing residences. To date, there has been no comprehensive evaluation of the research methods used with Oxford House or any other recovery residence. In this article, research methods, including study designs and data analyses, are summarized for 114 peer-reviewed empirical studies that included data on Oxford Houses or Oxford House residents. This review of a pluralistic research program can inform community researchers about the value of recovery residences, the many ways in which recovery residences may be assessed, and the benefits of using multiple methods. Implications for future recovery residence research are discussed.

Contracting in vivo research: what are the issues?

PubMed

Underwood, Wendy J

2007-07-01

As a result of increasing internal and external pressures, research institutions are using contract research organizations for the conduct of in vivo research. Many issues arise when contracting animal research, including concern regarding animal health and welfare. Each sponsor institution should develop a program for outsourced in vivo research that evaluates and ensures appropriate care and use of research animals. Each sponsoring institution should consider establishing a policy and procedure for how outsourced in vivo studies will be approved, conducted, and monitored. An approved list of contract facilities can be established on the basis of accepted standards for animal care and use. Written contracts should include confidentiality agreements, the delineation of animal ownership, and the expectation to comply with all applicable regulations and guidelines for research animal care and use. Finally, a process for communication of adverse study or animal welfare events should be established. Thorough evaluation of contract organizations will help ensure appropriate research animal care and use.

A Three-Pronged Approach to Evaluating Salary Equity among Faculty, Administrators, and Staff at a Metropolitan Research University.

ERIC Educational Resources Information Center

Armacost, Robert L.

A study was conducted to evaluate inequalities in salary for all regular faculty, administrative, and staff employees with respect to gender and ethnicity at a major metropolitan research university. In all, there were 648 minorities in the study and 1,443 women. Three approaches were used to test for inequalities: (1) a multiple regression…

Selection, Evaluation, and Modification of a Standard Operating Procedure as a Mechanism for Introducing an Undergraduate Student to Chemical Research: A Case Study

ERIC Educational Resources Information Center

Claycomb, Gregory D.; Venable, Frances A.

2015-01-01

In an effort to broaden the selection of research opportunities available to a student registered in a one-semester, upper-level independent study course at a primarily undergraduate institution (PUI), a highly motivated student was asked to select, evaluate, and modify a standard operating procedure (SOP). The student gained valuable experience…

Evaluating the Service Quality of the Hotel Establishments in Sports Tourism with Regard to the Athletes

ERIC Educational Resources Information Center

Osmanoglu, Hasan; Üzüm, Hanifi

2018-01-01

The purpose of this study was to evaluate the service quality of the hotels which are provided sport tourism by athletes according to some variables. The research was conducted with cross-sectional research method as one of the general survey models and relational screening model. Target group of the study also constituted the sample group. This…

Teachers' Applications of Principals' Evaluative Feedback

ERIC Educational Resources Information Center

Mueller, Lori M.

2016-01-01

The purpose of this study was to identify considerations that influenced teachers' implementation of principals' evaluative feedback to improve instructional practices. The research question for this study was: What considerations contribute to teachers' applications of principals' evaluative feedback? Participants in this qualitative study…

International Citizenship Education Research: An Annotated Bibliography of Research Using the IEA ICCS and IEA CIVED Datasets

ERIC Educational Resources Information Center

Knowles, Ryan T.; Di Stefano, Marialuisa

2015-01-01

In November 2015, a group of researchers met to discuss the role of large-scale international studies to inform social studies research and practice. The conversation focused on published analyses of the International Association for the Evaluation of Educational Achievement (IEA) 1999 Civic Education study (CIVED) of 14 year olds in 28 countries,…

34 CFR 660.32 - What additional selection criteria does the Secretary use for an application for a research...

Code of Federal Regulations, 2010 CFR

2010-07-01

... use for an application for a research project, a survey, or a study? 660.32 Section 660.32 Education... evaluates an application for a research project, study, or survey on the basis of the criteria in this..., DEPARTMENT OF EDUCATION THE INTERNATIONAL RESEARCH AND STUDIES PROGRAM How Does the Secretary Make a Grant...

34 CFR 660.32 - What additional selection criteria does the Secretary use for an application for a research...

Code of Federal Regulations, 2012 CFR

2012-07-01

... use for an application for a research project, a survey, or a study? 660.32 Section 660.32 Education... evaluates an application for a research project, study, or survey on the basis of the criteria in this..., DEPARTMENT OF EDUCATION THE INTERNATIONAL RESEARCH AND STUDIES PROGRAM How Does the Secretary Make a Grant...

34 CFR 660.32 - What additional selection criteria does the Secretary use for an application for a research...

Code of Federal Regulations, 2011 CFR

2011-07-01

... use for an application for a research project, a survey, or a study? 660.32 Section 660.32 Education... evaluates an application for a research project, study, or survey on the basis of the criteria in this..., DEPARTMENT OF EDUCATION THE INTERNATIONAL RESEARCH AND STUDIES PROGRAM How Does the Secretary Make a Grant...

34 CFR 660.32 - What additional selection criteria does the Secretary use for an application for a research...

Code of Federal Regulations, 2014 CFR

2014-07-01

... use for an application for a research project, a survey, or a study? 660.32 Section 660.32 Education... evaluates an application for a research project, study, or survey on the basis of the criteria in this..., DEPARTMENT OF EDUCATION THE INTERNATIONAL RESEARCH AND STUDIES PROGRAM How Does the Secretary Make a Grant...

34 CFR 660.32 - What additional selection criteria does the Secretary use for an application for a research...

Code of Federal Regulations, 2013 CFR

2013-07-01

... use for an application for a research project, a survey, or a study? 660.32 Section 660.32 Education... evaluates an application for a research project, study, or survey on the basis of the criteria in this..., DEPARTMENT OF EDUCATION THE INTERNATIONAL RESEARCH AND STUDIES PROGRAM How Does the Secretary Make a Grant...

A Study on the Role of Web Technology in Enhancing Research Pursuance among University Academia

ERIC Educational Resources Information Center

Hussain, Irshad; Durrani, Muhammad Ismail

2012-01-01

The purpose of this study was to evaluate the role of web technologies in promoting research pursuance among university teachers, examine the use of web technologies by university teachers in conducting research and identify the problems of university academia in using web technologies for research. The study was delimited to academia of social…

Insight into Evaluation Practice: A Content Analysis of Designs and Methods Used in Evaluation Studies Published in North American Evaluation-Focused Journals

ERIC Educational Resources Information Center

Christie, Christina A.; Fleischer, Dreolin Nesbitt

2010-01-01

To describe the recent practice of evaluation, specifically method and design choices, the authors performed a content analysis on 117 evaluation studies published in eight North American evaluation-focused journals for a 3-year period (2004-2006). The authors chose this time span because it follows the scientifically based research (SBR)…

Molasses supplementation of grazing dairy cows: summary of case study, continuous culture fermenter trials, and controlled research farm study

USDA-ARS?s Scientific Manuscript database

This fact sheet summarizes the results of a three-tiered research approach (case study, two continuous culture fermenter studies, and a controlled research farm study) to evaluate molasses as an alternative supplement source for grazing dairy cows. A two-year case study of a New York organic dairy f...

A 5-year scientometric analysis of research centers affiliated to Tehran University of Medical Sciences.

PubMed

Yazdani, Kamran; Rahimi-Movaghar, Afarin; Nedjat, Saharnaz; Ghalichi, Leila; Khalili, Malahat

2015-01-01

Since Tehran University of Medical Sciences (TUMS) has the oldest and highest number of research centers among all Iranian medical universities, this study was conducted to evaluate scientific output of research centers affiliated to Tehran University of Medical Sciences (TUMS) using scientometric indices and the affecting factors. Moreover, a number of scientometric indicators were introduced. This cross-sectional study was performed to evaluate a 5-year scientific performance of research centers of TUMS. Data were collected through questionnaires, annual evaluation reports of the Ministry of Health, and also from Scopus database. We used appropriate measures of central tendency and variation for descriptive analyses. Moreover, uni-and multi-variable linear regression were used to evaluate the effect of independent factors on the scientific output of the centers. The medians of the numbers of papers and books during a 5-year period were 150.5 and 2.5 respectively. The median of the "articles per researcher" was 19.1. Based on multiple linear regression, younger age centers (p=0.001), having a separate budget line (p=0.016), and number of research personnel (p<0.001) had a direct significant correlation with the number of articles while real properties had a reverse significant correlation with it (p=0.004). The results can help policy makers and research managers to allocate sufficient resources to improve current situation of the centers. Newly adopted and effective scientometric indices are is suggested to be used to evaluate scientific outputs and functions of these centers.

A systematic review of studies evaluating diffusion and dissemination of selected cancer control interventions.

PubMed

Ellis, Peter; Robinson, Paula; Ciliska, Donna; Armour, Tanya; Brouwers, Melissa; O'Brien, Mary Ann; Sussman, Jonathan; Raina, Parminder

2005-09-01

With this review, the authors sought to determine what strategies have been evaluated (including the outcomes assessed) to disseminate cancer control interventions that promote the uptake of behavior change. Five topic areas along the cancer care continuum (smoking cessation, healthy diet, mammography, cervical cancer screening, and control of cancer pain) were selected to be representative. A systematic review was conducted of primary studies evaluating dissemination of a cancer control intervention. Thirty-one studies were identified that evaluated dissemination strategies in the 5 topic areas. No strong evidence currently exists to recommend any one dissemination strategy as effective in promoting the uptake of cancer control interventions. The authors conclude that there is a strong need for more research into dissemination of cancer control interventions. Future research should consider methodological issues such as the most appropriate study design and outcomes to be evaluated. (c) 2005 APA, all rights reserved

Evaluating the Assessment Models for Young Children with Special Needs in Taiwan

ERIC Educational Resources Information Center

Ho, Hua-Kuo

2009-01-01

The purpose of this study was intended to evaluate the assessment models of two representative centers of team evaluation for children's development in Taiwan. Documentary analysis and phone interview were employed in the study to collect the research data needed. Two centers of team evaluation for children's development were selected and…

Questionnaire Evaluating Teaching Competencies in the University Environment. Evaluation of Teaching Competencies in the University

ERIC Educational Resources Information Center

Moreno-Murcia, Juan Antonio; Silveira Torregrosa, Yolanda; Belando Pedreño, Noelia

2015-01-01

The objective of this study was to design and validate a measuring instrument to evaluate the performance of university professors. The Evaluation of Teaching Performance (CEID [Centro de Estudios e Investigaciones Docentes (Center for Teaching Studies and Research)]) questionnaire was administered to 1297 university students. Various factor…

An Evaluation of the Private High School Curriculum in Turkey

ERIC Educational Resources Information Center

Aslan, Dolgun

2016-01-01

This study aims at evaluating curricula of private high schools in line with opinions of teachers working at the related high schools, and identifying any related problems. Screening model is used as a quantitative research method in the study. The "element-based curriculum evaluation model" is taken as basis for evaluation of the…

Level of evidence gap in orthopedic research.

PubMed

Baldwin, Keith D; Bernstein, Joseph; Ahn, Jaimo; McKay, Scott D; Sankar, Wudbhav N

2012-09-01

Level of evidence is the most widely used metric for the quality of a publication, but instances exist in which a Level I study is neither feasible nor desirable. The goal of this study was to evaluate the level of evidence gap in current orthopedic research, which the authors defined as the disparity between the level of evidence that would be required to optimally answer the primary research question and the level of evidence that was actually used. Five orthopedic surgeons (K.D.B., J.B., J.A., S.D.M., W.N.S.) evaluated blinded articles from the first 6 months of 2010 in the Journal of Bone and Joint Surgery (American Volume) (JBJS-Am), classifying the study type and design and extracting a primary research question from each article. Each evaluator then defined the study type and method, along with the level of evidence that would ideally be used to address the primary research question. The level of evidence gap was then calculated by subtracting the actual level of evidence of the manuscript from the level of evidence of the idealized study. Of the 64 JBJS-Am manuscripts eligible for analysis, the average level of evidence was between Level II and III (mean, 2.73). The average level of evidence gap was 1.06 compared with the JBJS-Am-designated level of evidence and 1.28 compared with the evaluators' assessment. Because not all questions require Level I studies, level of evidence alone may not be the best metric for the quality of orthopedic surgery literature. Instead, the authors' concept of a level of evidence gap may be a better tool for assessing the state of orthopedic research publications. Copyright 2012, SLACK Incorporated.

Anthropology and School Reform: To Catalog or Critique?

ERIC Educational Resources Information Center

Hess, G. Alfred, Jr.

1992-01-01

Discusses anthropology's role in policy-relevant educational research, drawing on experiences in evaluating Chicago (Illinois) city schools' restructuring. Questions raised by case studies in school restructuring include qualitative researchers' role in studying educational policy, issues of objectivity in policy research, and networking…

Assessing the Spread and Uptake of a Framework for Introducing and Evaluating Advanced Practice Nursing Roles.

PubMed

Boyko, Jennifer A; Carter, Nancy; Bryant-Lukosius, Denise

2016-08-01

Health system researchers must ensure that the products of their work meet the needs of various stakeholder groups (e.g., patients, practitioners, and policy makers). Evidence-based frameworks can support the uptake and spread of research evidence; however, their existence as knowledge translation tools does not ensure their uptake and it is difficult to ascertain their spread into research, practice, and policy using existing methods. The purpose of this article is to report results of a study on the spread and uptake of an evidence-based framework (i.e., the participatory, evidence-based, patient-focused process for advanced practice nursing [PEPPA] framework) into research, practice, and policies relevant to the introduction and evaluation of advanced practice nursing roles. We also reflect on the utility of using a modified citation methodology to evaluate knowledge translation efforts. We searched four databases for literature published between 2004 and 2014 citing the original paper in which the PEPPA framework was published, and carried out an Internet search for grey literature using keywords. Relevant data were extracted from sources and organized using NVivo software. We analysed results descriptively. Our search yielded 164 unique sources of which 69.5% were from published literature and the majority (83.4%) of these were published in nursing journals. Most frequently (71.5%), the framework was used by researchers and students in research studies. A smaller number of citations (11.3%) reflected use of the PEPPA framework in practice settings with a focus on role development, implementation, evaluation, or a combination of these. This study demonstrates that the PEPPA framework has been used to varying degrees as intended, and provides guidance on how to evaluate the spread and uptake of research outputs (e.g., theoretical frameworks). Further research is needed about ways to determine whether evidence-informed research tools such as frameworks have been taken up successfully into practice and policy contexts. © 2016 Sigma Theta Tau International.

Evaluation of WYDOT's research center and research program.

DOT National Transportation Integrated Search

2008-03-01

This study examined multiple aspects of the Wyoming Department of Transportations Research Program. It provides numerous observations of : the overall program and the research investment portfolio as well as guidance for developing a strategic res...

Developing non-routine problems for assessing students’ mathematical literacy

NASA Astrophysics Data System (ADS)

Murdiyani, N. M.

2018-03-01

The purpose of this study is to develop non-routine problems for assessing the mathematics literacy skills of students, which is valid, practical, and effective. It is based on the previous research said that Indonesian students’ mathematical literacy is still low. The results of this study can be used as a guide in developing the evaluation questions that can train students to improve the ability of solving non-routine problems in everyday life. This research type is formative evaluation that consists of preliminary, self evaluation, expert reviews, one-to-one, small group, and field test. The sample of this research is grade 8 students at one of Junior High School in Yogyakarta. This study results in mathematics literacy problems prototype consisting of level 1 to level 6 problems similar to PISA problems. This study also discusses the examples of students’ answer and their reasoning.

Methods and impact of engagement in research, from theory to practice and back again: early findings from the Patient-Centered Outcomes Research Institute.

PubMed

Forsythe, Laura; Heckert, Andrea; Margolis, Mary Kay; Schrandt, Suzanne; Frank, Lori

2018-01-01

Since 2012, PCORI has been funding patient-centered comparative effectiveness research with a requirement for engaging patients and other stakeholders in the research, a requirement that is unique among the US funders of clinical research. This paper presents PCORI's evaluation framework for assessing the short- and long-term impacts of engagement; describes engagement in PCORI projects (types of stakeholders engaged, when in the research process they are engaged and how they are engaged, contributions of their engagement); and identifies the effects of engagement on study design, processes, and outcomes selection, as reported by both PCORI-funded investigators and patient and other stakeholder research partners. Detailed quantitative and qualitative information collected annually from investigators and their partners was analyzed via descriptive statistics and cross-sectional qualitative content and thematic analysis, and compared against the outcomes expected from the evaluation framework and its underlying conceptual model. The data support the role of engaged research partners in refinements to the research questions, selection of interventions to compare, choice of study outcomes and how they are measured, contributions to strategies for recruitment, and ensuring studies are patient-centered. The evaluation framework and the underlying conceptual model are supported by results to date. PCORI will continue to assess the effects of engagement as the funded projects progress toward completion, dissemination, and uptake into clinical decision making.

Maintenance Operations Degradation of Airfield Pavement Markings

DTIC Science & Technology

2012-03-01

polyurea . 1.4 Research Questions To answer the problem presented, several questions need to be addressed. The first is whether or not rubber...suitable for use on airfields.  Further research is required. Cyrus and Frierson 2006 Polyurea  The material showed poor performance in...evaluating polyurea and one evaluating polyester. Both studies were undertaken to evaluate the effectiveness of polyurea or polyester as a potential

Relation of completeness of reporting of health research to journals’ endorsement of reporting guidelines: systematic review

PubMed Central

Stevens, Adrienne; Shamseer, Larissa; Weinstein, Erica; Yazdi, Fatemeh; Turner, Lucy; Thielman, Justin; Altman, Douglas G; Hirst, Allison; Hoey, John; Palepu, Anita; Schulz, Kenneth F

2014-01-01

Objective To assess whether the completeness of reporting of health research is related to journals’ endorsement of reporting guidelines. Design Systematic review. Data sources Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed “evaluations”) (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name. Study selection English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals). Data extraction Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals’ websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors’ analysis, a mean summed score. Results 101 reporting guidelines were included. Of 15 249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations. Conclusions The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals’ endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals’ endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence. Systematic review registration Not registered; no known register currently accepts protocols for methodology systematic reviews. PMID:24965222

Evaluation of a learner-designed course for teaching health research skills in Ghana

PubMed Central

Bates, Imelda; Ansong, Daniel; Bedu-Addo, George; Agbenyega, Tsiri; Akoto, Alex Yaw Osei; Nsiah-Asare, Anthony; Karikari, Patrick

2007-01-01

Background In developing countries the ability to conduct locally-relevant health research and high quality education are key tools in the fight against poverty. The objective of our study was to evaluate the effectiveness of a novel UK accredited, learner-designed research skills course delivered in a teaching hospital in Ghana. Methods Study participants were 15 mixed speciality health professionals from Komfo Anokye Teaching Hospital, Kumasi, Ghana. Effectiveness measures included process, content and outcome indicators to evaluate changes in learners' confidence and competence in research, and assessment of the impact of the course on changing research-related thinking and behaviour. Results were verified using two independent methods. Results 14/15 learners gained research competence assessed against UK Quality Assurance Agency criteria. After the course there was a 36% increase in the groups' positive responses to statements concerning confidence in research-related attitudes, intentions and actions. The greatest improvement (45% increase) was in learners' actions, which focused on strengthening institutional research capacity. 79% of paired before/after responses indicated positive changes in individual learners' research-related attitudes (n = 53), 81% in intention (n = 52) and 85% in action (n = 52). The course had increased learners' confidence to start and manage research, and enhanced life-long skills such as reflective practice and self-confidence. Doing their own research within the work environment, reflecting on personal research experiences and utilising peer support and pooled knowledge were critical elements that promoted learning. Conclusion Learners in Ghana were able to design and undertake a novel course that developed individual and institutional research capacity and met international standards. Learning by doing and a supportive peer community at work were critical elements in promoting learning in this environment where tutors were scarce. Our study provides a model for delivering and evaluating innovative educational interventions in developing countries to assess whether they meet external quality criteria and achieve their objectives. PMID:17596260

Evaluation of a Community-Based Participatory Research Consortium from the Perspective of Academics and Community Service Providers Focused on Child Health and Well-Being

ERIC Educational Resources Information Center

Pivik, Jayne R.; Goelman, Hillel

2011-01-01

A process evaluation of a consortium of academic researchers and community-based service providers focused on the health and well-being of children and families provides empirical and practice-based evidence of those factors important for community-based participatory research (CBPR). This study draws on quantitative ratings of 33 factors…

Obstacles to Using Prior Research and Evaluations.

ERIC Educational Resources Information Center

Orwin, Robert G.

1985-01-01

The manner in which results and methods are reported influences the ability of the synthesis of prior studies for planning new evaluations. Confidence ratings, coding conventions, and supplemental evidence can partially overcome the difficulties. Planners must acknowledge the influence of their own judgement in using prior research. (Author)

Evaluating Faculty Work: Expectations and Standards of Faculty Performance in Research Universities

ERIC Educational Resources Information Center

Hardre, Patricia; Cox, Michelle

2009-01-01

Expectations and the way they are communicated can influence employees' motivation and performance. Previous research has demonstrated individual effects of workplace climate and individual differences on faculty productivity. The present study focused on the characteristics of institutional performance standards, evaluation processes and…

21 CFR 600.80 - Postmarketing reporting of adverse experiences.

Code of Federal Regulations, 2011 CFR

2011-04-01

... epidemiological/surveillance studies, reports in the scientific literature, and unpublished scientific papers... products to the Center for Biologics Evaluation and Research (HFM-210), or to the Center for Drug Evaluation and Research (see mailing addresses in § 600.2). Submit all vaccine adverse experience reports to...

21 CFR 600.80 - Postmarketing reporting of adverse experiences.

Code of Federal Regulations, 2012 CFR

2012-04-01

... epidemiological/surveillance studies, reports in the scientific literature, and unpublished scientific papers... products to the Center for Biologics Evaluation and Research (HFM-210), or to the Center for Drug Evaluation and Research (see mailing addresses in § 600.2). Submit all vaccine adverse experience reports to...

21 CFR 600.80 - Postmarketing reporting of adverse experiences.

Code of Federal Regulations, 2014 CFR

2014-04-01

... epidemiological/surveillance studies, reports in the scientific literature, and unpublished scientific papers... products to the Center for Biologics Evaluation and Research (HFM-210), or to the Center for Drug Evaluation and Research (see mailing addresses in § 600.2). Submit all vaccine adverse experience reports to...

21 CFR 600.80 - Postmarketing reporting of adverse experiences.

Code of Federal Regulations, 2013 CFR

2013-04-01

... epidemiological/surveillance studies, reports in the scientific literature, and unpublished scientific papers... products to the Center for Biologics Evaluation and Research (HFM-210), or to the Center for Drug Evaluation and Research (see mailing addresses in § 600.2). Submit all vaccine adverse experience reports to...

78 FR 12066 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-02-21

... OMB Review; Comment Request Title: Tracking of the Early Head Start Research and Evaluation Project (EHSRET) Sample. OMB No.: 0970-0388. Description: The EHSREP is a longitudinal study originally designed.../families who participated in the Early Head Start Research and Evaluation Project (EHSREP) until the...

Emerging Methodologies in Pediatric Palliative Care Research: Six Case Studies

PubMed Central

Nelson, Katherine E.; Gerhardt, Cynthia A.; Rosenberg, Abby R.; Widger, Kimberley; Faerber, Jennifer A.; Feudtner, Chris

2018-01-01

Given the broad focus of pediatric palliative care (PPC) on the physical, emotional, and spiritual needs of children with potentially life-limiting illnesses and their families, PPC research requires creative methodological approaches. This manuscript, written by experienced PPC researchers, describes issues encountered in our own areas of research and the novel methods we have identified to target them. Specifically, we discuss potential approaches to: assessing symptoms among nonverbal children, evaluating medical interventions, identifying and treating problems related to polypharmacy, addressing missing data in longitudinal studies, evaluating longer-term efficacy of PPC interventions, and monitoring for inequities in PPC service delivery. PMID:29495384

Advances in Research on Organization Development: Toward a Beginning

ERIC Educational Resources Information Center

Pate, Larry E.; And Others

1977-01-01

This paper examines 38 research studies that were conducted on various aspects of organization development (OD) technology. The studies are compared along eight dimensions. Problems associated with evaluating OD and the limited amount of OD research are discussed. It is argued that more systematic, longitudinal research on OD is needed. (Author)

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review.

PubMed

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; "simulation," "practice," "drill," "exercise," "instrument," "tool," "questionnaire," " measurement," "checklist," "scale," "test," "inventory," "battery," "evaluation," "assessment," "appraisal," "emergency," "disaster," "cricise," "hazard," "catastrophe,: "hospital", "prehospital," "health centers," "treatment centers," were used in combination with Boolean operators OR and AND. The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest available evaluation techniques and methods for better implementation of disaster exercise evaluation stages.

Fuels research studies at NASA Lewis

NASA Technical Reports Server (NTRS)

Antoine, A. C.

1982-01-01

Fuels research studies carried out in a variety of areas related to aviation propulsion, ground transportation, and stationary power generation systems are discussed. The major efforts are directed to studies on fuels for jet aircraft. These studies involve fuels preparation, fuels analysis, and fuel quality evaluations. The scope and direction of research activities in these areas is discussed, descriptions of Lewis capabilities and facilities given, and results of recent research efforts reported.

Quantity and Quality of Economic Evaluations in U.S. Nursing Research, 1997-2015: A Systematic Review.

PubMed

Cook, Wendy A; Morrison, Megan L; Eaton, Linda H; Theodore, Brian R; Doorenbos, Ardith Z

The United States has a complex healthcare system that is undergoing substantial reformations. There is a need for high-quality, economic evaluations of nursing practice. An updated review of completed economic evaluations relevant to the field of nursing within the U.S. healthcare system is timely and needed. The purpose of this study was to evaluate and describe the quantity and quality of economic evaluations in nursing-relevant research performed in the United States between 1997 and 2015. Four databases were searched. Titles, abstracts, and full-text content were reviewed to identify studies that analyzed both costs and outcomes, relevant to nursing, performed in the United States, and used the quality-adjusted life year to measure effectiveness. For included studies, data were extracted from full-text articles using criteria from U.S. Public Health Service's Panel on Cost-Effectiveness in Health and Medicine. Twenty-eight studies met the inclusion criteria. Most (n = 25, 89%) were published in the last decade of the analysis, from 2006 to 2015. Assessment of quality, based on selected items from the panel guidelines, found that the evaluations did not consistently use the recommended societal perspective, use multiple resource utilization categories, use constant dollars, discount future costs and outcomes, use a lifetime horizon, or include an indication of uncertainty in results. The only resource utilization category consistently included across studies was healthcare resources. Only 28 nursing-related studies meeting the inclusion criteria were identified as meeting robust health economic evaluation methodological criteria, and most did not include all important guideline items. Despite increases in absolute numbers of published studies over the past decade, economic evaluation has been underutilized in U.S. nursing-relevant research in the past two decades.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods.

PubMed

Pommier, Jeanine; Guével, Marie-Renée; Jourdan, Didier

2010-01-28

Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community.

Performance Evaluation Tests for Environmental Research (PETER): evaluation of 114 measures

NASA Technical Reports Server (NTRS)

Bittner, A. C. Jr; Carter, R. C.; Kennedy, R. S.; Harbeson, M. M.; Krause, M.

1986-01-01

The goal of the Performance Evaluation Tests for Environmental Research (PETER) Program was to identify a set of measures of human capabilities for use in the study of environmental and other time-course effects. 114 measures studied in the PETER Program were evaluated and categorized into four groups based upon task stability and task definition. The Recommended category contained 30 measures that clearly obtained total stabilization and had an acceptable level of reliability efficiency. The Acceptable-But-Redundant category contained 15 measures. The 37 measures in the Marginal category, which included an inordinate number of slope and other derived measures, usually had desirable features which were outweighed by faults. The 32 measures in the Unacceptable category had either differential instability or weak reliability efficiency. It is our opinion that the 30 measures in the Recommended category should be given first consideration for environmental research applications. Further, it is recommended that information pertaining to preexperimental practice requirements and stabilized reliabilities should be utilized in repeated-measures environmental studies.

How to Critically Evaluate Case Studies in Social Work

ERIC Educational Resources Information Center

Lee, Eunjung; Mishna, Faye; Brennenstuhl, Sarah

2010-01-01

The purpose of this article is to develop guidelines to assist practitioners and researchers in evaluating and developing rigorous case studies. The main concern in evaluating a case study is to accurately assess its quality and ultimately to offer clients social work interventions informed by the best available evidence. To assess the quality of…

Integrity in Biomedical Research: A Systematic Review of Studies in China.

PubMed

Yi, Nannan; Nemery, Benoit; Dierickx, Kris

2018-05-02

Recent empirical evidence has demonstrated that research misconduct occurs to a substantial degree in biomedical research. It has been suggested that scientific integrity is also of concern in China, but this seems to be based largely on anecdotal evidence. We, therefore, sought to explore the Chinese situation, by making a systematic review of published empirical studies on biomedical research integrity in China. One of our purposes was also to summarize the existing body of research published in Chinese. We searched the China National Knowledge Infrastructure, Wanfang Data, PubMed and Web of Science for potentially relevant studies, and included studies meeting our inclusion criteria, i.e. mainly those presenting empirically obtained data about the practice of research in China. All the data was extracted and synthesized using an inductive approach. Twenty-one studies were included for review. Two studies used qualitative methods (interviews) and nineteen studies used quantitative methods (questionnaires). Studies involved mainly medical postgraduates and nurses and they investigated awareness, attitudes, perceptions and experiences of research integrity and misconduct. Most of the participants in these 21 studies reported that research integrity is of great importance and that they obey academic norms during their research. Nevertheless, the occurrence of research misbehaviors, such as fabrication, falsification, plagiarism, improper authorship and duplicate submission was also reported. Strengthening research integrity training, developing the governance system and improving the scientific evaluation system were areas of particular attention in several studies. Our review demonstrates that a substantial number of articles have been devoted to research integrity in China, but only a few studies provide empirical evidence. With more safeguard measures of research integrity being taken in China, it would be crucial to conduct more research to explore researchers' in-depth perceptions and evaluate the changes.

A systematic review of health economic evaluations of vaccines in Brazil.

PubMed

Sartori, Ana Marli Christovam; Rozman, Luciana Martins; Decimoni, Tassia Cristina; Leandro, Roseli; Novaes, Hillegonda Maria Dutilh; de Soárez, Patrícia Coelho

2017-06-03

In Brazil, since 2005, the Ministry of Health requires Health Economic Evaluation (HEE) of vaccines for introduction into the National Immunization Program. To describe and analyze the full HEE on vaccines conducted in Brazil from 1980 to 2013. Systematic review of the literature. We searched multiple databases. Two researchers independently selected the studies and extracted the data. The methodological quality of individual studies was evaluated using CHEERS items. Twenty studies were reviewed. The most evaluated vaccines were pneumococcal (25%) and HPV (15%). The most used types of HEE were cost-effectiveness analysis (45%) and cost-utility analysis (20%). The research question and compared strategies were stated in all 20 studies and the target population was clear in 95%. Nevertheless, many studies did not inform the perspective of analysis or data sources. HEE of vaccines in Brazil has increased since 2008. However, the studies still have methodological deficiencies.

A systematic review of health economic evaluations of vaccines in Brazil

PubMed Central

2017-01-01

ABSTRACT Background: In Brazil, since 2005, the Ministry of Health requires Health Economic Evaluation (HEE) of vaccines for introduction into the National Immunization Program. Objectives: To describe and analyze the full HEE on vaccines conducted in Brazil from 1980 to 2013. Methods: Systematic review of the literature. We searched multiple databases. Two researchers independently selected the studies and extracted the data. The methodological quality of individual studies was evaluated using CHEERS items. Results: Twenty studies were reviewed. The most evaluated vaccines were pneumococcal (25%) and HPV (15%). The most used types of HEE were cost-effectiveness analysis (45%) and cost-utility analysis (20%). The research question and compared strategies were stated in all 20 studies and the target population was clear in 95%. Nevertheless, many studies did not inform the perspective of analysis or data sources. Conclusions: HEE of vaccines in Brazil has increased since 2008. However, the studies still have methodological deficiencies. PMID:28129026

Preference Reversals Between Joint and Separate Evaluations With Multiple Alternatives and Context Effects.

PubMed

Cheng, Yin-Hui; Yu, Annie P; Huang, Molly Chien-Jung; Dai, Chia-Jung

2017-01-01

Most research on preference reversal (PR) focuses on the evaluability hypothesis with one or two alternatives. However, people normally encounter more than two options in daily life. In this research, a third option was added to the PR effect choice sets in the traditional joint-separate evaluations mode to create a context effect. Three studies were conducted. Studies 1 and 2 showed that adding a third option to the choice sets changed the PR effect; either the attributes were both important or one was important and the other was not. Study 3 showed that the PR effect reappeared when a third option was added to the choice sets that had no PR effect with just two attributes that were difficult to evaluate independently in traditional evaluations modes. The three studies confirmed that preferences changed in multi-alternative evaluation modes, contradicting Hsee's (1996) work and showing that the context effect is stronger than that of the attribute's importance in the PR effect.

The Role of Psychometrics in Individual Differences Research in Cognition: A Case Study of the AX-CPT

PubMed Central

Cooper, Shelly R.; Gonthier, Corentin; Barch, Deanna M.; Braver, Todd S.

2017-01-01

Investigating individual differences in cognition requires addressing questions not often thought about in standard experimental designs, especially regarding the psychometric properties of the task. Using the AX-CPT cognitive control task as a case study example, we address four concerns that one may encounter when researching the topic of individual differences in cognition. First, we demonstrate the importance of variability in task scores, which in turn directly impacts reliability, particularly when comparing correlations in different populations. Second, we demonstrate the importance of variability and reliability for evaluating potential failures to replicate predicted correlations, even within the same population. Third, we demonstrate how researchers can turn to evaluating psychometric properties as a way of evaluating the feasibility of utilizing the task in new settings (e.g., online administration). Lastly, we show how the examination of psychometric properties can help researchers make informed decisions when designing a study, such as determining the appropriate number of trials for a task. PMID:28928690

What Counts is not Falling … but Landing1

PubMed Central

BROUSSELLE, ASTRID

2012-01-01

Implementation evaluations, also called process evaluations, involve studying the development of programmes, and identifying and understanding their strengths and weaknesses. Undertaking an implementation evaluation offers insights into evaluation objectives, but does not help the researcher develop a research strategy. During the implementation analysis of the UNAIDS drug access initiative in Chile, the strategic analysis model developed by Crozier and Friedberg was used. However, a major incompatibility was noted between the procedure put forward by Crozier and Friedberg and the specific characteristics of the programme being evaluated. In this article, an adapted strategic analysis model for programme evaluation is proposed. PMID:23526306

Inter-rater agreement in evaluation of disability: systematic review of reproducibility studies.

PubMed

Barth, Jürgen; de Boer, Wout E L; Busse, Jason W; Hoving, Jan L; Kedzia, Sarah; Couban, Rachel; Fischer, Katrin; von Allmen, David Y; Spanjer, Jerry; Kunz, Regina

2017-01-25

 To explore agreement among healthcare professionals assessing eligibility for work disability benefits.  Systematic review and narrative synthesis of reproducibility studies.  Medline, Embase, and PsycINFO searched up to 16 March 2016, without language restrictions, and review of bibliographies of included studies.  Observational studies investigating reproducibility among healthcare professionals performing disability evaluations using a global rating of working capacity and reporting inter-rater reliability by a statistical measure or descriptively. Studies could be conducted in insurance settings, where decisions on ability to work include normative judgments based on legal considerations, or in research settings, where decisions on ability to work disregard normative considerations. : Teams of paired reviewers identified eligible studies, appraised their methodological quality and generalisability, and abstracted results with pretested forms. As heterogeneity of research designs and findings impeded a quantitative analysis, a descriptive synthesis stratified by setting (insurance or research) was performed.  From 4562 references, 101 full text articles were reviewed. Of these, 16 studies conducted in an insurance setting and seven in a research setting, performed in 12 countries, met the inclusion criteria. Studies in the insurance setting were conducted with medical experts assessing claimants who were actual disability claimants or played by actors, hypothetical cases, or short written scenarios. Conditions were mental (n=6, 38%), musculoskeletal (n=4, 25%), or mixed (n=6, 38%). Applicability of findings from studies conducted in an insurance setting to real life evaluations ranged from generalisable (n=7, 44%) and probably generalisable (n=3, 19%) to probably not generalisable (n=6, 37%). Median inter-rater reliability among experts was 0.45 (range intraclass correlation coefficient 0.86 to κ-0.10). Inter-rater reliability was poor in six studies (37%) and excellent in only two (13%). This contrasts with studies conducted in the research setting, where the median inter-rater reliability was 0.76 (range 0.91-0.53), and 71% (5/7) studies achieved excellent inter-rater reliability. Reliability between assessing professionals was higher when the evaluation was guided by a standardised instrument (23 studies, P=0.006). No such association was detected for subjective or chronic health conditions or the studies' generalisability to real world evaluation of disability (P=0.46, 0.45, and 0.65, respectively).  Despite their common use and far reaching consequences for workers claiming disabling injury or illness, research on the reliability of medical evaluations of disability for work is limited and indicates high variation in judgments among assessing professionals. Standardising the evaluation process could improve reliability. Development and testing of instruments and structured approaches to improve reliability in evaluation of disability are urgently needed. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Redesigning and aligning assessment and evaluation for a federally funded math and science teacher educational program.

PubMed

Hardré, Patricia L; Slater, Janis; Nanny, Mark

2010-11-01

This paper examines the redesign of evaluation components for a teacher professional development project funded by the National Science Foundation. It focuses on aligning evaluation instrumentation and strategies with program goals, research goals and program evaluation best practices. The study identifies weaknesses in the original (year 1) program evaluation design and implementation, develops strategies and tracks changes for year 2 implementation, and then reports enhancement of findings and recommendations for year 3. It includes lessons learned about assessment and evaluation over the project lifespan, with implications for research and evaluation of a range of related programs. This study functions as a classic illustration of how critical it is to observe first principles of assessment and evaluation for funded programs, the risks that arise when they are ignored, and the benefits that accrue when they are systematically observed. Copyright (c) 2009. Published by Elsevier Ltd.

Reporting Qualitative Research: Standards, Challenges, and Implications for Health Design.

PubMed

Peditto, Kathryn

2018-04-01

This Methods column describes the existing reporting standards for qualitative research, their application to health design research, and the challenges to implementation. Intended for both researchers and practitioners, this article provides multiple perspectives on both reporting and evaluating high-quality qualitative research. Two popular reporting standards exist for reporting qualitative research-the Consolidated Criteria for Reporting Qualitative Research (COREQ) and the Standards for Reporting Qualitative Research (SRQR). Though compiled using similar procedures, they differ in their criteria and the methods to which they apply. Creating and applying reporting criteria is inherently difficult due to the undefined and fluctuating nature of qualitative research when compared to quantitative studies. Qualitative research is expansive and occasionally controversial, spanning many different methods of inquiry and epistemological approaches. A "one-size-fits-all" standard for reporting qualitative research can be restrictive, but COREQ and SRQR both serve as valuable tools for developing responsible qualitative research proposals, effectively communicating research decisions, and evaluating submissions. Ultimately, tailoring a set of standards specific to health design research and its frequently used methods would ensure quality research and aid reviewers in their evaluations.

Design of CIAO, a research program to support the development of an integrated approach to prevent overweight and obesity in the Netherlands.

PubMed

van Koperen, Marije Tm; van der Kleij, Rianne Mjj; Renders, Carry Cm; Crone, Matty Mr; Hendriks, Anna-Marie Am; Jansen, Maria M; van de Gaar, Vivian Vm; Raat, Hein Jh; Ruiter, Emilie Elm; Molleman, Gerard Grm; Schuit, Jantine Aj; Seidell, Jacob Jc

2014-01-01

The aim of this paper is to describe the research aims, concepts and methods of the research Consortium Integrated Approach of Overweight (CIAO). CIAO is a concerted action of five Academic Collaborative Centres, local collaborations between academic institutions, regional public health services, local authorities and other relevant sectors in the Netherlands. Prior research revealed lacunas in knowledge of and skills related to five elements of the integrated approach of overweight prevention in children (based upon the French EPODE approach), namely political support, parental education, implementation, social marketing and evaluation. CIAO aims to gain theoretical and practical insight of these elements through five sub-studies and to develop, based on these data, a framework for monitoring and evaluation. For this research program, mixed methods are used in all the five sub-studies. First, problem specification through literature research and consultation of stakeholders, experts, health promotion specialists, parents and policy makers will be carried out. Based on this information, models, theoretical frameworks and practical instruments will be developed, tested and evaluated in the communities that implement the integrated approach to prevent overweight in children. Knowledge obtained from these studies and insights from experts and stakeholders will be combined to create an evaluation framework to evaluate the integrated approach at central, local and individual levels that will be applicable to daily practice. This innovative research program stimulates sub-studies to collaborate with local stakeholders and to share and integrate their knowledge, methodology and results. Therefore, the output of this program (both knowledge and practical tools) will be matched and form building blocks of a blueprint for a local evidence- and practice-based integrated approach towards prevention of overweight in children. The output will then support various communities to further optimize the implementation and subsequently the effects of this approach.

[Research about re-evaluation of screening of traditonal Chinese medicine symptoms item of post-marketing medicine Xuezhikang].

PubMed

He, Wei; Xie, Yanming; Wang, Yongyan

2011-10-01

The purpose of post-marketing Chinese medicine re-evaluation is to identify Chinese medicine clinical indications, while designing scientific and rational of Chinese medicine symptoms items are important to the result of symptoms re-evaluation. This study give screening of traditional Chinese medicine(TCM) symptoms item of post-marketing medicine Xuezhikang re-evaluation as example that reference to principle dyslipidemia clinical research, academic dissertations, Xuezhikang directions, clinical expert practice experience etc. while standardization those symptom names and screening 41 dyslipidemia common symptoms. Furthermore, this paper discuss about the accoerdance and announcements when screening symptoms item, so as to providing a research thread to manufacture PRO chart for post-marketing medicine re-evaluation.

A Primer on Health Economic Evaluations in Thoracic Oncology.

PubMed

Whittington, Melanie D; Atherly, Adam J; Bocsi, Gregary T; Camidge, D Ross

2016-08-01

There is growing interest for economic evaluation in oncology to illustrate the value of multiple new diagnostic and therapeutic interventions. As these analyses have started to move from specialist publications into mainstream medical literature, the wider medical audience consuming this information may need additional education to evaluate it appropriately. Here we review standard practices in economic evaluation, illustrating the different methods with thoracic oncology examples where possible. When interpreting and conducting health economic studies, it is important to appraise the method, perspective, time horizon, modeling technique, discount rate, and sensitivity analysis. Guidance on how to do this is provided. To provide a method to evaluate this literature, a literature search was conducted in spring 2015 to identify economic evaluations published in the Journal of Thoracic Oncology. Articles were reviewed for their study design, and areas for improvement were noted. Suggested improvements include using more rigorous sensitivity analyses, adopting a standard approach to reporting results, and conducting complete economic evaluations. Researchers should design high-quality studies to ensure the validity of the results, and consumers of this research should interpret these studies critically on the basis of a full understanding of the methodologies used before considering any of the conclusions. As advancements occur on both the research and consumer sides, this literature can be further developed to promote the best use of resources for this field. Copyright © 2016 International Association for the Study of Lung Cancer. Published by Elsevier Inc. All rights reserved.

[The positioning of nursing research in the academic studies: the origin and development of qualitative and quantitative studies].

PubMed

Lu, Pei-Pei; Ting, Shing-Shiang; Chen, Mei-Ling; Tang, Woung-Ru

2005-12-01

The purpose of this study is to discuss the historical context of qualitative and quantitative research so as to explain the principle of qualitative study and examine the positioning of nursing research within academic study as a whole. This paper guides the readers towards the historical context from empirical science, discusses the influences of qualitative and quantitative research on nursing research, then investigates the nature of research paradigms, examines the positioning of nursing research, which includes the characteristics of fields such as natural science, humanity and social studies, and science, and lastly, presents the research standard proposed by Yardley in 2000. The research paradigms include Positivism, Postpositivism, Criticism, and Constructivism, which can be compared with Ontology, Epistemology, and Methodology. The nature of the paradigm is to determine the assumption of the paradigm on the basis of Ontology, Epistemology, and Methodology. The paradigm determines how the researcher views the world and decides on what to answer, how to research, and how to answer. The difference in academic environment is reflected in the long-term dialogue between qualitative and quantitative studies, as well as the standard for criticism. This paper introduces the method of evaluation of the quality of qualitative study proposed by Yardley in 2002, namely the sensitivity of the context, the promise and conscientiousness, transparency and consistency, influence and significance. The paper is intended to provide a guideline for readers in evaluating the quality of qualitative study.

A hybrid method for evaluating enterprise architecture implementation.

PubMed

Nikpay, Fatemeh; Ahmad, Rodina; Yin Kia, Chiam

2017-02-01

Enterprise Architecture (EA) implementation evaluation provides a set of methods and practices for evaluating the EA implementation artefacts within an EA implementation project. There are insufficient practices in existing EA evaluation models in terms of considering all EA functions and processes, using structured methods in developing EA implementation, employing matured practices, and using appropriate metrics to achieve proper evaluation. The aim of this research is to develop a hybrid evaluation method that supports achieving the objectives of EA implementation. To attain this aim, the first step is to identify EA implementation evaluation practices. To this end, a Systematic Literature Review (SLR) was conducted. Second, the proposed hybrid method was developed based on the foundation and information extracted from the SLR, semi-structured interviews with EA practitioners, program theory evaluation and Information Systems (ISs) evaluation. Finally, the proposed method was validated by means of a case study and expert reviews. This research provides a suitable foundation for researchers who wish to extend and continue this research topic with further analysis and exploration, and for practitioners who would like to employ an effective and lightweight evaluation method for EA projects. Copyright © 2016 Elsevier Ltd. All rights reserved.

Incorporating Translation in Qualitative Studies: Two Case Studies in Education

ERIC Educational Resources Information Center

Sutrisno, Agustian; Nguyen, Nga Thanh; Tangen, Donna

2014-01-01

Cross-language qualitative research in education continues to increase. However, there has been inadequate discussion in the literature concerning the translation process that ensures research trustworthiness applicable for bilingual researchers. Informed by the literature on evaluation criteria for qualitative data translation, this paper…

Earth Resources Laboratory research and technology

NASA Technical Reports Server (NTRS)

1983-01-01

The accomplishments of the Earth Resources Laboratory's research and technology program are reported. Sensors and data systems, the AGRISTARS project, applied research and data analysis, joint research projects, test and evaluation studies, and space station support activities are addressed.

Methodological Review of Intimate Partner Violence Prevention Research

ERIC Educational Resources Information Center

Murray, Christine E.; Graybeal, Jennifer

2007-01-01

The authors present a methodological review of empirical program evaluation research in the area of intimate partner violence prevention. The authors adapted and utilized criterion-based rating forms to standardize the evaluation of the methodological strengths and weaknesses of each study. The findings indicate that the limited amount of…

Application of GPS and Near-Surface Geophysical Methods to Evaluate Agricultural Test Plot Differences

USDA-ARS?s Scientific Manuscript database

A field research facility with two pairs of replicated agricultural test plots (four total) was established at a location in northwest Ohio during 2005 for the purpose of studying water table management strategies. Initial efforts at this field research facility were devoted to evaluating difference...

Core Self-Evaluation and Goal Orientation: Understanding Work Stress

ERIC Educational Resources Information Center

Morris, Michael Lane; Messal, Carrie B.; Meriac, John P.

2013-01-01

This study investigates the dispositional factors related to work stress. Specifically, previous research has demonstrated a relationship between core self-evaluation (CSE) and general life stress. This article extends past research by examining the relationship between CSE and work stress, and includes goal orientation as a potential mediator of…

Multidimensional Collaboration: Reflections on Action Research in a Clinical Context

ERIC Educational Resources Information Center

Gregory, Sheila; Poland, Fiona; Spalding, Nicola J.; Sargen, Kevin; McCulloch, Jane; Vicary, Penny

2011-01-01

This paper reflects on the challenges and benefits of multidimensional collaboration in an action research study to evaluate and improve preoperative education for patients awaiting colorectal surgery. Three cycles of planning, acting, observing and reflecting were designed to evaluate practice and implement change in this interactive setting,…

76 FR 6795 - Statement of Organization, Functions, and Delegations of Authority; Office of the National...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-02-08

... Coordinator; (2) applies research methodologies to perform evaluation studies of health information technology grant programs; and, (3) applies advanced mathematical or quantitative modeling to the U.S. health care... remaining items in the paragraph accordingly: ``(1) Applying research methodologies to perform evaluation...

77 FR 48491 - Regulatory New Drug Review: Solutions for Study Data Exchange Standards; Notice of Meeting...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-14

... INFORMATION CONTACT: Ron Fitzmartin, Office of Planning & Informatics, Center for Drug Evaluation and Research... limited. Send registration information (including name, title, firm name, country of citizenship, address, telephone and fax number, and email address) to Fatima Elnigoumi, Center for Drug Evaluation and Research...

Expectancy Theory Outcomes and Student Evaluations of Teaching

ERIC Educational Resources Information Center

Ernst, David

2014-01-01

As student evaluation of teaching (SET) instruments are increasingly administered online, research has found that the response rates have dropped significantly. Validity concerns have necessitated research that explores student motivation for completing SETs. This study uses Vroom's [(1964). "Work and motivation" (3rd ed.). New York, NY:…

78 FR 37226 - Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-06-20

... Implementation Study. OMB No.: 0970-0398. Description: The Office of Data Analysis, Research, and Evaluation (HHS... Planning, Research, and Evaluation (HHS/ACF/OPRE) in the Administration for Children and Families (ACF... designed and implemented in the field, collect performance measure data for PREP programs, and assess the...

Evaluation of Participatory Research in Developing Community Leadership Skills.

ERIC Educational Resources Information Center

Karim, Wazir-Jahan B.

1982-01-01

This paper attempts to evaluate and explain the dynamic processes of decision-making and leadership development through participatory research, using the Malaysian experience as a case study. The focus is on the structural and situational constraints in the Malaysian rural society, the formal political machinery and the implementation of…

Fish biodiversity sampling in stream ecosystems: a process for evaluating the appropriate types and amount of gear

USGS Publications Warehouse

Smith, Joseph M.; Wells, Sarah P.; Mather, Martha E.; Muth, Robert M.

2014-01-01

When researchers and managers initiate sampling on a new stream or river system, they do not know how effective each gear type is and whether their sampling effort is adequate. Although the types and amount of gear may be different for other studies, systems, and research questions, the five-step process described here for making sampling decisions and evaluating sampling efficiency can be applied widely to any system to restore, manage, and conserve aquatic ecosystems. It is believed that incorporating this gear-evaluation process into a wide variety of studies and ecosystems will increase rigour within and across aquatic biodiversity studies.

Measures of Success for Earth System Science Education: The DLESE Evaluation Services and the Evaluation Toolkit Collection

NASA Astrophysics Data System (ADS)

McCaffrey, M. S.; Buhr, S. M.; Lynds, S.

2005-12-01

Increased agency emphasis upon the integration of research and education coupled with the ability to provide students with access to digital background materials, learning activities and primary data sources has begun to revolutionize Earth science education in formal and informal settings. The DLESE Evaluation Services team and the related Evaluation Toolkit collection (http://www.dlese.org/cms/evalservices/ ) provides services and tools for education project leads and educators. Through the Evaluation Toolkit, educators may access high-quality digital materials to assess students' cognitive gains, examples of alternative assessments, and case studies and exemplars of authentic research. The DLESE Evaluation Services team provides support for those who are developing evaluation plans on an as-requested basis. In addition, the Toolkit provides authoritative peer reviewed articlesabout evaluation research techniques and strategies of particular importance to geoscience education. This paper will provide an overview of the DLESE Evaluation Toolkit and discuss challenges and best practices for assessing student learning and evaluating Earth system sciences education in a digital world.

Advancing the research agenda for diagnostic error reduction.

PubMed

Zwaan, Laura; Schiff, Gordon D; Singh, Hardeep

2013-10-01

Diagnostic errors remain an underemphasised and understudied area of patient safety research. We briefly summarise the methods that have been used to conduct research on epidemiology, contributing factors and interventions related to diagnostic error and outline directions for future research. Research methods that have studied epidemiology of diagnostic error provide some estimate on diagnostic error rates. However, there appears to be a large variability in the reported rates due to the heterogeneity of definitions and study methods used. Thus, future methods should focus on obtaining more precise estimates in different settings of care. This would lay the foundation for measuring error rates over time to evaluate improvements. Research methods have studied contributing factors for diagnostic error in both naturalistic and experimental settings. Both approaches have revealed important and complementary information. Newer conceptual models from outside healthcare are needed to advance the depth and rigour of analysis of systems and cognitive insights of causes of error. While the literature has suggested many potentially fruitful interventions for reducing diagnostic errors, most have not been systematically evaluated and/or widely implemented in practice. Research is needed to study promising intervention areas such as enhanced patient involvement in diagnosis, improving diagnosis through the use of electronic tools and identification and reduction of specific diagnostic process 'pitfalls' (eg, failure to conduct appropriate diagnostic evaluation of a breast lump after a 'normal' mammogram). The last decade of research on diagnostic error has made promising steps and laid a foundation for more rigorous methods to advance the field.

Evaluating the impact and use of Transparent Reporting of Evaluations with Non-randomised Designs (TREND) reporting guidelines

PubMed Central

Fuller, Thomas; Pearson, Mark; Peters, Jaime L; Anderson, Rob

2012-01-01

Introduction Accurate and full reporting of evaluation of interventions in health research is needed for evidence synthesis and informed decision-making. Evidence suggests that biases and incomplete reporting affect the assessment of study validity and the ability to include this data in secondary research. The Transparent Reporting of Evaluations with Non-randomised Designs (TREND) reporting guideline was developed to improve the transparency and accuracy of the reporting of behavioural and public health evaluations with non-randomised designs. Evaluations of reporting guidelines have shown that they can be effective in improving reporting completeness. Although TREND occupies a niche within reporting guidelines, and despite it being 8 years since publication, no study yet has assessed its impact on reporting completeness or investigated what factors affect its use by authors and journal editors. This protocol describes two studies that aim to redress this. Methods and analysis Study 1 will use an observational design to examine the uptake and use of TREND by authors, and by journals in their instructions to authors. A comparison of reporting completeness and study quality of papers that do and do not use TREND to inform reporting will be made. Study 2 will use a cross-sectional survey to investigate what factors inhibit or facilitate authors’ and journal editors’ use of TREND. Semistructured interviews will also be conducted with a subset of authors and editors to explore findings from study 1 and the surveys in greater depth. Ethics and dissemination These studies will generate evidence of how implementation and dissemination of the TREND guideline has affected reporting completeness in studies with experimental, non-randomised designs within behavioural and public health research. The project has received ethics approval from the Research Ethics Committee of the Peninsula College of Medicine and Dentistry, Universities of Exeter and Plymouth. PMID:23257774

Evaluation of ridesharing programs in Michigan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kulp, G.; Tsao, H.J.; Webber, R.E.

1982-10-01

The design, implementation, and results of a carpool and vanpool evaluation are described. Objectives of the evaluation were: to develop credible estimates of the energy savings attributable to the ridesharing program, to provide information for improving the performance of the ridesharing program, and to add to a general understanding of the ridesharing process. Previous evaluation work is critiqued and the research methodology adopted for this study is discussed. The ridesharing program in Michigan is described and the basis for selecting Michigan as the evaluation site is discussed. The evaluation methodology is presented, including research design, sampling procedure, data collection, andmore » data validation. Evaluation results are analyzed. (LEW)« less

What Counts is not Falling … but Landing: Strategic Analysis: An Adapted Model for Implementation Evaluation.

PubMed

Brousselle, Astrid

2004-04-01

Implementation evaluations, also called process evaluations, involve studying the development of programmes, and identifying and understanding their strengths and weaknesses. Undertaking an implementation evaluation offers insights into evaluation objectives, but does not help the researcher develop a research strategy. During the implementation analysis of the UNAIDS drug access initiative in Chile, the strategic analysis model developed by Crozier and Friedberg was used. However, a major incompatibility was noted between the procedure put forward by Crozier and Friedberg and the specific characteristics of the programme being evaluated. In this article, an adapted strategic analysis model for programme evaluation is proposed.

Relation of completeness of reporting of health research to journals' endorsement of reporting guidelines: systematic review.

PubMed

Stevens, Adrienne; Shamseer, Larissa; Weinstein, Erica; Yazdi, Fatemeh; Turner, Lucy; Thielman, Justin; Altman, Douglas G; Hirst, Allison; Hoey, John; Palepu, Anita; Schulz, Kenneth F; Moher, David

2014-06-25

To assess whether the completeness of reporting of health research is related to journals' endorsement of reporting guidelines. Systematic review. Reporting guidelines from a published systematic review and the EQUATOR Network (October 2011). Studies assessing the completeness of reporting by using an included reporting guideline (termed "evaluations") (1990 to October 2011; addendum searches in January 2012) from searches of either Medline, Embase, and the Cochrane Methodology Register or Scopus, depending on reporting guideline name. English language reporting guidelines that provided explicit guidance for reporting, described the guidance development process, and indicated use of a consensus development process were included. The CONSORT statement was excluded, as evaluations of adherence to CONSORT had previously been reviewed. English or French language evaluations of included reporting guidelines were eligible if they assessed the completeness of reporting of studies as a primary intent and those included studies enabled the comparisons of interest (that is, after versus before journal endorsement and/or endorsing versus non-endorsing journals). Potentially eligible evaluations of included guidelines were screened initially by title and abstract and then as full text reports. If eligibility was unclear, authors of evaluations were contacted; journals' websites were consulted for endorsement information where needed. The completeness of reporting of reporting guidelines was analyzed in relation to endorsement by item and, where consistent with the authors' analysis, a mean summed score. 101 reporting guidelines were included. Of 15,249 records retrieved from the search for evaluations, 26 evaluations that assessed completeness of reporting in relation to endorsement for nine reporting guidelines were identified. Of those, 13 evaluations assessing seven reporting guidelines (BMJ economic checklist, CONSORT for harms, PRISMA, QUOROM, STARD, STRICTA, and STROBE) could be analyzed. Reporting guideline items were assessed by few evaluations. The completeness of reporting of only nine of 101 health research reporting guidelines (excluding CONSORT) has been evaluated in relation to journals' endorsement. Items from seven reporting guidelines were quantitatively analyzed, by few evaluations each. Insufficient evidence exists to determine the relation between journals' endorsement of reporting guidelines and the completeness of reporting of published health research reports. Journal editors and researchers should consider collaborative prospectively designed, controlled studies to provide more robust evidence. Not registered; no known register currently accepts protocols for methodology systematic reviews. © Stevens et al 2014.

Seeking consent for research with indigenous communities: a systematic review.

PubMed

Fitzpatrick, Emily F M; Martiniuk, Alexandra L C; D'Antoine, Heather; Oscar, June; Carter, Maureen; Elliott, Elizabeth J

2016-10-22

When conducting research with Indigenous populations consent should be sought from both individual participants and the local community. We aimed to search and summarise the literature about methods for seeking consent for research with Indigenous populations. A systematic literature search was conducted for articles that describe or evaluate the process of seeking informed consent for research with Indigenous participants. Guidelines for ethical research and for seeking consent with Indigenous people are also included in our review. Of 1447 articles found 1391 were excluded (duplicates, irrelevant, not in English); 56 were relevant and included. Articles were categorised into original research that evaluated the consent process (n = 5) or publications detailing the process of seeking consent (n = 13) and guidelines for ethical research (n = 38). Guidelines were categorised into international (n = 8); national (n = 20) and state/regional/local guidelines (n = 10). In five studies based in Australia, Canada and The United States of America the consent process with Indigenous people was objectively evaluated. In 13 other studies interpreters, voice recording, videos, pictures, flipcharts and "plain language" forms were used to assist in seeking consent but these processes were not evaluated. Some Indigenous organisations provide examples of community-designed resources for seeking consent and describe methods of community engagement, but none are evaluated. International, national and local ethical guidelines stress the importance of upholding Indigenous values but fail to specify methods for engaging communities or obtaining individual consent. In the 'Grey literature' concerns about the consent process are identified but no solutions are offered. Consultation with Indigenous communities is needed to determine how consent should be sought from the community and the individual, and how to evaluate this process.

Attitudes of Students of Croatian Teacher Training Studies towards Music Courses and Self-Evaluation of Their Playing Skills

ERIC Educational Resources Information Center

Begic, Jasna Šulentic; Begic, Amir; Škojo, Tihana

2017-01-01

This paper shows a research, which comprised of 152 students of teacher training studies from the Faculty of Educational in Osijek in the Republic of Croatia. The research was conducted during the academic year 2011/2012 and the main aim was to explore students' attitudes towards the musical courses and a self-evaluation of their own singing and…

Feasibility, appropriateness, meaningfulness and effectiveness of patient participation at bedside shift reporting: mixed-method research protocol.

PubMed

Malfait, Simon; Eeckloo, Kristof; Lust, Elisa; Van Biesen, Wim; Van Hecke, Ann

2017-02-01

To evaluate the feasibility, appropriateness, meaningfulness and effectiveness of bedside shift reporting in a minimum of five interventions and five control wards. Hospitals continually improve their quality of care. Next to improvements in clinical performance, more patient participation is stimulated through different methods. Methods to enhance patient participation such as bedside shift reporting lack rigorously performed research to determine their feasibility, appropriateness, meaningfulness and effectiveness. Small-scale research and a previous pilot study indicate that bedside shift reporting improves patient participation, nurse-nurse communication and nurse-patient communication. The development, implementation and evaluation of bedside shift report are based on the Medical Research Council framework for complex interventions in health care. A matched, controlled, mixed-method, longitudinal study design will be used. The Feasibility-Appropriateness-Meaningfulness-Effectiveness framework will be applied for the quantitative and qualitative evaluation of bedside shift report. A tailored intervention and implementation process for bedside shift report will be developed using diagnostic interviews, co-design and acceptability testing. The intervention will be evaluated before implementation and three times after implementation. Individual and focus group interviews will be performed. Questionnaires, observations and analysis of the medical records and administrative databases will be completed. This study was funded in October 2015. Research Ethics Committee approval was granted in March 2016. There is a pressing need for rigorous research into the effects of interventions for improving patient participation. This study addresses the significance of bedside shift report as an intervention to improve quality of care, communication and patient participation within a large-scale, matched, controlled research design. © 2016 John Wiley & Sons Ltd.

Computer-Assisted Telephone Screening: A New System for Patient Evaluation and Recruitment

PubMed Central

Radcliffe, Jeanne M.; Latham, Georgia S.; Sunderland, Trey; Lawlor, Brian A.

1990-01-01

Recruitment of subjects for research studies is a time consuming process for any research coordinator. This paper introduces three computerized databases designed to help screen potential research candidates by telephone. The three programs discussed are designed to evaluate specific populations: geriatric patients (i.e. Alzheimer's patients), patients with affective disorders and normal volunteers. The interview content, software development, and the utility of these programs is discussed with particular focus on how they can be helpful in the research setting.

Interventions aimed at increasing research use in nursing: a systematic review

PubMed Central

Thompson, David S; Estabrooks, Carole A; Scott-Findlay, Shannon; Moore, Katherine; Wallin, Lars

2007-01-01

Background There has been considerable interest recently in developing and evaluating interventions to increase research use by clinicians. However, most work has focused on medical practices; and nursing is not well represented in existing systematic reviews. The purpose of this article is to report findings from a systematic review of interventions aimed at increasing research use in nursing. Objective To assess the evidence on interventions aimed at increasing research use in nursing. Methods A systematic review of research use in nursing was conducted using databases (Medline, CINAHL, Healthstar, ERIC, Cochrane Central Register of Controlled Trials, and Psychinfo), grey literature, ancestry searching (Cochrane Database of Systematic Reviews), key informants, and manual searching of journals. Randomized controlled trials and controlled before- and after-studies were included if they included nurses, if the intervention was explicitly aimed at increasing research use or evidence-based practice, and if there was an explicit outcome to research use. Methodological quality was assessed using pre-existing tools. Data on interventions and outcomes were extracted and categorized using a pre-established taxonomy. Results Over 8,000 titles were screened. Three randomized controlled trials and one controlled before- and after-study met the inclusion criteria. The methodological quality of included studies was generally low. Three investigators evaluated single interventions. The most common intervention was education. Investigators measured research use using a combination of surveys (three studies) and compliance with guidelines (one study). Researcher-led educational meetings were ineffective in two studies. Educational meetings led by a local opinion leader (one study) and the formation of multidisciplinary committees (one study) were both effective at increasing research use. Conclusion Little is known about how to increase research use in nursing, and the evidence to support or refute specific interventions is inconclusive. To advance the field, we recommend that investigators: (1) use theoretically informed interventions to increase research use, (2) measure research use longitudinally using theoretically informed and psychometrically sound measures of research use, as well as, measuring patient outcomes relevant to the intervention, and (3) use more robust and methodologically sound study designs to evaluate interventions. If investigators aim to establish a link between using research and improved patient outcomes they must first identify those interventions that are effective at increasing research use. PMID:17498301

Exploring academics' views on designs, methods, characteristics and outcomes of inclusive health research with people with intellectual disabilities: a modified Delphi study.

PubMed

Frankena, T K; Naaldenberg, J; Cardol, M; Meijering, J V; Leusink, G; van Schrojenstein Lantman-de Valk, H M J

2016-08-18

The British Medical Journal's (BMJ's) patient revolution strives for collaboration with patients in healthcare and health research. This paper studies collaboration with people with intellectual disabilities (ID) in health research, also known as inclusive health research. Currently, transparency and agreement among academics is lacking regarding its main aspects, preventing upscaling of the patient revolution. This study aims to gain agreement among academics on 3 aspects of inclusive health research for people with ID: (1) designs and methods, (2) most important characteristics and (3) outcomes. A Delphi study was conducted with academics with experience in inclusive (health) research and on people with ID. The study consisted of 2 sequential questionnaire rounds (n=24; n=17), followed by in-depth interviews (n=10). Academics agreed on (1) a collaborative approach to be most suitable to inclusive health research, (2) characteristics regarding the accessibility and facilitation of inclusive health research, and (3) several outcomes of inclusive health research for people with ID and healthcare. Other characteristics agreed on included: atmosphere, relationship, engagement, partnership and power. It was stressed that these characteristics ensure meaningful inclusion. Interviewed academics voiced the need for a tool supporting the facilitation and evaluation of inclusive health research. There was ambiguity as to what this tool should comprise and the extent to which it was possible to capture the complex process of inclusive health research. This study underlines the need for transparency, facilitation and evaluation of inclusive health research. The need for in-depth interviews after 2 Delphi rounds underlines its complexity and context dependence. To increase process transparency, future research should focus on gaining insight into inclusive health research in its context. A tool could be developed to facilitate and evaluate inclusive health research. This tool will be partially applicable to participatory research in general and thereby upscale the patient revolution. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Research on uncertainty evaluation measure and method of voltage sag severity

NASA Astrophysics Data System (ADS)

Liu, X. N.; Wei, J.; Ye, S. Y.; Chen, B.; Long, C.

2018-01-01

Voltage sag is an inevitable serious problem of power quality in power system. This paper focuses on a general summarization and reviews on the concepts, indices and evaluation methods about voltage sag severity. Considering the complexity and uncertainty of influencing factors, damage degree, the characteristics and requirements of voltage sag severity in the power source-network-load sides, the measure concepts and their existing conditions, evaluation indices and methods of voltage sag severity have been analyzed. Current evaluation techniques, such as stochastic theory, fuzzy logic, as well as their fusion, are reviewed in detail. An index system about voltage sag severity is provided for comprehensive study. The main aim of this paper is to propose thought and method of severity research based on advanced uncertainty theory and uncertainty measure. This study may be considered as a valuable guide for researchers who are interested in the domain of voltage sag severity.

What are the barriers and facilitators for third sector organisations (non-profits) to evaluate their services? A systematic review.

PubMed

Bach-Mortensen, Anders Malthe; Montgomery, Paul

2018-01-22

The third sector is becoming a more common provider of social and health services, but little is known about how third sector organisations (TSOs) evaluate their activities. Past research has reported that the third sector is under increasing pressure to evaluate its impact and performance by government and other commissioning bodies. However, in responding to this increased pressure to undertake evaluation, research suggests that many TSOs struggle to evaluate their activities following the principles of evidence-based practice (EBP). Yet, there has been no systematic effort to investigate why the third sector is struggling to provide good quality evidence of its effects. This systematic review is reported following the PRISMA guidelines. Ten interdisciplinary databases were searched using a search string developed following best practice and in consultation with an information systems expert. Included studies were primary research of any research design investigating barriers to and facilitators of the evaluation process of TSOs as identified by practitioners. All studies were quality appraised, and the results were synthesised as a thematic summary. Twenty-four studies were included, which mainly investigated TSOs working within health and social services. The thematic summary identified the main barriers for TSOs to undertake evaluation to be related to the (1) lack of financial resources, (2) lack of technical capability and evaluation literacy and (3) challenges around identifying relevant evaluation systems and outcome indicators. Key facilitating factors involved (1) getting the appropriate support, (2) having an organisational culture that supports evaluation and (3) the motivation to be accountable to stakeholders. These findings were robust to study quality. This review constitutes the first systematic effort to synthesise existing literature on factors supporting and preventing evaluation by TSOs. The prevalence of factors revolving around the lack of support, resources and clarity on appropriate outcome indicators suggests that many of the identified challenges may be met by applying evidence-based and stakeholder-inclusive strategies to develop shared evaluation requirements. Future efforts should address the application of EBP as part of the commissioning process of TSOs.

Redesigning Teacher Evaluation: Lessons Learned from a Pilot Implementation in New Hampshire

ERIC Educational Resources Information Center

Riordan, Julie; Lacireno-Paquet, Natalie; Shakman, Karen; Bocala, Candice

2016-01-01

Many studies have called attention to the limitations of current teacher evaluation systems and the need for reform nationwide. This study addresses three research questions: (1) What are the features of the new teacher evaluation systems in New Hampshire's districts with SIG schools?; (2) To what extent did schools implement the evaluation system…

Management systems research study

NASA Technical Reports Server (NTRS)

Bruno, A. V.

1975-01-01

The development of a Monte Carlo simulation of procurement activities at the NASA Ames Research Center is described. Data cover: simulation of the procurement cycle, construction of a performance evaluation model, examination of employee development, procedures and review of evaluation criteria for divisional and individual performance evaluation. Determination of the influences and apparent impact of contract type and structure and development of a management control system for planning and controlling manpower requirements.

Research, science and technology parks: A global comparison of best practices

NASA Astrophysics Data System (ADS)

Ruiz Villacres, Hugo D.

The purpose of this study was to determine if significant differences exist in the evaluation of effectiveness and efficiency between North American, European, and Asian research parks (RPs). Park directors and staff responded to 25 questions from the Survey for Research, Science and Technology Parks. Effectiveness was measured by director's perception of the RP's contribution to economic growth and job creation. Efficiency was evaluated by the interactions between local universities and research parks, assessment of the ecosystem's basic characteristics, and the culture of innovation in the ecosystem. A stratified sampling procedure from a population of 793 parks was used; analysis of variance (ANOVA) and multivariate analysis of variance (MANOVA) were used to test for significance. 130 RPs from three continents participated in this study. No significant differences were found in the evaluation of RPs' directors on effectiveness and efficiency of RPs.

The importance of assessing for validity of symptom report and performance in attention deficit/hyperactivity disorder (ADHD): Introduction to the special section on noncredible presentation in ADHD.

PubMed

Suhr, Julie A; Berry, David T R

2017-12-01

Invalid self-report and invalid performance occur with high base rates in attention deficit/hyperactivity disorder (ADHD; Harrison, 2006; Musso & Gouvier, 2014). Although much research has focused on the development and validation of symptom validity tests (SVTs) and performance validity tests (PVTs) for psychiatric and neurological presentations, less attention has been given to the use of SVTs and PVTs in ADHD evaluation. This introduction to the special section describes a series of studies examining the use of SVTs and PVTs in adult ADHD evaluation. We present the series of studies in the context of prior research on noncredible presentation and call for future research using improved research methods and with a focus on assessment issues specific to ADHD evaluation. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Collaborative research to prevent HIV among male prison inmates and their female partners.

PubMed

Grinstead, O A; Zack, B; Faigeles, B

1999-04-01

Despite the need for targeted HIV prevention interventions for prison inmates, institutional and access barriers have impeded development and evaluation of such programs. Over the past 6 years, the authors have developed a unique collaborative relationship to develop and evaluate HIV prevention interventions for prison inmates. The collaboration includes an academic research institution (the Center for AIDS Prevention Studies at the University of California, San Francisco), a community-based organization (Centerforce), and the staff and inmate peer educators inside a state prison. In this ongoing collaboration, the authors have developed and evaluated a series of HIV prevention interventions for prison inmates and for women who visit prison inmates. Results of these studies support the feasibility and effectiveness of HIV prevention programs for inmates and their partners both in prison and in the community. Access and institutional barriers to HIV intervention research in prisons can be overcome through the development of collaborative research partnerships.

Evaluating Army Aviation’s Force Structure to Support an Operational Reserve Force

DTIC Science & Technology

2011-03-21

partial fulfillment of the requirements of the Master of Strategic Studies Degree. The views expressed in this student academic research paper are...Higher Education Accreditation. The views expressed in this student academic research paper are those of the author and do not reflect the official...Strategy Research Project 3. DATES COVERED (From - To) 4. TITLE AND SUBTITLE Evaluating Army Aviation’s Force Structure to Support an

Developing Guidelines for Assessing Visual Analytics Environments

DOE Office of Scientific and Technical Information (OSTI.GOV)

Scholtz, Jean

2011-07-01

In this paper, we develop guidelines for evaluating visual analytic environments based on a synthesis of reviews for the entries to the 2009 Visual Analytics Science and Technology (VAST) Symposium Challenge and from a user study with professional intelligence analysts. By analyzing the 2009 VAST Challenge reviews we gained a better understanding of what is important to our reviewers, both visualization researchers and professional analysts. We also report on a small user study with professional analysts to determine the important factors that they use in evaluating visual analysis systems. We then looked at guidelines developed by researchers in various domainsmore » and synthesized these into an initial set for use by others in the community. In a second part of the user study, we looked at guidelines for a new aspect of visual analytic systems – the generation of reports. Future visual analytic systems have been challenged to help analysts generate their reports. In our study we worked with analysts to understand the criteria they used to evaluate the quality of analytic reports. We propose that this knowledge will be useful as researchers look at systems to automate some of the report generation.1 Based on these efforts, we produced some initial guidelines for evaluating visual analytic environment and for evaluation of analytic reports. It is important to understand that these guidelines are initial drafts and are limited in scope because of the type of tasks for which the visual analytic systems used in the studies in this paper were designed. More research and refinement is needed by the Visual Analytics Community to provide additional evaluation guidelines for different types of visual analytic environments.« less

Development and pilot testing of an online module for ethics education based on the Nigerian National Code for Health Research Ethics

PubMed Central

2013-01-01

Background The formulation and implementation of national ethical regulations to protect research participants is fundamental to ethical conduct of research. Ethics education and capacity are inadequate in developing African countries. This study was designed to develop a module for online training in research ethics based on the Nigerian National Code of Health Research Ethics and assess its ease of use and reliability among biomedical researchers in Nigeria. Methodology This was a three-phased evaluation study. Phase one involved development of an online training module based on the Nigerian Code of Health Research Ethics (NCHRE) and uploading it to the Collaborative Institutional Training Initiative (CITI) website while the second phase entailed the evaluation of the module for comprehensibility, readability and ease of use by 45 Nigerian biomedical researchers. The third phase involved modification and re-evaluation of the module by 30 Nigerian biomedical researchers and determination of test-retest reliability of the module using Cronbach’s alpha. Results The online module was easily accessible and comprehensible to 95% of study participants. There were significant differences in the pretest and posttest scores of study participants during the evaluation of the online module (p = 0.001) with correlation coefficients of 0.9 and 0.8 for the pretest and posttest scores respectively. The module also demonstrated excellent test-retest reliability and internal consistency as shown by Cronbach’s alpha coefficients of 0.92 and 0.84 for the pretest and posttest respectively. Conclusion The module based on the Nigerian Code was developed, tested and made available online as a valuable tool for training in cultural and societal relevant ethical principles to orient national and international biomedical researchers working in Nigeria. It would complement other general research ethics and Good Clinical Practice modules. Participants suggested that awareness of the online module should be increased through seminars, advertisement on government websites and portals used by Nigerian biomedical researchers, and incorporation of the Code into the undergraduate medical training curriculum. PMID:23281968

77 FR 12641 - Privacy Act of 1974; System of Records Notice

Federal Register 2010, 2011, 2012, 2013, 2014

2012-03-01

... research study in order to contact that individual, or to retrieve property at the end of the study... of 1974; System of Records Notice AGENCY: Research and Innovative Technology Administration's (RITA... titled Vehicle and Driver Research, Test, and Evaluation Records. This system [[Page 12642

Investigating Primary Source Literacy

ERIC Educational Resources Information Center

Archer, Joanne; Hanlon, Ann M.; Levine, Jennie A.

2009-01-01

Primary source research requires students to acquire specialized research skills. This paper presents results from a user study testing the effectiveness of a Web guide designed to convey the concepts behind "primary source literacy". The study also evaluated students' strengths and weaknesses when conducting primary source research. (Contains 3…

Social media as an open-learning resource in medical education: current perspectives.

PubMed

Sutherland, S; Jalali, A

2017-01-01

Numerous studies evaluate the use of social media as an open-learning resource in education, but there is a little published knowledge of empirical evidence that such open-learning resources produce educative outcomes, particularly with regard to student performance. This study undertook a systematic review of the published literature in medical education to determine the state of the evidence as to empirical studies that conduct an evaluation or research regarding social media and open-learning resources. The authors searched MEDLINE, ERIC, Embase, PubMed, Scopus, and Google Scholar from 2012 to 2017. This search included using keywords related to social media, medical education, research, and evaluation, while restricting the search to peer reviewed, English language articles only. To meet inclusion criteria, manuscripts had to employ evaluative methods and undertake empirical research. Empirical work designed to evaluate the impact of social media as an open-learning resource in medical education is limited as only 13 studies met inclusion criteria. The majority of these studies used undergraduate medical education as the backdrop to investigate open-learning resources, such as Facebook, Twitter, and YouTube. YouTube appears to have little educational value due to the unsupervised nature of content added on a daily basis. Overall, extant reviews have demonstrated that we know a considerable amount about social media use, although to date, its impacts remain unclear. There is a paucity of outcome-based, empirical studies assessing the impact of social media in medical education. The few empirical studies identified tend to focus on evaluating the affective outcomes of social media and medical education as opposed to understanding any linkages between social media and performance outcomes. Given the potential for social media use in medical education, more empirical evaluative studies are required to determine educational value.

Research on evaluation methods for water regulation ability of dams in the Huai River Basin

NASA Astrophysics Data System (ADS)

Shan, G. H.; Lv, S. F.; Ma, K.

2016-08-01

Water environment protection is a global and urgent problem that requires correct and precise evaluation. Evaluation methods have been studied for many years; however, there is a lack of research on the methods of assessing the water regulation ability of dams. Currently, evaluating the ability of dams has become a practical and significant research orientation because of the global water crisis, and the lack of effective ways to manage a dam's regulation ability has only compounded this. This paper firstly constructs seven evaluation factors and then develops two evaluation approaches to implement the factors according to the features of the problem. Dams of the Yin Shang ecological control section in the Huai He River basin are selected as an example to demonstrate the method. The results show that the evaluation approaches can produce better and more practical suggestions for dam managers.

Documenting Evaluation Use: Guided Evaluation Decisionmaking. Evaluation Productivity Project.

ERIC Educational Resources Information Center

Burry, James

This paper documents the evaluation use process among districts using the Guide for Evaluation Decision Makers, published by the Center for the Study of Evaluation (CSE) during the 1984-85 school year. Included are the following: (1) a discussion of research that led to conclusions concerning the administrator's role in evaluation use; (2) a…

Toward Better Research on--and Thinking about--Evaluation Influence, Especially in Multisite Evaluations

ERIC Educational Resources Information Center

Mark, Melvin M.

2011-01-01

Evaluation is typically carried out with the intention of making a difference in the understandings and actions of stakeholders and decision makers. The author provides a general review of the concepts of evaluation "use," evaluation "influence," and "influence pathways," with connections to multisite evaluations. The study of evaluation influence…

Does sunshine prime loyal … or summer? Effects of associative relatedness on the evaluative priming effect in the valent/neutral categorisation task.

PubMed

Werner, Benedikt; von Ramin, Elisabeth; Spruyt, Adriaan; Rothermund, Klaus

2018-02-01

After 30 years of research, the mechanisms underlying the evaluative priming effect are still a topic of debate. In this study, we tested whether the evaluative priming effect can result from (uncontrolled) associative relatedness rather than evaluative congruency. Stimuli that share the same evaluative connotation are more likely to show some degree of non-evaluative associative relatedness than stimuli that have a different evaluative connotation. Therefore, unless associative relatedness is explicitly controlled for, evaluative priming effects reported in earlier research may be driven by associative relatedness instead of evaluative relatedness. To address this possibility, we performed an evaluative priming study in which evaluative congruency and associative relatedness were manipulated independently from each other. The valent/neutral categorisation task was used to ensure evaluative stimulus processing in the absence of response priming effects. Results showed an effect of associative relatedness but no (overall) effect of evaluative congruency. Our findings highlight the importance of controlling for associative relatedness when testing for evaluative priming effects.

Life sciences payload definition and integration study. Volume 2: Requirements, design, and planning studies for the carry-on laboratories. [for Spacelab

NASA Technical Reports Server (NTRS)

1974-01-01

The task phase concerned with the requirements, design, and planning studies for the carry-on laboratory (COL) began with a definition of biomedical research areas and candidate research equipment, and then went on to develop conceptual layouts for COL which were each evaluated in order to arrive at a final conceptual design. Each step in this design/evaluation process concerned itself with man/systems integration research and hardware, and life support and protective systems research and equipment selection. COL integration studies were also conducted and include attention to electrical power and data management requirements, operational considerations, and shuttle/Spacelab interface specifications. A COL program schedule was compiled, and a cost analysis was finalized which takes into account work breakdown, annual funding, and cost reduction guidelines.

Integrating knowledge generation with knowledge diffusion and utilization: a case study analysis of the Consortium for Applied Research and Evaluation in Mental Health.

PubMed

Vingilis, Evelyn; Hartford, Kathleen; Schrecker, Ted; Mitchell, Beth; Lent, Barbara; Bishop, Joan

2003-01-01

Knowledge diffusion and utilization (KDU) have become a key focus in the health research community because of the limited success to date of research findings to inform health policies, programs and services. Yet, evidence indicates that successful KDU is often predicated on the early involvement of potential knowledge users in the conceptualization and conduct of the research and on the development of a "partnership culture". This study describes the integration of KDU theory with practice via a case study analysis of the Consortium for Applied Research and Evaluation in Mental Health (CAREMH). This qualitative study, using a single-case design, included a number of data sources: proposals, meeting minutes, presentations, publications, reports and curricula vitae of CAREMH members. CAREMH has adopted the following operational strategies to increase KDU capacity: 1) viewing research as a means and not as an end; 2) bringing the university and researcher to the community; 3) using participatory research methods; 4) embracing transdisciplinary research and interactions; and 5) using connectors. Examples of the iterative process between researchers and potential knowledge users in their contribution to knowledge generation, diffusion and utilization are provided. This case study supports the importance of early and ongoing involvement of relevant potential knowledge users in research to enhance its utilization potential. It also highlights the need for re-thinking research funding approaches.

ACT-CCREC Core Research Program: Study Questions and Design. ACT Working Paper Series. WP-2015-01

ERIC Educational Resources Information Center

Cruce, Ty M.

2015-01-01

This report provides a non-technical overview of the guiding research questions and research design for the ACT-led core research program conducted on behalf of the GEAR UP College and Career Readiness Evaluation Consortium (CCREC). The core research program is a longitudinal study of the effectiveness of 14 GEAR UP state grants on the academic…

Research Capacity Building: A Historically Black College/University-Based Case Study of a Peer-to-Peer Mentor Research Team Model

ERIC Educational Resources Information Center

Moore, Corey L.; Manyibe, Edward O.; Aref, Fariborz; Washington, Andre L.

2017-01-01

Purpose: To evaluate a peer-to-peer mentor research team model (PPMRTM) in building investigators' research skills (i.e., research methods and grant writing) at a historically Black college/university (HBCU) in the United States. Method: Three different theories (i.e., planned change, critical mass, and self-efficacy), contemporary study findings,…

Economic analysis of centralized vs. decentralized electronic data capture in multi-center clinical studies.

PubMed

Walden, Anita; Nahm, Meredith; Barnett, M Edwina; Conde, Jose G; Dent, Andrew; Fadiel, Ahmed; Perry, Theresa; Tolk, Chris; Tcheng, James E; Eisenstein, Eric L

2011-01-01

New data management models are emerging in multi-center clinical studies. We evaluated the incremental costs associated with decentralized vs. centralized models. We developed clinical research network economic models to evaluate three data management models: centralized, decentralized with local software, and decentralized with shared database. Descriptive information from three clinical research studies served as inputs for these models. The primary outcome was total data management costs. Secondary outcomes included: data management costs for sites, local data centers, and central coordinating centers. Both decentralized models were more costly than the centralized model for each clinical research study: the decentralized with local software model was the most expensive. Decreasing the number of local data centers and case book pages reduced cost differentials between models. Decentralized vs. centralized data management in multi-center clinical research studies is associated with increases in data management costs.

Economic Analysis of Centralized vs. Decentralized Electronic Data Capture in Multi-Center Clinical Studies

PubMed Central

Walden, Anita; Nahm, Meredith; Barnett, M. Edwina; Conde, Jose G.; Dent, Andrew; Fadiel, Ahmed; Perry, Theresa; Tolk, Chris; Tcheng, James E.; Eisenstein, Eric L.

2012-01-01

Background New data management models are emerging in multi-center clinical studies. We evaluated the incremental costs associated with decentralized vs. centralized models. Methods We developed clinical research network economic models to evaluate three data management models: centralized, decentralized with local software, and decentralized with shared database. Descriptive information from three clinical research studies served as inputs for these models. Main Outcome Measures The primary outcome was total data management costs. Secondary outcomes included: data management costs for sites, local data centers, and central coordinating centers. Results Both decentralized models were more costly than the centralized model for each clinical research study: the decentralized with local software model was the most expensive. Decreasing the number of local data centers and case book pages reduced cost differentials between models. Conclusion Decentralized vs. centralized data management in multi-center clinical research studies is associated with increases in data management costs. PMID:21335692

Measurement and Design Issues in the Study of Adolescent Sexual Behavior and the Evaluation of Adolescent Sexual Health Behavior Interventions

ERIC Educational Resources Information Center

Young, Michael; Palacios, Rebecca; Penhollow, Tina M.

2012-01-01

To improve the quality of research and commentary concerning adolescent sexuality and evaluation of both comprehensive sexuality education and abstinence education programs, this article aims to help readers (1) select appropriate measures to study adolescent sexual behavior, (2) develop appropriate study designs to evaluate adolescent sexual…

A Qualitative Evaluation of the Use of Multimedia Case Studies in an Introductory Engineering Course at Two Southeastern Universities

ERIC Educational Resources Information Center

Huett, Kim C.; Kawulich, Barbara

2015-01-01

Collaborating at two universities to improve teaching and learning in undergraduate engineering, an interdisciplinary team of researchers, instructors, and evaluators planned and implemented the use of multimedia case studies with students enrolled in an introductory engineering course. This qualitative action evaluation study focuses on results…

Planting Healthy Roots: Using Documentary Film to Evaluate and Disseminate Community-Based Participatory Research

PubMed Central

Brandt, Heather M.; Freedman, Darcy A.; Friedman, Daniela B.; Choi, Seul Ki; Seel, Jessica S.; Guest, M. Aaron; Khang, Leepao

2016-01-01

The study purpose was twofold: (1) to evaluate a documentary film featuring the formation and implementation of a farmers’ market and (2) to assess whether the film affected awareness regarding food access issues in a food desert community with high rates of obesity. The coalition model of filmmaking, a model consistent with a community-based participatory research (CBPR) approach, and personal stories, community profiles, and expert interviews were used to develop a documentary film (Planting Healthy Roots). Evaluation demonstrated high levels of approval and satisfaction with the film and CBPR essence of the film. The documentary film aligned with a CBPR approach to document, evaluate, and disseminate research processes and outcomes. PMID:27536929

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency.

PubMed

Shepherd, Jonathan; Frampton, Geoff K; Pickett, Karen; Wyatt, Jeremy C

2018-01-01

To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review 'innovations'. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality.

The Problem of Evaluative Categorization of Human Intelligence in Linguistic World Images

ERIC Educational Resources Information Center

Abisheva, Klara M.; Dossanova, Altynay Zh.; Ismakova, Bibissara S.; Aupova, Gulbagira K.; Ayapbergenov, Bulat K.; Tlegenova, Kulyan A.

2016-01-01

The aim of the research is to determine the peculiarities of the evaluative categorization of human intelligence in linguistic world images. The study describes the interdisciplinary approach to studying evaluative categorization, which assumes the use of complex methodology including the anthropocentric, the interdisciplinary, and the cognitive…

Evaluation of Training Programs for Rural Development

ERIC Educational Resources Information Center

Indira, A.

2008-01-01

An Evaluation of the "Impact Assessment of the Training Programs" of a National Level Training Institution in India was conducted using the Kirkpatrick Method (KP Method). The studied Institution takes up research, provides training, offers consultancy and initiates action in the rural sector of India. The evaluation study used a…

Escaping the Dusty Shelf: Legislative Evaluation Offices' Efforts to Promote Utilization

ERIC Educational Resources Information Center

Vanlandingham, Gary R.

2011-01-01

Although scholars have proposed many steps to increase evaluation use, there has been little comparative empirical study of whether researchers follow these recommendations and whether specific steps are associated with greater utilization. This study of state legislative evaluators finds that those that regularly meet with stakeholders and…

Research on Evaluation and Control of Karst Water Resources in a Certain Tunnel of Dalian Subway

NASA Astrophysics Data System (ADS)

Wang, Guang Qiang

2018-05-01

Taking a certain tunnel in Dalian Metro as the research object, to evaluate the situation of karst development through geophysical prospecting and drilling data in study area. Karst water resources can be evaluated by quality and quantity in the study area, the correlation of the ion content can be analyzed according to the analysis results of chemical composition of groundwater and the maximum water inflow in karst water section tunnel can be calculated by using the Oshima Yoshi formula. Put forward measures and methods of groundwater control and tube well dewatering based on these evaluation, it has certain guiding significance for tunnel construction in karst area.

Challenges in evaluating surgical innovation.

PubMed

Ergina, Patrick L; Cook, Jonathan A; Blazeby, Jane M; Boutron, Isabelle; Clavien, Pierre-Alain; Reeves, Barnaby C; Seiler, Christoph M; Altman, Douglas G; Aronson, Jeffrey K; Barkun, Jeffrey S; Campbell, W Bruce; Cook, Jonathan A; Feldman, Liane S; Flum, David R; Glasziou, Paul; Maddern, Guy J; Marshall, John C; McCulloch, Peter; Nicholl, Jon; Strasberg, Steven M; Meakins, Jonathan L; Ashby, Deborah; Black, Nick; Bunker, John; Burton, Martin; Campbell, Marion; Chalkidou, Kalipso; Chalmers, Iain; de Leval, Marc; Deeks, Jon; Grant, Adrian; Gray, Muir; Greenhalgh, Roger; Jenicek, Milos; Kehoe, Sean; Lilford, Richard; Littlejohns, Peter; Loke, Yoon; Madhock, Rajan; McPherson, Kim; Rothwell, Peter; Summerskill, Bill; Taggart, David; Tekkis, Parris; Thompson, Matthew; Treasure, Tom; Trohler, Ulrich; Vandenbroucke, Jan

2009-09-26

Research on surgical interventions is associated with several methodological and practical challenges of which few, if any, apply only to surgery. However, surgical evaluation is especially demanding because many of these challenges coincide. In this report, the second of three on surgical innovation and evaluation, we discuss obstacles related to the study design of randomised controlled trials and non-randomised studies assessing surgical interventions. We also describe the issues related to the nature of surgical procedures-for example, their complexity, surgeon-related factors, and the range of outcomes. Although difficult, surgical evaluation is achievable and necessary. Solutions tailored to surgical research and a framework for generating evidence on which to base surgical practice are essential.

A 5-year scientometric analysis of research centers affiliated to Tehran University of Medical Sciences

PubMed Central

Yazdani, Kamran; Rahimi-Movaghar, Afarin; Nedjat, Saharnaz; Ghalichi, Leila; Khalili, Malahat

2015-01-01

Background: Since Tehran University of Medical Sciences (TUMS) has the oldest and highest number of research centers among all Iranian medical universities, this study was conducted to evaluate scientific output of research centers affiliated to Tehran University of Medical Sciences (TUMS) using scientometric indices and the affecting factors. Moreover, a number of scientometric indicators were introduced. Methods: This cross-sectional study was performed to evaluate a 5-year scientific performance of research centers of TUMS. Data were collected through questionnaires, annual evaluation reports of the Ministry of Health, and also from Scopus database. We used appropriate measures of central tendency and variation for descriptive analyses. Moreover, uni-and multi-variable linear regression were used to evaluate the effect of independent factors on the scientific output of the centers. Results: The medians of the numbers of papers and books during a 5-year period were 150.5 and 2.5 respectively. The median of the "articles per researcher" was 19.1. Based on multiple linear regression, younger age centers (p=0.001), having a separate budget line (p=0.016), and number of research personnel (p<0.001) had a direct significant correlation with the number of articles while real properties had a reverse significant correlation with it (p=0.004). Conclusion: The results can help policy makers and research managers to allocate sufficient resources to improve current situation of the centers. Newly adopted and effective scientometric indices are is suggested to be used to evaluate scientific outputs and functions of these centers. PMID:26157724

An Evaluation of h-Index as a Measure of Research Productivity Among Canadian Academic Plastic Surgeons.

PubMed

Hu, Jiayi; Gholami, Arian; Stone, Nicholas; Bartoszko, Justyna; Thoma, Achilleas

2018-02-01

Evaluation of research productivity among plastic surgeons can be complex. The Hirsch index (h-index) was recently introduced to evaluate both the quality and quantity of one's research activity. It has been proposed to be valuable in assessing promotions and grant funding within academic medicine, including plastic surgery. Our objective is to evaluate research productivity among Canadian academic plastic surgeons using the h-index. A list of Canadian academic plastic surgeons was obtained from websites of academic training programs. The h-index was retrieved using the Scopus database. Relevant demographic and academic factors were collected and their effects on the h-index were analyzed using the t test and Wilcoxon Mann-Whitney U test. Nominal and categorical variables were analyzed using χ 2 test and 1-way analysis of variance. Univariate and multivariate models were built a priori. All P values were 2 sided, and P < .05 was considered to be significant. Our study on Canadian plastic surgeons involved 175 surgeons with an average h-index of 7.6. Over 80% of the surgeons were male. Both univariable and multivariable analysis showed that graduate degree ( P < .0001), academic rank ( P = .03), and years in practice ( P < .0001) were positively correlated with h-index. Limitations of the study include that the Scopus database and the websites of training programs were not always up-to-date. The h-index is a novel tool for evaluating research productivity in academic medicine, and this study shows that the h-index can also serve as a useful metric for measuring research productivity in the Canadian plastic surgery community. Plastic surgeons would be wise to familiarize themselves with the h-index concept and should consider using it as an adjunct to existing metrics such as total publication number.

Appraising Qualitative Research in Health Education: Guidelines for Public Health Educators

PubMed Central

Jeanfreau, Scharalda G.; Jack, Leonard

2010-01-01

Research studies, including qualitative studies, form the basis for evidence-based practice among health professionals. However, many practicing health educators do not feel fully confident in their ability to critically appraise qualitative research studies. This publication presents an overview of qualitative research approaches, defines key terminology used in qualitative research, and provides guidelines for appraising the strengths and weaknesses of published qualitative research. On reading, health educators will be better equipped to evaluate the quality of the evidence through critical appraisals of qualitative research publications. PMID:20817630

A Systematic Review of Economic Evaluation Methodologies Between Resource-Limited and Resource-Rich Countries: A Case of Rotavirus Vaccines.

PubMed

Thiboonboon, Kittiphong; Santatiwongchai, Benjarin; Chantarastapornchit, Varit; Rattanavipapong, Waranya; Teerawattananon, Yot

2016-12-01

For more than three decades, the number and influence of economic evaluations of healthcare interventions have been increasing and gaining attention from a policy level. However, concerns about the credibility of these studies exist, particularly in studies from low- and middle- income countries (LMICs). This analysis was performed to explore economic evaluations conducted in LMICs in terms of methodological variations, quality of reporting and evidence used for the analyses. These results were compared with those studies conducted in high-income countries (HICs). Rotavirus vaccine was selected as a case study, as it is one of the interventions that many studies in both settings have explored. The search to identify individual studies on rotavirus vaccines was performed in March 2014 using MEDLINE and the National Health Service Economic Evaluation Database. Only full economic evaluations, comparing cost and outcomes of at least two alternatives, were included for review. Selected criteria were applied to assess methodological variation, quality of reporting and quality of evidence used. Eighty-five studies were included, consisting of 45 studies in HICs and 40 studies in LMICs. Seventy-five percent of the studies in LMICs were published by researchers from HICs. Compared with studies in HICs, the LMIC studies showed less methodological variety. In terms of the quality of reporting, LMICs had a high adherence to technical criteria, but HICs ultimately proved to be better. The same trend applied for the quality of evidence used. Although the quality of economic evaluations in LMICs was not as high as those from HICs, it is of an acceptable level given several limitations that exist in these settings. However, the results of this study may not reflect the fact that LMICs have developed a better research capacity in the domain of health economics, given that most of the studies were in theory led by researchers from HICs. Putting more effort into fostering the development of both research infrastructure and capacity building as well as encouraging local engagement in LMICs is thus necessary.

Effective Use of Audio Media in Multimedia Presentations.

ERIC Educational Resources Information Center

Kerr, Brenda

This paper emphasizes research-based reasons for adding audio to multimedia presentations. The first section summarizes suggestions from a review of research on the effectiveness of audio media when accompanied by other forms of media; types of research studies (e.g., evaluation, intra-medium, and aptitude treatment interaction studies) are also…

Action Research Approach on Mobile Learning Design for the Underserved

ERIC Educational Resources Information Center

Kim, Paul H.

2009-01-01

This paper discusses an action research study focused on developing a mobile learning model of literacy development for underserved migrant indigenous children in Latin America. The research study incorporated a cyclical action model with four distinctive stages (Strategize, Apply, Evaluate, and Reflect) designed to guide constituencies involved…

INTERNATIONAL STUDY OF ACHIEVEMENT IN MATHEMATICS, A COMPARISON OF TWELVE COUNTRIES, VOLUME I.

ERIC Educational Resources Information Center

HUSEN, TORSTEN; AND OTHERS

THIS REPORT OF AN INTERNATIONAL RESEARCH ALLIANCE OF TWELVE COUNTRIES EXPLAINS THE ESTABLISHMENT OF PROCEDURES OF RESEARCH AND QUANTITATIVE ASSESSMENT FOR THE COMPARATIVE STUDY OF EDUCATION THROUGHOUT THE WORLD. RESEARCH INSTITUTES FROM TWELVE COUNTRIES ORGANIZED THE COUNCIL OF THE INTERNATIONAL PROJECT FOR THE EVALUATION OF EDUCATIONAL…

How Well Do Researchers Report Their Measures? An Evaluation of Measurement in Published Educational Research.

ERIC Educational Resources Information Center

Whittington, Dale

1998-01-01

This study describes how much and in what ways authors of research studies fail to include adequate information about data collection. Results based on analysis of 220 articles from 22 journals show that the quality of measurement reporting continues to be a problem. (SLD)

An Evaluative and Prescriptive Look at Graphics Research.

ERIC Educational Resources Information Center

Soderston, Candace

Graphics research history shows that some topics have been studied heavily while others have been almost entirely neglected. Furthermore, researchers have used many different methods of defining and measuring effects such as legibility and comprehension, and this, together with vagueness in reporting, makes it difficult to compare studies and draw…

Evaluation of the work of hospital districts' research ethics committees in Finland.

PubMed

Halila, Ritva

2014-12-01

The main task of research ethics committees (RECs) is to assess research studies before their start. In this study, 24 RECs that evaluate medical research were sent questionnaires about their structure and functions. The RECs were divided into two separate groups: those working in university hospital districts (uRECs) and those in central hospital districts (non-uRECs). The two groups were different in many respects: the uRECs were bigger in size, covered a wider range of disciplines (both medical and non-medical), had better resources and more frequent and regular meetings. After the survey was performed and analysed, the Medical Research Act was amended so that only hospital districts with a medical faculty in their region had a duty to establish ethics committees. After the amendment, the number of RECs evaluating medical research in Finland decreased from 25 to 9. The ethics committees that remained had wider expertise and were better equipped already by the time of this survey. Only one non-uREC was continuing its work, and this was being done under the governance of a university hospital district. Simple measures were used for qualitative analysis of the work of RECs that evaluate medical research. These showed differences between RECs. This may be helpful in establishing an ethics committee network in a research field or administrational area. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Evaluating Educational Programmes: The Need and the Response.

ERIC Educational Resources Information Center

Stake, Robert E.

This survey of recent developments in educational program evaluation is intended for persons who commission, implement, direct, or carry out evaluation studies. The attitudes of government officials, educators, and researchers toward assessment and their own evaluation needs are discussed. Various approaches to evaluation are briefly described;…

Mixed methods for telehealth research.

PubMed

Caffery, Liam J; Martin-Khan, Melinda; Wade, Victoria

2017-10-01

Mixed methods research is important to health services research because the integrated qualitative and quantitative investigation can give a more comprehensive understanding of complex interventions such as telehealth than can a single-method study. Further, mixed methods research is applicable to translational research and program evaluation. Study designs relevant to telehealth research are described and supported by examples. Quality assessment tools, frameworks to assist in the reporting and review of mixed methods research, and related methodologies are also discussed.

Evaluation methods used on health information systems (HISs) in Iran and the effects of HISs on Iranian healthcare: a systematic review.

PubMed

Ahmadian, Leila; Nejad, Simin Salehi; Khajouei, Reza

2015-06-01

The most important goal of a health information system (HIS) is improvement of quality, effectiveness and efficiency of health services. To achieve this goal, health care systems should be evaluated continuously. The aim of this paper was to study the impacts of HISs in Iran and the methods used for their evaluation. We systematically searched all English and Persian papers evaluating health information systems in Iran that were indexed in SID, Magiran, Iran medex, PubMed and Embase databases until June 2013. A data collection form was designed to extract required data such as types of systems evaluated, evaluation methods and tools. In this study, 53 out of 1103 retrieved articles were selected as relevant and reviewed by the authors. This study indicated that 28 studies used questionnaires to evaluate the system and in 27 studies the study instruments were distributed within a research population. In 26 papers the researchers collected the information by means of interviews, observations, heuristic evaluation and the review of documents and records. The main effects of the evaluated systems in health care settings were improving quality of services, reducing time, increasing accessibility to information, reducing costs and decreasing medical errors. Evaluation of health information systems is central to their development and enhancement, and to understanding their effect on health and health services. Despite numerous evaluation methods available, the reviewed studies used a limited number of methods to evaluate HIS. Additionally, the studies mainly discussed the positive effects of HIS on health care services. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Individual determinants of research utilization: a systematic review.

PubMed

Estabrooks, Carole A; Floyd, Judith A; Scott-Findlay, Shannon; O'Leary, Katherine A; Gushta, Matthew

2003-09-01

In order to design interventions that increase research use in nursing, it is necessary to have an understanding of what influences research use. To report findings on a systematic review of studies that examine individual characteristics of nurses and how they influence the utilization of research. A survey of published articles in English that examine the influence of individual factors on the research utilization behaviour of nurses, without restriction of the study design, from selected computerized databases and hand searches. Articles had to measure one or more individual determinants of research utilization, measure the dependent variable (research utilization), and evaluate the relationship between the dependent and independent variables. The studies also had to indicate the direction of the relationship between the independent and dependent variables, report a P-value and the statistic used, and indicate the magnitude of the relationship. Six categories of potential individual determinants were identified: beliefs and attitudes, involvement in research activities, information seeking, professional characteristics, education and other socio-economic factors. Research design, sampling, measurement, and statistical analysis were examined to evaluate methodological quality. Methodological problems surfaced in all of the studies and, apart from attitude to research, there was little to suggest that any potential individual determinant influences research use. Important conceptual and measurement issues with regard to research utilization could be better addressed if research in the area were undertaken longitudinally by multi-disciplinary teams of researchers.

An Illustrative Case Study of the Heuristic Practices of a High-Performing Research Department: Toward Building a Model Applicable in the Context of Large Urban Districts

ERIC Educational Resources Information Center

Munoz, Marco A.; Rodosky, Robert J.

2011-01-01

This case study provides an illustration of the heuristic practices of a high-performing research department, which in turn, will help build much needed models applicable in the context of large urban districts. This case study examines the accountability, planning, evaluation, testing, and research functions of a research department in a large…

[Sensitivity to change].

PubMed

Igl, W; Zwingmann, C; Faller, H

2005-04-01

In rehabilitation research patient questionnaires are widely used for evaluative purposes, i. e. to measure improvements or deteriorations over time. This is only possible if the questionnaires applied appropriately reflect "true" change over time, i. e. they have to be sensitive to change. The aim of this paper is to point out the importance of the "sensitivity to change" concept for evaluative assessment tools and evaluative studies, respectively, considering quality of life research as an example. Various qualitative aspects, e. g. scaling of response options of assessment tools, are covered as well as quantitative methods, i. e. study designs and indices. Furthermore, recommendations for interpretation are given.

[Research-based thinking of nurses at the end of their basic nursing education].

PubMed

Säämänen, J

1993-01-01

The purpose of this study was to find out the level of research-based thinking that students have internalized during their professional education. The research-based thinking of students has been investigated by analyzing the study reports, they have made at the end of their professional education. "The research-based thinking" is evaluated from the perspective of a research consumer. So, the purpose of this study was not to evaluate the level of studies, but the basis of them. The data consisted of 51 study reports. The data was analyzed by using the content analysis and descriptive statistics. The content analysis was based on the set of general rules for research using deductive methods of approach. The students' problems in research-based thinking fell mainly into the following parts: (1) the students did not use previous studies to build up the frame and the problems of their study, the students used scientific publications limitedly, it seems that the knowledge had the same value to the students regardless of the reference they have taken it from; (2) the students had difficulties in connecting the empirical part of their study with theoretical or conceptual frame. In this study the results indicated, that Finnish nursing students' research-based thinking is not mature in their study-reports at the end of education. It seems important to do further research to be able to analyze the reasons for these findings and how education could be improved in the future.

Evaluating department of transportation's research program : a methodology and case study.

DOT National Transportation Integrated Search

2012-06-01

An effective research program within a transportation organization can be a valuable asset to accomplish the goals of the overall : mission. Determining whether a research program is pursuing relevant research projects and obtaining results for the s...

Strategic Evaluation of University Knowledge and Technology Transfer Effectiveness

ERIC Educational Resources Information Center

Tran, Thien Anh

2013-01-01

Academic knowledge and technology transfer has been growing in importance both in academic research and practice. A critical question in managing this activity is how to evaluate its effectiveness. The literature shows an increasing number of studies done to address this question; however, it also reveals important gaps that need more research.…

Evaluation of Secondary School Students' Writing Fluency Skills

ERIC Educational Resources Information Center

Atasoy, Arzu; Temizkan, Mehmet

2016-01-01

Developed to evaluate secondary school students' writing fluency skills, this study is descriptive in nature and uses a mixed method approach. During the research, the researcher attempted to identify students' abilities to write in terms of quantity and complexity, on the one hand, and also attempted to identify findings on accuracy, the…

Evaluating a Pre-Session Homework Exercise in a Standalone Information Literacy Class

ERIC Educational Resources Information Center

Goetz, Joseph E.; Barber, Catherine R.

2015-01-01

In this study, researchers evaluate a homework exercise assigned before a standalone information literacy session. Students in a Master of Education program completed a worksheet using the ERIC database thesaurus. The researchers conducted pre- and posttests within a single library session to assess student learning, using a control group for…

Teacher Evaluations: A Correlation of Observed Teaching Practice and Student Achievement

ERIC Educational Resources Information Center

Wright, Pamela D.

2017-01-01

This quantitative study employed a correlational research design to examine the extent to which overall teacher evaluation scores and instructional practice domain scores relate to student achievement scores in mathematics and English language arts among 3rd grade students. This research tested the theory of instruction by Jerome Bruner as it…

Using Microanalytical Simulation Methods in Educational Evaluation: An Exploratory Study

ERIC Educational Resources Information Center

Sondergeld, Toni A.; Beltyukova, Svetlana A.; Fox, Christine M.; Stone, Gregory E.

2012-01-01

Scientifically based research used to inform evidence based school reform efforts has been required by the federal government in order to receive grant funding since the reenactment of No Child Left Behind (2002). Educational evaluators are thus faced with the challenge to use rigorous research designs to establish causal relationships. However,…

Application of GPS and Near-Surface Geophysical Methods to Evaluate Differences Between Agricultural Test Plots

USDA-ARS?s Scientific Manuscript database

A field research facility with two pairs of replicated agricultural test plots (four total) was established at a location in northwest Ohio during 2005 for the purpose of studying water table management strategies. Initial efforts at this field research facility were devoted to evaluating difference...

A Controlled Evaluation of the Distress Criterion for Binge Eating Disorder

ERIC Educational Resources Information Center

Grilo, Carlos M.; White, Marney A.

2011-01-01

Objective: Research has examined various aspects of the validity of the research criteria for binge eating disorder (BED) but has yet to evaluate the utility of Criterion C, "marked distress about binge eating." This study examined the significance of the marked distress criterion for BED using 2 complementary comparison groups. Method:…

The Interface of Opinion, Understanding and Evaluation While Learning about a Socioscientific Issue

ERIC Educational Resources Information Center

Witzig, Stephen B.; Halverson, Kristy L.; Siegel, Marcelle A.; Freyermuth, Sharyn K.

2013-01-01

Scientific literacy is an important goal for science education, especially within controversial socioscientific issues. In this study, we analysed 143 students' research reports about stem cell research (SCR) for how they addressed specific source evaluation criteria provided within the assignment. We investigated students' opinions about SCR, how…

75 FR 9228 - Draft Guidance for Industry on Non-Inferiority Clinical Trials; Availability

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-01

... guidance provides sponsors and review staff in the Center for Drug Evaluation and Research (CDER) and the Center for Biologics Evaluation and Research (CBER) with the agency's interpretation of the underlying principles involved in the use of non-inferiority (NI) study designs to provide evidence of the effectiveness...

Applying Generalizability Theory To Evaluate Treatment Effect in Single-Subject Research.

ERIC Educational Resources Information Center

Lefebvre, Daniel J.; Suen, Hoi K.

An empirical investigation of methodological issues associated with evaluating treatment effect in single-subject research (SSR) designs is presented. This investigation: (1) conducted a generalizability (G) study to identify the sources of systematic and random measurement error (SRME); (2) used an analytic approach based on G theory to integrate…

Assessing the Impact of Planned Social Change. Occasional Paper Series, #8.

ERIC Educational Resources Information Center

Campbell, Donald T.

Program impact methodology--usually referred to as evaluation research--is described as it is developing in the United States. Several problems face the field of evaluation research. First, those issues grouped as "meta-scientific" include: (1) the distinction between qualitative and quantitative studies; (2) the separation of implementation and…

Research Knowledge Transfer through Business-Driven Student Assignment

ERIC Educational Resources Information Center

Sas, Corina

2009-01-01

Purpose: The purpose of this paper is to present a knowledge transfer method that capitalizes on both research and teaching dimensions of academic work. It also aims to propose a framework for evaluating the impact of such a method on the involved stakeholders. Design/methodology/approach: The case study outlines and evaluates the six-stage…

Development and Validation of E-Portfolios: The UAE Pre-Service Teachers' Experiences

ERIC Educational Resources Information Center

Forawi, Sufian A.; Almekhlafi, Abdurrahman G.; Al-Mekhlafy, Mohamed H.

2012-01-01

Research has indicated the importance of evaluating the experiences related to developing e-portfolios (electronic portfolio) to contribute to the overall excellence in teaching and learning. Researchers (instructors) of the present study used an exit e-portfolios, a questionnaire and follow up interviews to describe development and evaluation of…

An Evaluation of Policy-Related Rehabilitation Research.

ERIC Educational Resources Information Center

Berkowitz, Monroe; And Others

The monograph evaluates the methodological quality and the policy utility of research in the area of rehabilitation of the handicapped. Analysis was based on a multidisciplinary review of 477 sample reports from more than 4,000 screened project reports. Chapter 1 delineates the nature of the study; Chapter 2 reviews the Federal/State…

Acoustic evaluation of standing trees : recent research development

Treesearch

Xiping Wang; Robert J. Ross; Peter Carter

2005-01-01

This paper presents some research results from recent trial studies on measuring acoustic velocities on standing trees of five softwood species. The relationships between tree velocities measured by time of flight method and log velocities measured by resonance method were evaluated. Theoretical and empirical models were developed for adjusting observed tree velocity...

A Research Synthesis of the Evaluation Capacity Building Literature

ERIC Educational Resources Information Center

Labin, Susan N.; Duffy, Jennifer L.; Meyers, Duncan C.; Wandersman, Abraham; Lesesne, Catherine A.

2012-01-01

The continuously growing demand for program results has produced an increased need for evaluation capacity building (ECB). The "Integrative ECB Model" was developed to integrate concepts from existing ECB theory literature and to structure a synthesis of the empirical ECB literature. The study used a broad-based research synthesis method with…

Farmers' Attitude towards a Participatory Research Method Used to Evaluate Weed Management Strategies in Bananas

ERIC Educational Resources Information Center

Ganpat, Wayne G.; Isaac, Wendy-Ann P.; Brathwaite, Richard A. I.; Bekele, Isaac

2009-01-01

In this study, farmers were engaged in a participatory research project and their attitudes evaluated. The purpose was to identify the characteristics of farmers who are favourably predisposed towards meaningful participation in the process. Several cover crops were tested for possible use in the management of watergrass ("Commelina…

The Evaluation of an Early Childhood Teacher Preparation Program: An Action Research Project

ERIC Educational Resources Information Center

Ragno, Kerry Sullivan

2013-01-01

The purpose of this dissertation was to evaluate the effectiveness of an Early Childhood Development Associate of Applied Science (AAS) degree program at one community college as part of an ongoing action research project. Prior to this dissertation study, external and internal barriers prevented the associate degree program stakeholders from…

The Influence of Learning Characteristics on Evaluation of Audience Response Technology

ERIC Educational Resources Information Center

MacGeorge, Erina L.; Homan, Scott R.; Dunning, John B.; Elmore, David; Bodie, Graham D.; Evans, Ed; Khichadia, Sangeetha; Lichti, Steven M.

2008-01-01

Audience Response Technology (ART) has been widely adopted on college campuses, and prior research indicates that, on average, it receives positive evaluations from students. However, research has not yet examined how characteristics of students as learners influence their responses to ART. The current study examined aptitude for learning,…

A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation

PubMed Central

Acosta, Joie D.; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S.

2017-01-01

Restorative Practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this paper describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI) in 14 middle schools in Maine to assess whether RPI impacts both positive developmental outcomes and problem behaviors and whether the effects persist during the transition from middle to high school. The two-year RPI intervention began in the 2014–2015 school year. The study’s rationale and theoretical concerns are discussed along with methodological concerns including teacher professional development. The theoretical rationale and description of the methods from this study may be useful to others conducting rigorous research and evaluation in this area. PMID:28936104

Nursing students’ satisfaction about their field of study

PubMed Central

HAKIM, ASHRAFALSADAT

2014-01-01

Introduction: Nowadays students' opinion is considered as a necessary factor to evaluate quality in universities. This study was performed to evaluate the nursing students' satisfaction about their field of study. Methods: The research population in this study consists of all the students of nursing studying at the second to fourth year of university (72 students). The data were collected from all the studied population. Data collection instrument was a research questionnaire. In this cross-sectional research, nursing students' satisfaction (72 students) in 6 major topics (situation of educational environment, situation of clinical environment, trainers, social image, relation to colleagues and management) was studied. The data were analyzed in SPSS, version 14, using quantitative variables and descriptive statistics including frequency distribution tables and diagrams. Results: The findings indicated that 83.3% of the students had little satisfaction as to the situation of educational environment, 47.2% about situation of clinical environment, 41.7% concerning the theoretical educational method by professors, and 41.7% as to the method of clinical education by clinical trainers. Also 47.2% were not that satisfied with the method of evaluation by the school professors, 80.6% with the method of relationship with colleagues and also 62.5% with the nursing social image. Moreover, findings indicated that 33.3% of the participants in this research were dissatisfied with the method of evaluation by clinical trainers and 50% with the method of nursing management. Conclusion: In the present study, most students had little satisfaction concerning their field of study. So it is necessary to make an attempt for continuous development of quality services. PMID:25512925

Nursing students' satisfaction about their field of study.

PubMed

Hakim, Ashrafalsadat

2014-04-01

Nowadays students' opinion is considered as a necessary factor to evaluate quality in universities. This study was performed to evaluate the nursing students' satisfaction about their field of study. The research population in this study consists of all the students of nursing studying at the second to fourth year of university (72 students). The data were collected from all the studied population. Data collection instrument was a research questionnaire. In this cross-sectional research, nursing students' satisfaction (72 students) in 6 major topics (situation of educational environment, situation of clinical environment, trainers, social image, relation to colleagues and management) was studied. The data were analyzed in SPSS, version 14, using quantitative variables and descriptive statistics including frequency distribution tables and diagrams. The findings indicated that 83.3% of the students had little satisfaction as to the situation of educational environment, 47.2% about situation of clinical environment, 41.7% concerning the theoretical educational method by professors, and 41.7% as to the method of clinical education by clinical trainers. Also 47.2% were not that satisfied with the method of evaluation by the school professors, 80.6% with the method of relationship with colleagues and also 62.5% with the nursing social image. Moreover, findings indicated that 33.3% of the participants in this research were dissatisfied with the method of evaluation by clinical trainers and 50% with the method of nursing management. In the present study, most students had little satisfaction concerning their field of study. So it is necessary to make an attempt for continuous development of quality services.

Rollover Data Special Study : Final Report.

DOT National Transportation Integrated Search

2011-01-31

This report summarizes research results from the Rollover Data Special Study (RODSS) project. The research encompassed the : design of a RODSS database for the National Highway Traffic Safety Administration, review of the RODSS data to evaluate the :...

Global development and diffusion of outcome evaluation research for interpersonal and self-directed violence prevention from 2007 to 2013: A systematic review

PubMed Central

Hughes, Karen; Bellis, Mark A.; Hardcastle, Katherine A.; Butchart, Alexander; Dahlberg, Linda L.; Mercy, James A.; Mikton, Christopher

2018-01-01

Through a global review, we identified gaps in the geographical distribution of violence prevention evidence outcome evaluation studies and the types of violence addressed. Systematic literature searches identified 355 articles published between 2007 and 2013 that evaluated programs to prevent interpersonal or self-directed violence; focused on universal or selected populations; and reported outcomes measuring violence or closely related risk factors. The number of studies identified increased annually from 2008 (n = 37), reaching 64 in 2013. Over half (n = 203) of all studies focused on youth violence yet only one on elder maltreatment. Study characteristics varied by year and violence type. Only 9.3% of all studies had been conducted in LMICs. These studies were less likely than those in high income countries (HICs) to have tested established interventions yet more likely to involve international collaboration. Evaluation studies successfully established in LMIC had often capitalized on other major regional priorities (e.g. HIV). Relationships between violence and social determinants, communicable and non-communicable diseases, and even economic prosperity should be explored as mechanisms to increase the global reach of violence prevention research. Results should inform future research strategies and provide a baseline for measuring progress in developing the violence prevention evidence-base, especially in LMICs. PMID:29725241

Global development and diffusion of outcome evaluation research for interpersonal and self-directed violence prevention from 2007 to 2013: A systematic review.

PubMed

Hughes, Karen; Bellis, Mark A; Hardcastle, Katherine A; Butchart, Alexander; Dahlberg, Linda L; Mercy, James A; Mikton, Christopher

2014-01-01

Through a global review, we identified gaps in the geographical distribution of violence prevention evidence outcome evaluation studies and the types of violence addressed. Systematic literature searches identified 355 articles published between 2007 and 2013 that evaluated programs to prevent interpersonal or self-directed violence; focused on universal or selected populations; and reported outcomes measuring violence or closely related risk factors. The number of studies identified increased annually from 2008 (n = 37), reaching 64 in 2013. Over half (n = 203) of all studies focused on youth violence yet only one on elder maltreatment. Study characteristics varied by year and violence type. Only 9.3% of all studies had been conducted in LMICs. These studies were less likely than those in high income countries (HICs) to have tested established interventions yet more likely to involve international collaboration. Evaluation studies successfully established in LMIC had often capitalized on other major regional priorities (e.g. HIV). Relationships between violence and social determinants, communicable and non-communicable diseases, and even economic prosperity should be explored as mechanisms to increase the global reach of violence prevention research. Results should inform future research strategies and provide a baseline for measuring progress in developing the violence prevention evidence-base, especially in LMICs.

Training Maneuver Evaluation for Reduced Order Modeling of Stability & Control Properties Using Computational Fluid Dynamics

DTIC Science & Technology

2013-03-01

reduced order model is created. Finally, previous research in this area of study will be examined, and its application to this research will be...TRAINING MANEUVER EVALUATION FOR REDUCED ORDER MODELING OF STABILITY & CONTROL PROPERTIES USING COMPUTATIONAL FLUID DYNAMICS THESIS Craig Curtis...Government and is not subject to copyright protection in the United States. AFIT-ENY-13-M-28 TRAINING MANEUVER EVALUATION FOR REDUCED ORDER MODELING OF

An Examination of Performance-Based Teacher Evaluation Systems in Five States. Summary. Issues & Answers. REL 2012-No. 129

ERIC Educational Resources Information Center

Shakman, Karen; Riordan, Julie; Sanchez, Maria Teresa; Cook, Kyle DeMeo; Fournier, Richard; Brett, Jessica

2012-01-01

This study reports on performance-based teacher evaluation systems in five states that have implemented such systems. It investigates two primary research questions: (1) What are the key characteristics of state-level performance-based teacher evaluation systems in the study states?; and (2) How do state teacher evaluation measures, the teaching…

A Review and Evaluation of the Langley Research Center's Scientific and Technical Information Program. Results of Phase IV--Knowledge and Attitudes Survey, Academic and Industrial Personnel. Final Report.

ERIC Educational Resources Information Center

Pinelli, Thomas E.; And Others

As Phase IV of a comprehensive evaluation of the NASA-affiliated Langley Research Center's (LaRC) scientific and technical information (STI) program, a study was conducted to assess the usage, importance, and perceived quality of Langley-generated STI among academic and industrial research personnel, and to determine ways in which that information…

Research on Comprehensive Evaluation Method for Heating Project Based on Analytic Hierarchy Processing

NASA Astrophysics Data System (ADS)

Han, Shenchao; Yang, Yanchun; Liu, Yude; Zhang, Peng; Li, Siwei

2018-01-01

It is effective to reduce haze in winter by changing the distributed heat supply system. Thus, the studies on comprehensive index system and scientific evaluation method of distributed heat supply project are essential. Firstly, research the influence factors of heating modes, and an index system with multiple dimension including economic, environmental, risk and flexibility was built and all indexes were quantified. Secondly, a comprehensive evaluation method based on AHP was put forward to analyze the proposed multiple and comprehensive index system. Lastly, the case study suggested that supplying heat with electricity has great advantage and promotional value. The comprehensive index system of distributed heating supply project and evaluation method in this paper can evaluate distributed heat supply project effectively and provide scientific support for choosing the distributed heating project.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods

PubMed Central

2010-01-01

Background Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. Methods/Design The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. Discussion This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community. PMID:20109202

The Neighborhood Voice: evaluating a mobile research vehicle for recruiting African Americans to participate in cancer control studies.

PubMed

Alcaraz, Kassandra I; Weaver, Nancy L; Andresen, Elena M; Christopher, Kara; Kreuter, Matthew W

2011-09-01

The Neighborhood Voice is a vehicle customized for conducting health research in community settings. It brings research studies into neighborhoods affected most by health disparities and reaches groups often underrepresented in research samples. This paper reports on the experience and satisfaction of 599 African American women who participated in research on board the Neighborhood Voice. Using bivariate, psychometric, and logistic regression analyses, we examined responses to a brief post-research survey. Most women (71%) reported that they had never previously participated in research, and two-thirds (68%) rated their Neighborhood Voice experience as excellent. Satisfaction scores were highest among first-time research participants (p < .05). Women's ratings of the Neighborhood Voice on Comfort (OR = 4.9; 95% CI = 3.0, 7.9) and Convenience (OR = 1.8; 95% CI = 1.2, 2.9) significantly predicted having an excellent experience. Mobile research facilities may increase participation among disadvantaged and minority populations. Our brief survey instrument is a model for evaluating such outreach.

In-silico studies in Chinese herbal medicines' research: evaluation of in-silico methodologies and phytochemical data sources, and a review of research to date.

PubMed

Barlow, D J; Buriani, A; Ehrman, T; Bosisio, E; Eberini, I; Hylands, P J

2012-04-10

The available databases that catalogue information on traditional Chinese medicines are reviewed in terms of their content and utility for in-silico research on Chinese herbal medicines, as too are the various protein database resources, and the software available for use in such studies. The software available for bioinformatics and 'omics studies of Chinese herbal medicines are summarised, and a critical evaluation given of the various in-silico methods applied in screening Chinese herbal medicines, including classification trees, neural networks, support vector machines, docking and inverse docking algorithms. Recommendations are made regarding any future in-silico studies of Chinese herbal medicines. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Community-level climate change vulnerability research: trends, progress, and future directions

NASA Astrophysics Data System (ADS)

McDowell, Graham; Ford, James; Jones, Julie

2016-03-01

This study systematically identifies, characterizes, and critically evaluates community-level climate change vulnerability assessments published over the last 25 years (n = 274). We find that while the field has advanced considerably in terms of conceptual framing and methodological approaches, key shortcomings remain in how vulnerability is being studied at the community-level. We argue that vulnerability research needs to more critically engage with the following: methods for evaluating future vulnerability, the relevance of vulnerability research for decision-making, interdependencies between social and ecological systems, attention to researcher / subject power dynamics, critical interpretation of key terms, and consideration of the potentially positive opportunities presented by a changing climate. Addressing these research needs is necessary for generating knowledge that supports climate-affected communities in navigating the challenges and opportunities ahead.

A synthesis study of noncontact nondestructive evaluation of top-down cracking in asphalt pavements.

DOT National Transportation Integrated Search

2013-12-01

The primary objective of this research study was to conduct an extensive literature review on top-down : cracking evaluation studies, prepare a synthesis of findings, and recommend a follow up phase for a : pilot study in Mississippi with a candidate...

Technology Enhanced Teacher Evaluation

ERIC Educational Resources Information Center

Teter, Richard B.

2010-01-01

The purpose of this research and development study was to design and develop an affordable, computer-based, pre-service teacher assessment and reporting system to allow teacher education institutions and supervising teachers to efficiently enter evaluation criteria, record pre-service teacher evaluations, and generate evaluation reports. The…

[Detection of palliative care needs in an acute care hospital unit. Pilot study].

PubMed

Rodríguez-Calero, Miguel Ángel; Julià-Mora, Joana María; Prieto-Alomar, Araceli

2016-01-01

Previous to wider prevalence studies, we designed the present pilot study to assess concordance and time invested in patient evaluations using a palliative care needs assessment tool. We also sought to estimate the prevalence of palliative care needs in an acute care hospital unit. A cross-sectional study was carried out, 4 researchers (2 doctors and 2 nurses) independently assessed all inpatients in an acute care hospital unit in Manacor Hospital, Mallorca (Spain), using the validated tool NECPAL CCOMS-ICO©, measuring time invested in every case. Another researcher revised clinical recordings to analise the sample profile. Every researcher assessed 29 patients, 15 men and 14 women, mean age 74,03 ± 10.25 years. 4-observer concordance was moderate (Kappa 0,5043), tuning out to be higher between nurses. Mean time per patient evaluation was 1.9 to 7.72 minutes, depending on researcher. Prevalence of palliative care needs was 23,28%. Moderate concordance lean us towards multidisciplinary shared assessments as a method for future research. Avarage of time invested in evaluations was less than 8 minutes, no previous publications were identified regarding this variable. More than 20% of inpatients of the acute care unit were in need of palliative care. Copyright © 2015 Elsevier España, S.L.U. All rights reserved.

Evaluating performance of limestone prone to polishing.

DOT National Transportation Integrated Search

2009-12-01

This research project evaluated the effect of blending Vanport limestone and other aggregates on the frictional surface characteristic properties of constructed trial road surfaces. The study undertook the evaluation of the performance of different m...

The Practice of Evaluation Research and the Use of Evaluation Results.

ERIC Educational Resources Information Center

Van den Berg, G.; Hoeben, W. Th. J. G.

1984-01-01

Lack of use of educational evaluation results in the Netherlands was investigated by analyzing 14 curriculum evaluation studies. Results indicated that rational decision making with a technical (empirical) evaluation approach makes utilization of results most likely. Incremental decision making and a conformative approach make utilization least…

Educational Evaluation: Key Characteristics. ACER Research Series No. 102.

ERIC Educational Resources Information Center

Maling-Keepes, Jillian

A set of 13 key characteristics is presented as a framework for educational evaluation studies: (1) program's stage of development when evaluator is appointed; (2) program's openness to revision; (3) program uniformity from site to site; (4) specificity of program objectives; (5) evaluator's independence; (6) evaluator's orientation to value…

The Evaluation of Hospital Performance in Iran: A Systematic Review Article

PubMed Central

BAHADORI, Mohammadkarim; IZADI, Ahmad Reza; GHARDASHI, Fatemeh; RAVANGARD, Ramin; HOSSEINI, Seyed Mojtaba

2016-01-01

Background: This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. Methods: In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. Results: The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Conclusion: Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them. PMID:27516991

The Evaluation of Hospital Performance in Iran: A Systematic Review Article.

PubMed

Bahadori, Mohammadkarim; Izadi, Ahmad Reza; Ghardashi, Fatemeh; Ravangard, Ramin; Hosseini, Seyed Mojtaba

2016-07-01

This research aimed to systematically study and outline the methods of hospital performance evaluation used in Iran. In this systematic review, all Persian and English-language articles published in the Iranian and non-Iranian scientific journals indexed from Sep 2004 to Sep 2014 were studied. For finding the related articles, the researchers searched the Iranian electronic databases, including SID, IranMedex, IranDoc, Magiran, as well as the non-Iranian electronic databases, including Medline, Embase, Scopus, and Google Scholar. For reviewing the selected articles, a data extraction form, developed by the researchers was used. The entire review process led to the selection of 51 articles. The publication of articles on the hospital performance evaluation in Iran has increased considerably in the recent years. Besides, among these 51 articles, 38 articles (74.51%) had been published in Persian language and 13 articles (25.49%) in English language. Eight models were recognized as evaluation model for Iranian hospitals. Totally, in 15 studies, the data envelopment analysis model had been used to evaluate the hospital performance. Using a combination of model to integrate indicators in the hospital evaluation process is inevitable. Therefore, the Ministry of Health and Medical Education should use a set of indicators such as the balanced scorecard in the process of hospital evaluation and accreditation and encourage the hospital managers to use them.

Economic Evaluation in Global Perspective: A Bibliometric Analysis of the Recent Literature.

PubMed

Pitt, Catherine; Goodman, Catherine; Hanson, Kara

2016-02-01

We present a bibliometric analysis of recently published full economic evaluations of health interventions and reflect critically on the implications of our findings for this growing field. We created a database drawing on 14 health, economic, and/or general literature databases for articles published between 1 January 2012 and 3 May 2014 and identified 2844 economic evaluations meeting our criteria. We present findings regarding the sensitivity, specificity, and added value of searches in the different databases. We examine the distribution of publications between countries, regions, and health areas studied and compare the relative volume of research with disease burden. We analyse authors' country and institutional affiliations, journals and journal type, language, and type of economic evaluation conducted. More than 1200 economic evaluations were published annually, of which 4% addressed low-income countries, 4% lower-middle-income countries, 14% upper-middle-income countries, and 83% high-income countries. Across country income levels, 53, 54, 86, and 100% of articles, respectively, included an author based in a country within the income level studied. Biomedical journals published 74% of economic evaluations. The volume of research across health areas correlates more closely with disease burden in high-income than in low-income and middle-income countries. Our findings provide an empirical basis for further study on methods, research prioritization, and capacity development in health economic evaluation. © 2016 The Authors. Health Economics published by John Wiley & Sons Ltd.

DETROIT EXPOSURE AND AEROSOL RESEARCH STUDY (DEARS)

EPA Science Inventory

The Detroit Exposure and Aerosol Research Study (DEARS) is a residential and personal exposure field monitoring study that is being conducted in Detroit MI over a three-year period from 2004 to 2007. The primary goal of the study is to evaluate and describe the relationship betw...

Guidelines for Conducting and Reporting Mixed Research in the Field of Counseling and beyond

ERIC Educational Resources Information Center

Leech, Nancy L.; Onwuegbuzie, Anthony J.

2010-01-01

This article provides guidelines for conducting, reporting, and evaluating mixed research studies in 3 sections: research formulation, research planning, and research implementation. To date, no such guidelines are available. Detailed descriptions of each subsection are included. The authors hope that these standards assist researchers from the…

Trend of knowledge production of research centers in the field of medical sciences in iran.

PubMed

Falahat, K; Eftekhari, Mb; Habibi, E; Djalalinia, Sh; Peykari, N; Owlia, P; Malekafzali, H; Ghanei, M; Mojarrab, Sh

2013-01-01

Establishment of medical research centers at universities and health-related organizations and annually evaluation of their research activities was one of the strategic policies which followed by governmental organization in last decade in order to strengthening the connections between health research system and health system. The aim of this study is to scrutinize the role of medical research centers in medical science production in Iran. This study is a cross sectional which has been performed based on existing reports on national scientometrics and evaluation results of research performance of medical research centers between years 2001 to 2010. During last decade number of medical research centers increased from 53 in 2001 to 359 in 2010. Simultaneous scientific output of medical research centers has been increased especially articles indexed in ISI (web of science). Proper policy implementation in the field of health research system during last decades led to improving capacity building and growth knowledge production of medical science in recent years in Iran. The process embedding research into the health systems requires planning up until research products improves health outcomes and health equity in country.

Methodological issues in oral health research: intervention studies.

PubMed

O'Mullane, Denis; James, Patrice; Whelton, Helen; Parnell, Carmel

2012-02-01

To provide a broad overview of methodological issues in the design and evaluation of intervention studies in dental public health, with particular emphasis on explanatory trials, pragmatic trials and complex interventions. We present a narrative summary of selected publications from the literature outlining both historical and recent challenges in the design and evaluation of intervention studies and describe some recent tools that may help researchers to address these challenges. It is now recognised that few intervention studies in dental public health are purely explanatory or pragmatic. We describe the PRECIS tool which can be used by trialists to assess and display the position of their trial on a continuum between the extremes of explanatory and pragmatic trials. The tool aims to help trialists make design decisions that are in line with their stated aims. The increasingly complex nature of dental public health interventions presents particular design and evaluation challenges. The revised Medical Research Council (MRC) guidance for the development and evaluation of complex interventions which emphasises the importance of planning and process evaluation is a welcome development. We briefly describe the MRC guidance and outline some examples of complex interventions in the field of oral health. The role of observational studies in monitoring public health interventions when the conduct of RCTs is not appropriate or feasible is acknowledged. We describe the STROBE statement and outline the implications of the STROBE guidelines for dental public health. The methodological challenges in the design, conduct and reporting of intervention studies in oral health are considerable. The need to provide reliable evidence to support innovative new strategies in oral health policy is a major impetus in these fields. No doubt the 'Methodological Issues in Oral Health Research' group will have further opportunities to highlight this work. © 2012 John Wiley & Sons A/S.

[Methods in health services research. The example of the evaluation of the German disease management programmes].

PubMed

Morfeld, M; Wirtz, M

2006-02-01

According to the established definition of Pfaff, health services research analyses patients' path through the institutions of the health care system. The focus is on development, evaluation and implementation of innovative measures of health care. By increasing its quality health services research strives for an improvement of efficacy and efficiency of the health care system. In order to allow for an appropriate evaluation it is essential to differentiate between structure, process and outcome quality referring to (1) the health care system in its entirety, (2) specific health care units as well as (3) processes of communication in different settings. Health services research comprises a large array of scientific disciplines like public health, medicine, social sciences and social care. For the purpose of managing its tasks adequately a special combination of instruments and methodological procedures is needed. Thus, diverse techniques of evaluation research as well as special requirements for study designs and assessment procedures are of vital importance. The example of the German disease management programmes illustrates the methodical requirements for a scientific evaluation.

Examining the impact of sexism on evaluations of social scientific evidence in discrimination litigation.

PubMed

Kim, Anita; Tidwell, Natasha

2014-12-01

The present 2 studies involved undergraduate participants and investigated whether various types of sexism and other correlated predictors, such as political conservatism and scientific discounting, can predict people's evaluations of social science research on sex stereotypes, sexism, and sex discrimination. In Study 1, participants high in hostile sexism, scientific discounting, and/or political conservatism were more critical of scientific studies that provided evidence for sexism than identical studies showing null results. Study 2 showed that participants high in modern sexism, hostile sexism, and political conservatism evaluated social scientific studies more negatively; in addition, assessments of social scientific evidence quality mediated the effect of modern sexism on admissibility ratings (b = -0.15, z = -4.16, p = .00). Overall, these results suggest that sexist beliefs can bias one's judgments of social scientific evidence. Future research should explore whether the same psychological processes operate for judges and jurors as they evaluate the admissibility of evidence and examine ways to attenuate the effect of sexism on evaluations. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Evaluation of a Research Experiences for Undergraduates Program in ChE Indicates Benefit from a Collaborative Model

ERIC Educational Resources Information Center

Follmer, D. Jake; Gomez, Esther; Zappe, Sarah; Kumar, Manish

2017-01-01

This study examined how a collaborative research environment in a structured research experience impacts undergraduate student outcomes. Students demonstrated significant gains in research skills and provided positive appraisals of their collaborative experiences. Emphasis on collaboration among students in an undergraduate research program…

Quantitative Research Attitudes and Research Training Perceptions among Master's-Level Students

ERIC Educational Resources Information Center

Steele, Janeé M.; Rawls, Glinda J.

2015-01-01

This study explored master's-level counseling students' (N = 804) perceptions of training in the Council for Accreditation of Counseling and Related Educational Programs (2009) Research and Program Evaluation standard, and their attitudes toward quantitative research. Training perceptions and quantitative research attitudes were low to moderate,…

Application of electronic medical record data for health outcomes research: a review of recent literature.

PubMed

Lin, Junji; Jiao, Tianze; Biskupiak, Joseph E; McAdam-Marx, Carrie

2013-04-01

Electronic medical records (EMRs) have become a common source of data for outcomes research. This review discusses trends in EMR data use for outcomes research as well as strengths and limitations, and likely future developments to help optimize value and use of EMR data for outcomes research. EMR-based studies reporting treatment outcomes published between 2007 and 2012 were predominantly from the USA and Europe. There has been a substantial increase in the number of EMR-based outcomes studies published from 2007-2008 (n = 28) to 2010-2011 (n = 55). Many studies evaluated biometric and laboratory test outcomes in common chronic conditions. However, researchers are expanding the scope of evaluated diseases and outcomes using advanced techniques, such as natural language processing and linking EMRs to other patient-level data to overcome issues with missing data or data that cannot be accessed using standard queries. These advances will help to expand the scope and sophistication of outcomes research in the coming years.

Novel methods to estimate antiretroviral adherence: protocol for a longitudinal study.

PubMed

Saberi, Parya; Ming, Kristin; Legnitto, Dominique; Neilands, Torsten B; Gandhi, Monica; Johnson, Mallory O

2018-01-01

There is currently no gold standard for assessing antiretroviral (ARV) adherence, so researchers often resort to the most feasible and cost-effective methods possible (eg, self-report), which may be biased or inaccurate. The goal of our study was to evaluate the feasibility and acceptability of innovative and remote methods to estimate ARV adherence, which can potentially be conducted with less time and financial resources in a wide range of clinic and research settings. Here, we describe the research protocol for studying these novel methods and some lessons learned. The 6-month pilot study aimed to examine the feasibility and acceptability of a remotely conducted study to evaluate the correlation between: 1) text-messaged photographs of pharmacy refill dates for refill-based adherence; 2) text-messaged photographs of pills for pill count-based adherence; and 3) home-collected hair sample measures of ARV concentration for pharmacologic-based adherence. Participants were sent monthly automated text messages to collect refill dates and pill counts that were taken and sent via mobile telephone photographs, and hair collection kits every 2 months by mail. At the study end, feasibility was calculated by specific metrics, such as the receipt of hair samples and responses to text messages. Participants completed a quantitative survey and qualitative exit interviews to examine the acceptability of these adherence evaluation methods. The relationship between the 3 novel metrics of adherence and self-reported adherence will be assessed. Investigators conducting adherence research are often limited to using either self-reported adherence, which is subjective, biased, and often overestimated, or other more complex methods. Here, we describe the protocol for evaluating the feasibility and acceptability of 3 novel and remote methods of estimating adherence, with the aim of evaluating the relationships between them. Additionally, we note the lessons learned from the protocol implementation to date. We expect that these novel measures will be feasible and acceptable. The implications of this research will be the identification and evaluation of innovative and accurate metrics of ARV adherence for future implementation.

Novel methods to estimate antiretroviral adherence: protocol for a longitudinal study

PubMed Central

Saberi, Parya; Ming, Kristin; Legnitto, Dominique; Neilands, Torsten B; Gandhi, Monica; Johnson, Mallory O

2018-01-01

Background There is currently no gold standard for assessing antiretroviral (ARV) adherence, so researchers often resort to the most feasible and cost-effective methods possible (eg, self-report), which may be biased or inaccurate. The goal of our study was to evaluate the feasibility and acceptability of innovative and remote methods to estimate ARV adherence, which can potentially be conducted with less time and financial resources in a wide range of clinic and research settings. Here, we describe the research protocol for studying these novel methods and some lessons learned. Methods The 6-month pilot study aimed to examine the feasibility and acceptability of a remotely conducted study to evaluate the correlation between: 1) text-messaged photographs of pharmacy refill dates for refill-based adherence; 2) text-messaged photographs of pills for pill count-based adherence; and 3) home-collected hair sample measures of ARV concentration for pharmacologic-based adherence. Participants were sent monthly automated text messages to collect refill dates and pill counts that were taken and sent via mobile telephone photographs, and hair collection kits every 2 months by mail. At the study end, feasibility was calculated by specific metrics, such as the receipt of hair samples and responses to text messages. Participants completed a quantitative survey and qualitative exit interviews to examine the acceptability of these adherence evaluation methods. The relationship between the 3 novel metrics of adherence and self-reported adherence will be assessed. Discussion Investigators conducting adherence research are often limited to using either self-reported adherence, which is subjective, biased, and often overestimated, or other more complex methods. Here, we describe the protocol for evaluating the feasibility and acceptability of 3 novel and remote methods of estimating adherence, with the aim of evaluating the relationships between them. Additionally, we note the lessons learned from the protocol implementation to date. We expect that these novel measures will be feasible and acceptable. The implications of this research will be the identification and evaluation of innovative and accurate metrics of ARV adherence for future implementation. PMID:29950816

The Evaluation of Health Education Program (HEP) of 9th Graders

ERIC Educational Resources Information Center

Erdogan, Polat; Gürol, Mehmet

2016-01-01

The main purpose of evaluation is to improve the quality of program. So, the purpose of this study was to evaluate the Health Education Program of 9th graders (HEP) with Educational Criticism Model of Eisner. The study was conducted with the qualitative research method. A holistic single case design was employed in this study. The typical case…

Study of Teacher Evaluation and Dismissal: Recommendations for 1998. Report to the Colorado General Assembly. Research Publication No. 429.

ERIC Educational Resources Information Center

Colorado State General Assembly, Denver. Legislative Council.

The Interim Committee on Teacher Evaluation and Dismissal was established by (Colorado) Senate Joint Resolution 97-14 to study the state's teacher evaluation and dismissal laws and explore alternatives. The committee was directed to study the relationship between education reform and employment protections for teachers; the effectiveness of adding…

Implementation and evaluation of LMS mobile application: scele mobile based on user-centered design

NASA Astrophysics Data System (ADS)

Banimahendra, R. D.; Santoso, H. B.

2018-03-01

The development of mobile technology is now increasing rapidly, demanding all activities including learning should be done on mobile devices. It shows that the implementation of mobile application as a learning medium needs to be done. This study describes the process of developing and evaluating the Moodle-based mobile Learning Management System (LMS) application called Student Centered e-Learning Environment (SCeLE). This study discusses the process of defining features, implementing features into the application, and evaluating the application. We define the features using user research and literature study, then we implement the application with user-centered design basis, at the last phase we evaluated the application using usability testing and system usability score (SUS). The purpose of this study is to determine the extent to which this application can help the users doing their tasks and provide recommendation for the next research and development.

How will we know "good" qualitative research when we see it? Beginning the dialogue in health services research.

PubMed

Devers, K J

1999-12-01

To lay the foundation for an explicit review and dialogue concerning the criteria that should be used to evaluate qualitative health services research. Clear criteria are critical for the discipline because they provide a benchmark against which research can be assessed. Existing literature in the social sciences and health services research, particularly in primary care and medicine. Traditional criteria for evaluating qualitative research are rooted in the philosophical perspective (positivism) most closely associated with quantitative research and methods. As a result, qualitative research and methods may not be used as frequently as they can be and research results generated from qualitative studies may not be disseminated as widely as possible. However, alternative criteria for evaluating qualitative research have been proposed that reflect a different philosophical perspective (post-positivism). Moreover, these criteria are tailored to the unique purposes for which qualitative research is used and the research designs traditionally employed. While criteria based on these two different philosophical perspectives have much in common, some important differences exist. The field of health services research must engage in a collective, "qualitative" process to determine which criteria to adopt (positivist or post-positivist), or whether some combination of the two is most appropriate. Greater clarity about the criteria used to evaluate qualitative research will strengthen the discipline by fostering a more appropriate and improved use of qualitative methods, a greater willingness to fund and publish "good" qualitative research, and the development of more informed consumers of qualitative research results.

Implementing clinical guidelines to prevent catheter-associated urinary tract infections and improve catheter care in nursing homes: Systematic review.

PubMed

Gould, Dinah; Gaze, Sarah; Drey, Nicholas; Cooper, Tracey

2017-05-01

Catheter-associated urinary tract infection is the most common health care-associated infection, is considered avoidable, and has cost implications for health services. Prevalence is high in nursing homes, but little research has been undertaken to establish whether implementing clinical guidelines can reduce infection rates in long-term care or improve quality of urinary catheter care. Systematic search and critical appraisal of the literature. Three studies evaluated the impact of implementing a complete clinical guideline. Five additional studies evaluated the impact of implementing individual elements of a clinical guideline. Prevention of catheter-associated urinary tract infection in nursing homes has received little clinical or research attention. Studies concerned with whole guideline implementation emerged as methodologically poor using recognized criteria for critically appraising epidemiologic studies concerned with infection prevention. Research evaluating the impact of single elements of clinical guidelines is more robust, and their findings could be implemented to prevent urinary infections in nursing homes. Copyright © 2017. Published by Elsevier Inc.

Facilitative Components of Collaborative Learning: A Review of Nine Health Research Networks

PubMed Central

Rittner, Jessica Levin; Johnson, Karin E.; Gerteis, Jessie; Miller, Therese

2017-01-01

Objective: Collaborative research networks are increasingly used as an effective mechanism for accelerating knowledge transfer into policy and practice. This paper explored the characteristics and collaborative learning approaches of nine health research networks. Data sources/study setting: Semi-structured interviews with representatives from eight diverse US health services research networks conducted between November 2012 and January 2013 and program evaluation data from a ninth. Study design: The qualitative analysis assessed each network's purpose, duration, funding sources, governance structure, methods used to foster collaboration, and barriers and facilitators to collaborative learning. Data collection: The authors reviewed detailed notes from the interviews to distill salient themes. Principal findings: Face-to-face meetings, intentional facilitation and communication, shared vision, trust among members and willingness to work together were key facilitators of collaborative learning. Competing priorities for members, limited funding and lack of long-term support and geographic dispersion were the main barriers to coordination and collaboration across research network members. Conclusion: The findings illustrate the importance of collaborative learning in research networks and the challenges to evaluating the success of research network functionality. Conducting readiness assessments and developing process and outcome evaluation metrics will advance the design and show the impact of collaborative research networks. PMID:28277202

[Cultural anthropology of traditional Chinese medicine].

PubMed

Wan, Xia; Liu, Jian-ping; Ai, Yan-ke; Li, Liu-ji

2008-07-01

Biological, psychological and sociological model of medicine substantializes the old model lacking the social humane attributes. The new medical model makes people take medical anthropology into research and highly evaluate traditional medical system. Cultural anthropology of traditional Chinese medicine (TCM) is part of medical anthropology with three major characteristics: wide research scope, specificity, and integration. It has developed its own research methods, such as field investigation, comprehensive inspection and comparison study. Cultural anthropology provides an efficient research method for TCM, and its application would further develop TCM theory and form comprehensive evaluation on TCM effects.

Review of Studies on Pedestrian and Bicyclist Safety, 1991-2007

DOT National Transportation Integrated Search

2012-06-01

This report reviews the pedestrian and bicyclist safety research literature in print as of 2007. It summarizes and synthesizes the key studies, evaluates existing knowledge and identifies research gaps and provides recommendations for future directio...

Review of research designs and statistical methods employed in dental postgraduate dissertations.

PubMed

Shirahatti, Ravi V; Hegde-Shetiya, Sahana

2015-01-01

There is a need to evaluate the quality of postgraduate dissertations of dentistry submitted to university in the light of the international standards of reporting. We conducted the review with an objective to document the use of sampling methods, measurement standardization, blinding, methods to eliminate bias, appropriate use of statistical tests, appropriate use of data presentation in postgraduate dental research and suggest and recommend modifications. The public access database of the dissertations from Rajiv Gandhi University of Health Sciences was reviewed. Three hundred and thirty-three eligible dissertations underwent preliminary evaluation followed by detailed evaluation of 10% of randomly selected dissertations. The dissertations were assessed based on international reporting guidelines such as strengthening the reporting of observational studies in epidemiology (STROBE), consolidated standards of reporting trials (CONSORT), and other scholarly resources. The data were compiled using MS Excel and SPSS 10.0. Numbers and percentages were used for describing the data. The "in vitro" studies were the most common type of research (39%), followed by observational (32%) and experimental studies (29%). The disciplines conservative dentistry (92%) and prosthodontics (75%) reported high numbers of in vitro research. Disciplines oral surgery (80%) and periodontics (67%) had conducted experimental studies as a major share of their research. Lacunae in the studies included observational studies not following random sampling (70%), experimental studies not following random allocation (75%), not mentioning about blinding, confounding variables and calibrations in measurements, misrepresenting the data by inappropriate data presentation, errors in reporting probability values and not reporting confidence intervals. Few studies showed grossly inappropriate choice of statistical tests and many studies needed additional tests. Overall observations indicated the need to comply with standard guidelines of reporting research.

Taking Financial Relationships into Account When Assessing Research

PubMed Central

Resnik, David B.; Elliott, Kevin C.

2014-01-01

Many scientific journals, government agencies, and universities require disclosure of sources of funding and financial interests related to research, such as stock ownership, consulting arrangements with companies, and patents. Although disclosure has become one of the central approaches for responding to financial conflicts of interest (COIs) in research, critics contend that information about financial COIs does not serve as a reliable indicator of research credibility, and therefore, studies should be evaluated solely based on their scientific merits. We argue that, while it is indeed important to evaluate studies on their scientific merits, it is often difficult to detect significant influences of financial relationships that affect research credibility. Moreover, at least five factors can be examined to determine whether financial relationships are likely to enhance, undermine, or have no impact on the credibility of research. These include as follows: whether sponsors, institutions, or researchers have a significant financial stake in the outcome of a study; whether the financial interests of the sponsors, institutions, or researchers coincide with the goal of conducting research that is objective and reliable; whether the sponsor, institution, or researchers have a history of biasing research in order to promote their financial goals; how easy it is to manipulate the research in order to achieve financial goals; and whether oversight mechanisms are in place which are designed to minimize bias. Since these factors vary from case to case, evaluating the impact of financial relationships depends on the circumstances. In some situations, onemay decide that the financial relationships significantly undermine the study’s credibility; in others, one may decide that they have no impact on credibility or even enhance it. PMID:23672544

An Analysis of Teacher Candidates' Usage Level of Metacognitive Learning Strategies: Sample of a University in Turkey

ERIC Educational Resources Information Center

Yesilyurt, Etem

2013-01-01

The purpose of this research is to evaluate the level metacognitive learning strategies are used by teacher candidates. The study was designed as a descriptive research. Study group of present research consists of 291 teacher candidates studying in the Faculty of Education within the body of a Western Anatolian university in Turkey. Research…

Insights on Using Developmental Evaluation for Innovating: A Case Study on the Cocreation of an Innovative Program

ERIC Educational Resources Information Center

Lam, Chi Yan; Shulha, Lyn M.

2015-01-01

This article contributes to research on evaluation by examining the capacity and contribution of developmental evaluation for innovating. This case study describes the "preformative development" of an educational program (from conceptualization to pilot implementation) and analyzes the processes of innovation within a developmental…

Evaluating the Effectiveness of Cognitive-Behavioral Treatment of Residual Symptoms and Impairment in Schizophrenia

ERIC Educational Resources Information Center

Bradshaw, William; Roseborough, David

2004-01-01

This study evaluated the effectiveness of cognitive-behavioral interventions in the treatment of persons with schizophrenia who experienced significant residual symptoms and impaired functioning despite their adherence to medication. The study used an aggregated AB single-system research design across 22 participants to evaluate change in clinical…

Electrification Futures Study: A Technical Evaluation of the Impacts of an

Science.gov Websites

Technical Evaluation of the Impacts of an Electrified U.S. Energy System Electrification Futures Study: A Technical Evaluation of the Impacts of an Electrified U.S. Energy System Illustration showing various impacts of widespread electrification in the United States. In addition to NREL, the research team

Entropy of Linkography: Evaluating the Creativity of Short Animation

ERIC Educational Resources Information Center

Chou, Shyan-Bin; Chou, Huey-Wen; Chen, Yui-Liang

2013-01-01

There are important research issues surrounding the best methods for evaluating creativity of animation. This study proposed an approach to evaluate the creativity of short animation by adopting Linkography. This article reported the results of two experiments performed to test this approach. In study 1, participants identified as impressive a set…

"Evaluation as Illumination: A New Approach to the Study of Innovatory Programs". Occasional Paper.

ERIC Educational Resources Information Center

Parlett, Malcolm; Hamilton, David

Conventional approaches to program evaluation have followed the experimental and psychometric traditions dominant in educational research. Their aim (unfulfilled) of achieving fully objective methods had led to studies that are artificial and restricted in scope. Illuminative evaluation is introduced as a total re-appraisal of the rationale and…

The Effect of Student Evaluations on Faculty Performance

ERIC Educational Resources Information Center

Hartford, Kenneth M.

2017-01-01

The purpose of this study was to understand the behavior of professors as a consequence of receiving student evaluations. To address this purpose, a single research question directed this study: In what ways and to what extent might faculty compromise good pedagogical practices for positive student evaluations of teaching? A qualitative research…

Refinement, Application, and Evaluation of Cognitive and Affective Chemistry Measures for College Students

ERIC Educational Resources Information Center

Heredia, Keily

2013-01-01

This work describes three case studies conducted to address two major problems in the area of chemistry education research, the lack of reported psychometrics regarding instrument scores, and the need for well-characterized assessments to evaluate college chemistry curricula. The first case study describes a psychometric evaluation of the Colorado…

Academic consortium for the evaluation of computer-aided diagnosis (CADx) in mammography

NASA Astrophysics Data System (ADS)

Mun, Seong K.; Freedman, Matthew T.; Wu, Chris Y.; Lo, Shih-Chung B.; Floyd, Carey E., Jr.; Lo, Joseph Y.; Chan, Heang-Ping; Helvie, Mark A.; Petrick, Nicholas; Sahiner, Berkman; Wei, Datong; Chakraborty, Dev P.; Clarke, Laurence P.; Kallergi, Maria; Clark, Bob; Kim, Yongmin

1995-04-01

Computer aided diagnosis (CADx) is a promising technology for the detection of breast cancer in screening mammography. A number of different approaches have been developed for CADx research that have achieved significant levels of performance. Research teams now recognize the need for a careful and detailed evaluation study of approaches to accelerate the development of CADx, to make CADx more clinically relevant and to optimize the CADx algorithms based on unbiased evaluations. The results of such a comparative study may provide each of the participating teams with new insights into the optimization of their individual CADx algorithms. This consortium of experienced CADx researchers is working as a group to compare results of the algorithms and to optimize the performance of CADx algorithms by learning from each other. Each institution will be contributing an equal number of cases that will be collected under a standard protocol for case selection, truth determination, and data acquisition to establish a common and unbiased database for the evaluation study. An evaluation procedure for the comparison studies are being developed to analyze the results of individual algorithms for each of the test cases in the common database. Optimization of individual CADx algorithms can be made based on the comparison studies. The consortium effort is expected to accelerate the eventual clinical implementation of CADx algorithms at participating institutions.

Parents, Practitioners, and Researchers: Community-Based Participatory Research With Early Head Start

PubMed Central

McAllister, Carol L.; Green, Beth L.; Terry, Martha Ann; Herman, Vivian; Mulvey, Laurie

2003-01-01

Community-based participatory research (CBPR) is an approach to research and evaluation that is receiving increased attention in the field of public health. Our report discusses the application of this approach to research and evaluation with an Early Head Start (EHS) program in Pittsburgh, Pa. Our primary purpose is to illustrate the key elements that contributed to effective collaboration among researchers, EHS practitioners, and parents of EHS children in the conduct of the study. The focus is not on research findings but on research process. Our goal is to make the practices of CBPR visible and explicit so they can be analyzed, further developed, and effectively applied to a range of public health issues in a diversity of community contexts. PMID:14534219

Applying the institutional review board data repository approach to manage ethical considerations in evaluating and studying medical education

PubMed Central

Thayer, Erin K.; Rathkey, Daniel; Miller, Marissa Fuqua; Palmer, Ryan; Mejicano, George C.; Pusic, Martin; Kalet, Adina; Gillespie, Colleen; Carney, Patricia A.

2016-01-01

Issue Medical educators and educational researchers continue to improve their processes for managing medical student and program evaluation data using sound ethical principles. This is becoming even more important as curricular innovations are occurring across undergraduate and graduate medical education. Dissemination of findings from this work is critical, and peer-reviewed journals often require an institutional review board (IRB) determination. Approach IRB data repositories, originally designed for the longitudinal study of biological specimens, can be applied to medical education research. The benefits of such an approach include obtaining expedited review for multiple related studies within a single IRB application and allowing for more flexibility when conducting complex longitudinal studies involving large datasets from multiple data sources and/or institutions. In this paper, we inform educators and educational researchers on our analysis of the use of the IRB data repository approach to manage ethical considerations as part of best practices for amassing, pooling, and sharing data for educational research, evaluation, and improvement purposes. Implications Fostering multi-institutional studies while following sound ethical principles in the study of medical education is needed, and the IRB data repository approach has many benefits, especially for longitudinal assessment of complex multi-site data. PMID:27443407

Online market research panel members as controls in case-control studies to investigate gastrointestinal disease outbreaks: early experiences and lessons learnt from the UK.

PubMed

Mook, P; McCormick, J; Kanagarajah, S; Adak, G K; Cleary, P; Elson, R; Gobin, M; Hawker, J; Inns, T; Sinclair, C; Trienekens, S C M; Vivancos, R; McCarthy, N D

2018-03-01

Established methods of recruiting population controls for case-control studies to investigate gastrointestinal disease outbreaks can be time consuming, resulting in delays in identifying the source or vehicle of infection. After an initial evaluation of using online market research panel members as controls in a case-control study to investigate a Salmonella outbreak in 2013, this method was applied in four further studies in the UK between 2014 and 2016. We used data from all five studies and interviews with members of each outbreak control team and market research panel provider to review operational issues, evaluate risk of bias in this approach and consider methods to reduce confounding and bias. The investigators of each outbreak reported likely time and cost savings from using market research controls. There were systematic differences between case and control groups in some studies but no evidence that conclusions on the likely source or vehicle of infection were incorrect. Potential selection biases introduced by using this sampling frame and the low response rate are unclear. Methods that might reduce confounding and some bias should be balanced with concerns for overmatching. Further evaluation of this approach using comparisons with traditional methods and population-based exposure survey data is recommended.

Effectiveness of nursing management information systems: a systematic review.

PubMed

Choi, Mona; Yang, You Lee; Lee, Sun-Mi

2014-10-01

The purpose of this study was to review evaluation studies of nursing management information systems (NMISs) and their outcome measures to examine system effectiveness. For the systematic review, a literature search of the PubMed, CINAHL, Embase, and Cochrane Library databases was conducted to retrieve original articles published between 1970 and 2014. Medical Subject Headings (MeSH) terms included informatics, medical informatics, nursing informatics, medical informatics application, and management information systems for information systems and evaluation studies and nursing evaluation research for evaluation research. Additionally, manag(*) and admin(*), and nurs(*) were combined. Title, abstract, and full-text reviews were completed by two reviewers. And then, year, author, type of management system, study purpose, study design, data source, system users, study subjects, and outcomes were extracted from the selected articles. The quality and risk of bias of the studies that were finally selected were assessed with the Risk of Bias Assessment Tool for Non-randomized Studies (RoBANS) criteria. Out of the 2,257 retrieved articles, a total of six articles were selected. These included two scheduling programs, two nursing cost-related programs, and two patient care management programs. For the outcome measurements, usefulness, time saving, satisfaction, cost, attitude, usability, data quality/completeness/accuracy, and personnel work patterns were included. User satisfaction, time saving, and usefulness mostly showed positive findings. The study results suggest that NMISs were effective in time saving and useful in nursing care. Because there was a lack of quality in the reviewed studies, well-designed research, such as randomized controlled trials, should be conducted to more objectively evaluate the effectiveness of NMISs.

Effects of NIGMS Training Programs on Graduate Education in the Biomedical Sciences. An Evaluative Study of the Training Programs of the National Institute of General Medical Sciences 1958-1967.

ERIC Educational Resources Information Center

National Inst. of General Medical Sciences (NIH), Bethesda, MD.

This report was prepared by the National Research Council, at the request of the National Institutes of Health, in an attempt to evaluate the Graduate Research Training Grant Program and Fellowship Program in bioscience. One of the purposes of the study was to collect objective data that would provide answers to such questions as: What have been…

Evaluation of the clinical protocol quality for family planning services of people living with HIV/AIDS.

PubMed

Brasil, Raquel Ferreira Gomes; Silva, Maria Josefina da; Moura, Escolástica Rejane Ferreira

2018-01-01

To evaluate the quality of a clinical protocol for family planning care for people living with HIV/AIDS. An evaluative study based on the six domains of the Appraisal of Guidelines for Research & Evaluation II and on Pearson's Coefficient of Variation. The protocol reached between 88.8% and 100.0% quality in the domains of the Appraisal of Guidelines for Research & Evaluation II and 93.3% in the overall evaluation. The obtained Pearson's coefficient of variation was between zero and 18.6. Considering that a minimum percentage of 70.0% was adopted for the quality attributed by the evaluators, quality has been achieved for all domains of the Appraisal of Guidelines for Research & Evaluation II. As a coefficient for all domains was less than 25%, we can infer that the scores attributed by the evaluators were linear or homogeneous, meaning high agreement between them. The protocol was evaluated as a quality instrument, recommended for use by health professionals who deal with family planning for people living with HIV/AIDS.

The Quantitative Evaluation of the Clinical and Translational Science Awards (CTSA) Program Based on Science Mapping and Scientometric Analysis

PubMed Central

Zhang, Yin; Wang, Lei

2013-01-01

Abstract The Clinical and Translational Science Awards (CTSA) program is one of the most important initiatives in translational medical funding. The quantitative evaluation of the efficiency and performance of the CTSA program has a significant referential meaning for the decision making of global translational medical funding. Using science mapping and scientometric analytic tools, this study quantitatively analyzed the scientific articles funded by the CTSA program. The results of the study showed that the quantitative productivities of the CTSA program had a stable increase since 2008. In addition, the emerging trends of the research funded by the CTSA program covered clinical and basic medical research fields. The academic benefits from the CTSA program were assisting its members to build a robust academic home for the Clinical and Translational Science and to attract other financial support. This study provided a quantitative evaluation of the CTSA program based on science mapping and scientometric analysis. Further research is required to compare and optimize other quantitative methods and to integrate various research results. PMID:24330689

The quantitative evaluation of the Clinical and Translational Science Awards (CTSA) program based on science mapping and scientometric analysis.

PubMed

Zhang, Yin; Wang, Lei; Diao, Tianxi

2013-12-01

The Clinical and Translational Science Awards (CTSA) program is one of the most important initiatives in translational medical funding. The quantitative evaluation of the efficiency and performance of the CTSA program has a significant referential meaning for the decision making of global translational medical funding. Using science mapping and scientometric analytic tools, this study quantitatively analyzed the scientific articles funded by the CTSA program. The results of the study showed that the quantitative productivities of the CTSA program had a stable increase since 2008. In addition, the emerging trends of the research funded by the CTSA program covered clinical and basic medical research fields. The academic benefits from the CTSA program were assisting its members to build a robust academic home for the Clinical and Translational Science and to attract other financial support. This study provided a quantitative evaluation of the CTSA program based on science mapping and scientometric analysis. Further research is required to compare and optimize other quantitative methods and to integrate various research results. © 2013 Wiley Periodicals, Inc.

Evaluative Intervention Research in Child's Play.

ERIC Educational Resources Information Center

Yawkey, Thomas Daniels; Fox, Frank D.

Evaluative intervention studies which have examined the potential of imaginative play to foster young children's cognitive and social development provide the focus of this literature review. Four criteria were used to select the studies: (1) the study's focus was on the use of imaginative play to foster cognitive growth; (2) the studies were…

Truancy Interventions: A Review of the Research Literature

ERIC Educational Resources Information Center

Sutphen, Richard D.; Ford, Janet P.; Flaherty, Chris

2010-01-01

Objectives: This article presents a systematic review of the literature on evaluative studies of truancy interventions. Method: Included studies evaluating truancy interventions appearing in peer-reviewed academic journals from 1990 to 2007. Findings: In total, 16 studies were assessed. Eight studies used group comparison designs and eight studies…

The Validation of a Software Evaluation Instrument.

ERIC Educational Resources Information Center

Schmitt, Dorren Rafael

This study, conducted at six southern universities, analyzed the validity and reliability of a researcher developed instrument designed to evaluate educational software in secondary mathematics. The instrument called the Instrument for Software Evaluation for Educators uses measurement scales, presents a summary section of the evaluation, and…

A Program Evaluation of Cardinal Stritch University's Undergraduate Teacher Education Program

ERIC Educational Resources Information Center

Russell, Freda Renee

2009-01-01

The purpose of the research was to study the effectiveness of Cardinal Stritch University's Undergraduate Teacher Education Program in preparing its graduates to teach all children. The researcher framed the study around four areas of concern common to beginning teachers from the research and literature: (a) curriculum, instruction and assessment…

Development of a School Nursing Research Agenda in Florida: A Delphi Study

ERIC Educational Resources Information Center

Gordon, Shirley C.; Barry, Charlotte D.

2006-01-01

Research is important to the image, visibility, and viability of school nursing. Each state school nursing association should evaluate member commitment to school nursing research based on their unique set of financial, educational, and organizational resources. A 3-round Delphi study was conducted in which Florida school nurses identified…

Concentration, Chlorination, and Chemical Analysis of Drinking Water for Disinfection Byproduct Mixtures Health Effects Research: U.S. EPA’s Four Lab Study

EPA Science Inventory

The U.S. Environmental Protection Agency’s “Four Lab Study” involved participation of researchers from four national Laboratories and Centers of the Office of Research and Development along with collaborators from the water industry and academia. The study evaluated toxicological...

A Research Experience Using Portfolios for Assessing College Teaching

ERIC Educational Resources Information Center

Cisneros-Cohernour, Edith J.; Stake, Robert E.

2014-01-01

In this article, we use the findings of a study conducted in a university in the southeast of Mexico to examine strengths and limitations of portfolios to assess formatively the quality of teaching. The research is part of the study: Model for the Development and Evaluation of Academic Competencies, involving researchers from six Mexican…

Health Information Technology Evaluation Framework (HITREF) Comprehensiveness as Assessed in Electronic Point-of-Care Documentation Systems Evaluations.

PubMed

Sockolow, Paulina S; Bowles, Kathryn H; Rogers, Michelle

2015-01-01

We assessed the Health Information Technology (HIT) Reference-based Evaluation Framework (HITREF) comprehensiveness in two HIT evaluations in settings different from that in which the HITREF was developed. Clinician satisfaction themes that emerged from clinician interviews in the home care and the hospital studies were compared to the framework components. Across both studies, respondents commented on 12 of the 20 HITREF components within 5 of the 6 HITREF concepts. No new components emerged that were missing from the HITREF providing evidence that the HITREF is a comprehensive framework. HITREF use in a range of HIT evaluations by researchers new to the HITREF demonstrates that it can be used as intended. Therefore, we continue to recommend the HITREF as a comprehensive, research-based HIT evaluation framework to increase the capacity of informatics evaluators' use of best practice and evidence-based practice to support the credibility of their findings for fulfilling the purpose of program evaluation.

Examples of sex/gender sensitivity in epidemiological research: results of an evaluation of original articles published in JECH 2006-2014.

PubMed

Jahn, Ingeborg; Börnhorst, Claudia; Günther, Frauke; Brand, Tilman

2017-02-15

During the last decades, sex and gender biases have been identified in various areas of biomedical and public health research, leading to compromised validity of research findings. As a response, methodological requirements were developed but these are rarely translated into research practice. The aim of this study is to provide good practice examples of sex/gender sensitive health research. We conducted a systematic search of research articles published in JECH between 2006 and 2014. An instrument was constructed to evaluate sex/gender sensitivity in four stages of the research process (background, study design, statistical analysis, discussion). In total, 37 articles covering diverse topics were included. Thereof, 22 were evaluated as good practice example in at least one stage; two articles achieved highest ratings across all stages. Good examples of the background referred to available knowledge on sex/gender differences and sex/gender informed theoretical frameworks. Related to the study design, good examples calculated sample sizes to be able to detect sex/gender differences, selected sex/gender sensitive outcome/exposure indicators, or chose different cut-off values for male and female participants. Good examples of statistical analyses used interaction terms with sex/gender or different shapes of the estimated relationship for men and women. Examples of good discussions interpreted their findings related to social and biological explanatory models or questioned the statistical methods used to detect sex/gender differences. The identified good practice examples may inspire researchers to critically reflect on the relevance of sex/gender issues of their studies and help them to translate methodological recommendations of sex/gender sensitivity into research practice.

R and D Evaluation Workshop report, U.S. Department of Energy, Office of Energy Research, September 7--8, 1995

DOE Office of Scientific and Technical Information (OSTI.GOV)

Jordan, G.

1995-10-30

The objective of the workshop was to promote discussions between experts and research managers on developing approaches for assessing the impact of DOE`s basic energy research upon the energy mission, applied research, technology transfer, the economy, and society. The purpose of this impact assessment is to demonstrate results and improve ER research programs in this era when basic research is expected to meet changing national economic and social goals. The questions addressed were: (1) By what criteria and metrics does Energy Research measure performance and evaluate its impact on the DOE mission and society while maintaining an environment that fostersmore » basic research? (2) What combination of evaluation methods best applies to assessing the performance and impact of OBES basic research? The focus will be upon the following methods: Case studies, User surveys, Citation analysis, TRACES approach, Return on DOE investment (ROI)/Econometrics, and Expert panels. (3) What combination of methods and specific rules of thumb can be applied to capture impacts along the spectrum from basic research to products and societal impacts?« less

Experimental Evaluation and Workload Characterization for High-Performance Computer Architectures

NASA Technical Reports Server (NTRS)

El-Ghazawi, Tarek A.

1995-01-01

This research is conducted in the context of the Joint NSF/NASA Initiative on Evaluation (JNNIE). JNNIE is an inter-agency research program that goes beyond typical.bencbking to provide and in-depth evaluations and understanding of the factors that limit the scalability of high-performance computing systems. Many NSF and NASA centers have participated in the effort. Our research effort was an integral part of implementing JNNIE in the NASA ESS grand challenge applications context. Our research work under this program was composed of three distinct, but related activities. They include the evaluation of NASA ESS high- performance computing testbeds using the wavelet decomposition application; evaluation of NASA ESS testbeds using astrophysical simulation applications; and developing an experimental model for workload characterization for understanding workload requirements. In this report, we provide a summary of findings that covers all three parts, a list of the publications that resulted from this effort, and three appendices with the details of each of the studies using a key publication developed under the respective work.

A New Approach to Evaluating the Well-Being of PhD Research Students

ERIC Educational Resources Information Center

Juniper, Bridget; Walsh, Elaine; Richardson, Alan; Morley, Bernard

2012-01-01

This study describes the development of an assessment to evaluate the well-being of PhD researchers using a clinically approved methodology that places the perceptions and experiences of the subject population at the heart of its construction. It identifies and assesses the range and relative importance of seven distinct dimensions which are shown…

Antisocial Peer Affiliation and Externalizing Disorders in the Transition from Adolescence to Young Adulthood: Selection versus Socialization Effects

ERIC Educational Resources Information Center

Samek, Diana R.; Goodman, Rebecca J.; Erath, Stephen A.; McGue, Matt; Iacono, William G.

2016-01-01

Prior research has demonstrated both socialization and selection effects for the relationship between antisocial peer affiliation and externalizing problems in adolescence. Less research has evaluated such effects postadolescence. In this study, a cross-lagged panel analysis was used to evaluate the extent of "socialization" (i.e., the…

Enhancing Research Capacity for Global Health: Evaluation of a Distance-Based Program for International Study Coordinators

ERIC Educational Resources Information Center

Wilson, Lynda Law; Rice, Marti; Jones, Carolynn T.; Joiner, Cynthia; LaBorde, Jennifer; McCall, Kimberly; Jester, Penelope M.; Carter, Sheree C.; Boone, Chrissy; Onwuzuligbo, Uzoma; Koneru, Alaya

2013-01-01

Introduction: Due to the increasing number of clinical trials conducted globally, there is a need for quality continuing education for health professionals in clinical research manager (CRM) roles. This article describes the development, implementation, and evaluation of a distance-based continuing education program for CRMs working outside the…

The Design and Evaluation of a Front-End User Interface for Energy Researchers.

ERIC Educational Resources Information Center

Borgman, Christine L.; And Others

1989-01-01

Reports on the Online Access to Knowledge (OAK) Project, which developed software to support end user access to a Department of Energy database based on the skill levels and needs of energy researchers. The discussion covers issues in development, evaluation, and the study of user behavior in designing an interface tailored to a special…

An Approach for Selecting a Theoretical Framework for the Evaluation of Training Programs

ERIC Educational Resources Information Center

Tasca, Jorge Eduardo; Ensslin, Leonardo; Ensslin, Sandra Rolim; Alves, Maria Bernardete Martins

2010-01-01

Purpose: This research paper proposes a method for selecting references related to a research topic, and seeks to exemplify it for the case of a study evaluating training programs. The method is designed to identify references with high academic relevance in databases accessed via the internet, using a bibliometric analysis to sift the selected…

Do Trajectories of Household Risk in Childhood Moderate Pubertal Timing Effects on Substance Initiation in Middle School?

ERIC Educational Resources Information Center

Lynne-Landsman, Sarah D.; Graber, Julia A.; Andrews, Judy A.

2010-01-01

Previous research on pubertal timing has either evaluated contextual predictors of early puberty or negative adjustment outcomes associated with off-time development, especially early maturation. In this study, we integrated these 2 lines of research by evaluating the moderating influence of early childhood household risk on associations between…

Highway concrete pavement technology development and testing : volume IV, field evaluation of Strategic Highway Research Program (SHRP) C-206 test sites (early opening of full-depth pavement repairs).

DOT National Transportation Integrated Search

2006-08-01

The objective of this study was to monitor and evaluate the performance of experimental full-depth repairs made with high-early-strength (HES) materials placed under Strategic Highway Research Program (SHRP) project C-206, Optimization of Highway Con...

Using Simultaneous Prompting and Computer-Assisted Instruction to Teach Story Writing to Students with Autism

ERIC Educational Resources Information Center

Pennington, Robert C.; Ault, Melinda Jones; Schuster, John W.; Sanders, Ann

2011-01-01

In the current study, the researchers evaluated the effects of simultaneous prompting and computer-assisted instruction on the story-writing responses of 3 males with autism, 7 to 10 ears of age. Classroom teachers conducted all probe and training sessions. The researchers used a multiple baseline across participants design to evaluate the…

An Evaluation of the Research Evidence on the Early Start Denver Model

ERIC Educational Resources Information Center

Baril, Erika M.; Humphreys, Betsy P.

2017-01-01

The Early Start Denver Model (ESDM) has been gaining popularity as a comprehensive treatment model for children ages 12 to 60 months with autism spectrum disorders (ASD). This article evaluates the research on the ESDM through an analysis of study design and purpose; child participants; setting, intervention agents, and context; density and…

Perceived Growth versus Actual Growth in Executive Leadership Competencies: An Application of the Stair-Step Behaviorally Anchored Evaluation Approach

ERIC Educational Resources Information Center

McCormick, Michael J.; Dooley, Kim E.; Lindner, James R.; Cummins, Richard L.

2007-01-01

The purpose of this study was to describe student learning in executive leadership core competencies after being engaged in a two-semester leadership education sequence. The researchers used evaluative research techniques to compare perceived and actual growth in learning of executive leadership competencies. Data collection consisted of a…

Using Citation Analysis Methods to Assess the Influence of Science, Technology, Engineering, and Mathematics Education Evaluations

ERIC Educational Resources Information Center

Greenseid, Lija O.; Lawrenz, Frances

2011-01-01

This study explores the use of citation analysis methods to assess the influence of program evaluations conducted within the area of science, technology, engineering, and mathematics (STEM) education. Citation analysis is widely used within scientific research communities to measure the relative influence of scientific research enterprises and/or…

Evaluation of an Action Learning Programme for Leadership Development of SME Leaders in the UK

ERIC Educational Resources Information Center

Stewart, Jean-Anne

2009-01-01

This paper presents the findings from an evaluation research project undertaken by Henley Management College in 2006. This project followed an earlier research study that focused on identifying the leadership development needs for leaders of small and medium sized-enterprises (SMEs) in the UK, developed a leadership development model and made…

A Microscope or a Mirror?: A Question of Study Validity Regarding the Use of Dissertation Citation Analysis for Evaluating Research Collections

ERIC Educational Resources Information Center

Beile, Penny M.; Boote, David N.; Killingsworth, Elizabeth K.

2004-01-01

Use of dissertation citation analysis for collection evaluation was investigated. Analysis of 1842 education dissertation citations from three institutions suggests the assumption of doctoral student expertise in their use of the scholarly literature may be overstated. For purposes of developing research collections, dependence on dissertation…

Collaborative Assessment: Middle School Case Study

ERIC Educational Resources Information Center

Parkison, Paul T.

2014-01-01

Utilizing a participant observer research model, a case study of the efficacy of a collaborative assessment methodology within a middle school social studies class was conducted. A review of existing research revealed that students' perceptions of assessment, evaluation, and accountability influence their intrinsic motivation to learn. A…

Roadmap for the protection of disaster research participants: findings from the World Trade Center Evacuation Study.

PubMed

Qureshi, Kristine A; Gershon, Robyn R M; Smailes, Elizabeth; Raveis, Victoria H; Murphy, Bridgette; Matzner, Frederick; Fleischman, Alan R

2007-01-01

This report addresses the development, implementation, and evaluation of a protocol designed to protect participants from inadvertent emotional harm or further emotional trauma due to their participation in the World Trade Center Evacuation (WTCE) Study research project. This project was designed to identify the individual, organizational, and structural (environmental) factors associated with evacuation from the World Trade Center Towers 1 and 2 on 11 September 2001. Following published recommended practices for protecting potentially vulnerable disaster research participants, protective strategies and quality assurance processes were implemented and evaluated, including an assessment of the impact of participation on study subjects enrolled in the qualitative phase of the WTCE Study. The implementation of a protocol designed to protect disaster study participants from further emotional trauma was feasible and effective in minimizing risk and monitoring for psychological injury associated with study participation. Details about this successful strategy provide a roadmap that can be applied in other post-disaster research investigations.

Learning To Use Scientific Knowledge in Education and Practice Settings: An Evaluation of the Contribution of the Biological Behavioural and Social Sciences to Pre-Registration Nursing and Midwifery Programmes. Researching Professional Education. Research Reports Series Number 3.

ERIC Educational Resources Information Center

Eraut, Michael; And Others

A research project evaluated the contribution of biological, behavioral, and social sciences to nursing and midwifery education programs in Britain. The study of scientific knowledge relevant to recently qualified nurses and midwives was confined to six topics: fluids, electrolytes, and renal systems; nutrition; acute pain; shock; stress; and…

Measuring cognition in teams: a cross-domain review.

PubMed

Wildman, Jessica L; Salas, Eduardo; Scott, Charles P R

2014-08-01

The purpose of this article is twofold: to provide a critical cross-domain evaluation of team cognition measurement options and to provide novice researchers with practical guidance when selecting a measurement method. A vast selection of measurement approaches exist for measuring team cognition constructs including team mental models, transactive memory systems, team situation awareness, strategic consensus, and cognitive processes. Empirical studies and theoretical articles were reviewed to identify all of the existing approaches for measuring team cognition. These approaches were evaluated based on theoretical perspective assumed, constructs studied, resources required, level of obtrusiveness, internal consistency reliability, and predictive validity. The evaluations suggest that all existing methods are viable options from the point of view of reliability and validity, and that there are potential opportunities for cross-domain use. For example, methods traditionally used only to measure mental models may be useful for examining transactive memory and situation awareness. The selection of team cognition measures requires researchers to answer several key questions regarding the theoretical nature of team cognition and the practical feasibility of each method. We provide novice researchers with guidance regarding how to begin the search for a team cognition measure and suggest several new ideas regarding future measurement research. We provide (1) a broad overview and evaluation of existing team cognition measurement methods, (2) suggestions for new uses of those methods across research domains, and (3) critical guidance for novice researchers looking to measure team cognition.

Making the Invisible Visible: A Responsive Evaluation Study of ESL and Spanish Language Services for Immigrants in a Small Rural County in Indiana

ERIC Educational Resources Information Center

Pawan, Faridah; Thomalla, Therese Groff

2005-01-01

This article describes a responsive evaluation study of ESL services and Spanish language services for immigrants in a rural county in Indiana. An ESL specialist led the evaluation of language services in the county from the perspectives of language providers and recipients. The responsive evaluation--a form of action research that uses…

Efficacy methods to evaluate health communication and marketing campaigns.

PubMed

Evans, W Douglas; Uhrig, Jennifer; Davis, Kevin; McCormack, Lauren

2009-06-01

Communication and marketing are growing areas of health research, but relatively few rigorous efficacy studies have been conducted in these fields. In this article, we review recent health communication and marketing efficacy research, present two case studies that illustrate some of the considerations in making efficacy design choices, and advocate for greater emphasis on rigorous health communication and marketing efficacy research and the development of a research agenda. Much of the outcomes research in health communication and marketing, especially mass media, utilizes effectiveness designs conducted in real time, in the media markets or communities in which messages are delivered. Such evaluations may be impractical or impossible, however, imiting opportunities to advance the state of health communication and marketing research and the knowledge base on effective campaign strategies, messages, and channels. Efficacy and effectiveness studies use similar measures of behavior change. Efficacy studies, however, offer greater opportunities for experimental control, message exposure, and testing of health communication and marketing theory. By examining the literature and two in-depth case studies, we identify advantages and limitations to efficacy studies. We also identify considerations for when to adopt efficacy and effectiveness methods, alone or in combination. Finally, we outline a research agenda to investigate issues of internal and external validity, mode of message presentation, differences between marketing and message strategies, and behavioral outcomes.

[Metabolomics research of medicinal plants].

PubMed

Duan, Li-Xin; Dai, Yun-Tao; Sun, Chao; Chen, Shi-Lin

2016-11-01

Metabolomics is the comprehensively study of chemical processes involving small molecule metabolites. It is an important part of systems biology, and is widely applied in complex traditional Chinese medicine（TCM）system. Metabolites biosynthesized by medicinal plants are the effective basis for TCM. Metabolomics studies of medicinal plants will usher in a new period of vigorous development with the implementation of Herb Genome Program and the development of TCM synthetic biology. This manuscript introduces the recent research progresses of metabolomics technology and the main research contents of metabolomics studies for medicinal plants, including identification and quality evaluation for medicinal plants, cultivars breeding, stress resistance, metabolic pathways, metabolic network, metabolic engineering and synthetic biology researches. The integration of genomics, transcriptomics and metabolomics approaches will finally lay foundation for breeding of medicinal plants, R&D, quality and safety evaluation of innovative drug. Copyright© by the Chinese Pharmaceutical Association.

Basic Exploratory Research versus Guideline-Compliant Studies Used for Hazard Evaluation and Risk Assessment: Bisphenol A as a Case Study

PubMed Central

Tyl, Rochelle W.

2009-01-01

Background Myers et al. [Environ Health Perspect 117:309–315 (2009)] argued that Good Laboratory Practices (GLPs) cannot be used as a criterion for selecting data for risk assessment, using bisphenol A (BPA) as a case study. They did not discuss the role(s) of guideline-compliant studies versus basic/exploratory research studies, and they criticized both GLPs and guideline-compliant studies and their roles in formal hazard evaluation and risk assessment. They also specifically criticized our published guideline-compliant dietary studies on BPA in rats and mice and 17β-estradiol (E2) in mice. Objectives As the study director/first author of the criticized E2 and BPA studies, I discuss the uses of basic research versus guideline-compliant studies, how testing guidelines are developed and revised, how new end points are validated, and the role of GLPs. I also provide an overview of the BPA guideline-compliant and exploratory research animal studies and describe BPA pharmacokinetics in rats and humans. I present responses to specific criticisms by Myers et al. Discussion and conclusions Weight-of-evidence evaluations have consistently concluded that low-level BPA oral exposures do not adversely affect human developmental or reproductive health, and I encourage increased validation efforts for “new” end points for inclusion in guideline studies, as well as performance of robust long-term studies to follow early effects (observed in small exploratory studies) to any adverse consequences. PMID:20049112

Discovering the Future of the Case Study Method in Evaluation Research.

ERIC Educational Resources Information Center

Yin, Robert K.

1994-01-01

It is assumed that evaluators of the future will still be interested in case study methodology. Scenarios that ignore a case study method, that look back to a distinctive case study method, and that see the case study method as an integrating force in the qualitative-quantitative debate are explored. (SLD)

Children facing a family member's acute illness: a review of intervention studies.

PubMed

Spath, Mary L

2007-07-01

A review of psycho-educational intervention studies to benefit children adapting to a close (parent, sibling, or grandparent) family member's serious illness was conducted. To review the literature on studies addressing this topic, critique research methods, describe clinical outcomes, and make recommendations for future research efforts. Research citations from 1990 to 2005 from Medline, CINAHL, Health Source: Nursing/Academic Edition, PsycARTICLES, and PsycINFO databases were identified. Citations were reviewed and evaluated for sample, design, theoretical framework, intervention, threats to validity, and outcomes. Reviewed studies were limited to those that included statistical analysis to evaluate interventions and outcomes. Six studies were reviewed. Positive outcomes were reported for all of the interventional strategies used in the studies. Reviewed studies generally lacked a theoretical framework and a control group, were generally composed of small convenience samples, and primarily used non-tested investigator instruments. They were diverse in terms of intervention length and intensity, and measured short-term outcomes related to participant program satisfaction, rather than participant cognitive and behavioral change. The paucity of interventional studies and lack of systematic empirical precision to evaluate intervention effectiveness necessitates future studies that are methodologically rigorous.

Using Eye Trackers for Usability Evaluation of Health Information Technology: A Systematic Literature Review

PubMed Central

Yang, Yushi

2015-01-01

Background Eye-tracking technology has been used to measure human cognitive processes and has the potential to improve the usability of health information technology (HIT). However, it is still unclear how the eye-tracking method can be integrated with other traditional usability methodologies to achieve its full potential. Objective The objective of this study was to report on HIT evaluation studies that have used eye-tracker technology, and to envision the potential use of eye-tracking technology in future research. Methods We used four reference databases to initially identify 5248 related papers, which resulted in only 9 articles that met our inclusion criteria. Results Eye-tracking technology was useful in finding usability problems in many ways, but is still in its infancy for HIT usability evaluation. Limited types of HITs have been evaluated by eye trackers, and there has been a lack of evaluation research in natural settings. Conclusions More research should be done in natural settings to discover the real contextual-based usability problems of clinical and mobile HITs using eye-tracking technology with more standardized methodologies and guidance. PMID:27026079

[Sample size calculation in clinical post-marketing evaluation of traditional Chinese medicine].

PubMed

Fu, Yingkun; Xie, Yanming

2011-10-01

In recent years, as the Chinese government and people pay more attention on the post-marketing research of Chinese Medicine, part of traditional Chinese medicine breed has or is about to begin after the listing of post-marketing evaluation study. In the post-marketing evaluation design, sample size calculation plays a decisive role. It not only ensures the accuracy and reliability of post-marketing evaluation. but also assures that the intended trials will have a desired power for correctly detecting a clinically meaningful difference of different medicine under study if such a difference truly exists. Up to now, there is no systemic method of sample size calculation in view of the traditional Chinese medicine. In this paper, according to the basic method of sample size calculation and the characteristic of the traditional Chinese medicine clinical evaluation, the sample size calculation methods of the Chinese medicine efficacy and safety are discussed respectively. We hope the paper would be beneficial to medical researchers, and pharmaceutical scientists who are engaged in the areas of Chinese medicine research.

Junior and Community College Research, Texas, 1980-81. The 1981 Research Report to the Texas Association of Junior and Community College Instructional Administrators.

ERIC Educational Resources Information Center

Texas Association of Junior and Community Coll. Instructional Administrators.

Reports and abstracts are presented for research conducted during 1981 on community college education in Texas. Four institutional research reports are provided first: an evaluation of the effectiveness of the developmental studies program at North Harris County College; a study of retention patterns at Amarillo College by Stanley Adelman and Kay…

The Case Study as Research Heuristic: Lessons from the R&D Value Mapping Project.

ERIC Educational Resources Information Center

Bozeman, Barry; Klein, Hans K.

1999-01-01

Examines the role of prototype case studies as the foundation for later evaluation through two studies from the "R&D Value Mapping Project," a study that will involve more than 30 cases. Explores the usefulness of case studies in defining and assessing subsequent research efforts. (SLD)