Through a comparative study of the United Kingdom and Spain, this article addresses the effect of different research governance structures on the functioning and uses of research evaluation. It distinguishes three main evaluation uses: distributive, improvement, and controlling. Research evaluation in the United Kingdom plays important…
Hogle, Janice A; Moberg, D Paul
The success case studies approach examines in depth what works well in a program by describing cases and examining factors leading to successful outcomes. In this article, we describe the use of success case studies as part of an evaluation of the transformation of a health sciences research support infrastructure. Using project-specific descriptions and the researchers' perceptions of the impact of improved research infrastructure, we added depth of understanding to the quantitative data required by funding agencies. Each case study included an interview with the lead researcher, along with review of documents about the research, the investigator, and their collaborators. Our analyses elucidated themes regarding contributions of the Clinical and Translational Science Awards program of the National Institutes of Health to scientific achievements and career advancement of investigators in one academic institution.
Radhakrishna, Rama; Tobin, Daniel; Brennan, Mark; Thomson, Joan
This article presents a checklist as a guide for Extension professionals to use in research and evaluation studies they carry out. A total of 40 statements grouped under eight data quality components--relevance, objectivity, validity, reliability, integrity, generalizability, completeness, and utility--are identified to ensure that research…
Kalton, Graham; Piesse, Andrea
Survey research methods are widely used in two types of analytic studies: evaluation studies that measure the effects of interventions; and population-based case-control studies that investigate the effects of various risk factors on the presence of disease. This paper provides a broad overview of some design and analysis issues related to such studies, illustrated with examples. The lack of random assignment to treatment and control groups in many evaluation studies makes controlling for confounders critically important. Confounder control can be achieved by matching in the design and by various alternative methods in the analysis. One popular analytic method of controlling for confounders is propensity scoring, which bears a close resemblance to survey weighting. The use of population-based controls has become common in case-control studies. For reasons of cost, population-based controls are often identified by telephone surveys using random digit dialling (RDD) sampling methods. However, RDD surveys are now experiencing serious problems with response rates. A recent alternative approach is to select controls from frames such as driver license lists that contain valuable demographic information for use in matching. Methods of analysis developed in the survey sampling literature are applicable, at least to some degree, in the analyses of evaluation and population-based case-control studies. In particular, the effects of complex sample designs can be taken into account using survey sampling variance estimation methods. Several survey analysis software packages are available for carrying out the computations.
Wildemuth, Barbara M., Comp.
Resources in Education was computer searched in order to identify documents which reported evaluation research carried out by forty large school districts in the United States and Canada. The citations are grouped by the name of the reporting school district. Each of the 149 references is abstracted and a subject index is provided. (MV)
... AFFAIRS Clinical Science Research and Development Service Cooperative Studies Scientific Evaluation... (Federal Advisory Committee Act) that a meeting of the Clinical Science Research and Development Service... Research and Development Officer through the Director of the Clinical Science Research and...
... No: 2012-12522] DEPARTMENT OF VETERANS AFFAIRS Clinical Science Research and Development Service... Science Research and Development Service Cooperative Studies Scientific Evaluation Committee will be held... Research and Development Officer through the Director of the Clinical Science Research and...
... AFFAIRS Clinical Science Research and Development Service; Cooperative Studies Scientific Evaluation... (Federal Advisory Committee Act) that a meeting of the Clinical Science Research and Development Service... Committee advises the Chief Research and Development Officer through the Director of the Clinical...
... AFFAIRS Clinical Science Research and Development Service Cooperative Studies Scientific Evaluation... (Federal Advisory Committee Act) that a meeting of the Clinical Science Research and Development Service... Science Research and Development Service on the relevance and feasibility of proposed projects and...
... AFFAIRS Clinical Science Research and Development Service; Cooperative Studies Scientific Evaluation... (Federal Advisory Committee Act) that a meeting of the Clinical Science Research and Development Service... Clinical Science Research and Development Service on the relevance and feasibility of proposed projects...
... AFFAIRS Clinical Science Research and Development Service; Cooperative Studies Scientific Evaluation... (Federal Advisory Committee Act) that a meeting of the Clinical Science Research and Development Service... Clinical Science Research and Development Service on the relevance and feasibility of proposed projects...
... AFFAIRS Clinical Science Research and Development Service Cooperative Studies Scientific Evaluation... Committee Act, 5 U.S.C. App. 2, that the Clinical Science Research and Development Service Cooperative... Research and Development Officer through the Director of the Clinical Science Research and...
... AFFAIRS Clinical Science Research and Development Service Cooperative Studies Scientific Evaluation... Committee Act, 5 U.S.C. App. 2, that the Clinical Science Research and Development Service Cooperative... Chief Research and Development Officer through the Director of the Clinical Science Research...
Wildemuth, Barbara M., Comp.
Limited to documents announced in Resources in Education from April 1977 to March 1978, this annotated bibliography covers a broad spectrum of reports generated directly or indirectly by 66 large school districts in the United States and Canada. The reports include descriptions and evaluations of bilingual, early childhood, compensatory, and…
Taylor, Brian; Wylie, Emma; Dempster, Martin; Donnelly, Michael
Objective: Developing the scientific underpinnings of social welfare requires effective and efficient methods of retrieving relevant items from the increasing volume of research. Method: We compared seven databases by running the nearest equivalent search on each. The search topic was chosen for relevance to social work practice with older people.…
... AFFAIRS Clinical Science Research and Development Service Cooperative Studies Scientific Evaluation... Committee Act, 5 U.S.C. App. 2, that the Clinical Science Research and Development Service Cooperative... Clinical Science Research and Development Service on the relevance and feasibility of proposed projects...
... AFFAIRS Clinical Science Research and Development Service Cooperative Studies; Scientific Evaluation... Committee Act, 5 U.S.C. App. 2, that the Clinical Science Research and Development Service Cooperative... the Director of the Clinical Science Research and Development Service on the relevance and...
Arthur, Linet; Cox, Elaine
Traditionally there has been a tension between evaluation research and so-called pure research which has resulted in evaluation research seldom being recognized by the UK Research Assessment Exercises. The newly configured Research Excellence Framework (REF) will use similar criteria to judge research, notwithstanding the introduction of…
Three research studies examined the impact of environmental interpretation programs on the environmental knowledge, attitudes, and behaviors of student participants. Conducted by Indiana University's Department of Recreation and Park Administration, the studies evaluated variables related to entry level (awareness), ownership, and empowerment…
Hulshof, C. T.; Verbeek, J. H.; van Dijk, F. J.; van der Weide, W. E.; Braam, I. T.
OBJECTIVES: To study the nature and extent of evaluation research in occupational health services (OHSs). METHODS: Literature review of evaluation research in OHSs. On the basis of a conceptual model of OHS evaluation, empirical studies are categorised into aspects of input, process, output, outcome, and OHS core activities. RESULTS: Many methods to evaluate OHSs or OHS activities exist, depending on the objective and object of evaluation. The amount of empirical studies on evaluation of OHSs or OHS activities that met the non-restrictive inclusion criteria, was remarkably limited. Most of the 52 studies were more descriptive than evaluative. The methodological quality of most studies was not high. A differentiated picture of the evidence of effectiveness of OHSs arises. Occupational health consultations and occupational rehabilitation are hardly studied despite much time spent on the consultation by occupational physicians in most countries. The lack of effectiveness and efficiency of the pre-employment examination should lead to its abandonment as a means of selection of personnel by OHSs. Periodic health monitoring or surveillance, and education on occupational health hazards can be carried out with reasonable process quality. Identification and evaluation of occupational health hazards by a workplace survey can be done with a high output quality, which, however, does not guarantee a favourable outcome. CONCLUSIONS: Although rigorous study designs are not always applicable or feasible in daily practice, much more effort should be directed at the scientific evaluation of OHSs and OHS instruments. To develop evidence-based occupational health care the quality of evaluation studies should be improved. In particular, process and outcome of consultation and rehabilitation activities of occupational physicians need to be studied more. PMID:10474531
Chen, Peiyao; Weiss, Faedra Lazar; Nicholson, Heather Johnston
Between 2004 and 2007, Girls Incorporated conducted research about the experience of five affiliates from different parts of the United States as they engaged with girls in Girls Study Girls Inc., a participatory evaluation project that explored the meaning and impact of Girls Inc. environments and uncovered ways such environments can be improved. We describe the context and motivation for using participatory action research [PAR] in Girls Inc. environments and discuss the relevance and importance of PAR for organizations that empower girls and young women. We explain the process of training and engaging Girls Inc. members in research, discuss the effectiveness of Girls Study Girls Inc. as an evaluation strategy, and conclude this article with lessons learned and recommendations for using PAR in evaluating youth development programs.
van Besouw, Rachel M.; Rogers, Katrine S.; Powles, Christopher J.; Papadopoulos, Timos; Ku, Emery M.
This paper considers the importance of providing technical training opportunities for Early Career Researchers (ECRs) worldwide through the case study of a MATLAB training programme, which was proposed, organised, managed and evaluated by a team of five ECRs at the University of Southampton. The effectiveness of the programme in terms of the…
Russell, Cynthia L
As a novice reviewer, it is often difficult to trust your evaluation of a research report. You may feel uncertain in your interpretations. These are common concerns and can be remedied by reading and discussing research reports on research listservs, through journal clubs, or with other nephrology nurses. Practice using the criteria for research report evaluation and you too can perfect critiquing a research report!
Background The increase in the volume of research conducted in Low and Middle Income Countries (LMIC), has brought a renewed international focus on processes for ethical conduct of research. Several programs have been initiated to strengthen the capacity for research ethics in LMIC. However, most such programs focus on individual training or development of ethics review committees. The objective of this paper is to present an approach to institutional capacity assessment in research ethics and application of this approach in the form of a case study from an institution in Africa. Methods We adapted the Octagon model originally used by the Swedish International Development Cooperation Agency to assess an organization along eight domains in research ethics: basic values and identity; structure and organization; ability to carry out activities; relevance of activities to stated goals; capacity of staff and management; administrative, financing and accounting systems; its relations with target groups; and the national context. We used a mixed methods approach to collect empirical data at the University of Botswana from March to December 2010. Results The overall shape of the external evaluation Octagon suggests that strengths of the University of Botswana are in the areas of structure, relevance, production and identity; while the university still needs more work in the areas of systems of finance, target groups, and environment. The Octagons also show the similarities and discrepancies between the 'external' and 'internal' evaluations and provide an opportunity for exploration of these different assessments. For example, the discrepant score for 'identity' between internal and external evaluations allows for an exploration of what constitutes a strong identity for research ethics at the University of Botswana and how it can be strengthened. Conclusions There is a general lack of frameworks for evaluating research ethics capacity in LMICs. We presented an approach that
Kwan, Becky S. C.; Chan, Hang; Lam, Colin
Evaluations of prior scholarship play a crucial role in the literature review (LR) of a research article by showing how the boundary of an area of inquiry can be further advanced by the writer's work. Yet, many inexperienced writers find evaluating others' work a major challenge. Although the task has received some attention in research and…
Burghaus, S.; Fehm, T.; Fasching, P. A.; Blum, S.; Renner, S. K.; Baier, F.; Brodkorb, T.; Fahlbusch, C.; Findeklee, S.; Häberle, L.; Heusinger, K.; Hildebrandt, T.; Lermann, J.; Strahl, O.; Tchartchian, G.; Bojahr, B.; Porn, A.; Fleisch, M.; Reicke, S.; Füger, T.; Hartung, C.-P.; Hackl, J.; Beckmann, M. W.; Renner, S. P.
Introduction: Endometriosis is a heterogeneous disease characterized by a range of different presentations. It is usually diagnosed when patients present with pain and/or infertility, but it has also been diagnosed in asymptomatic patients. Because of the different diagnostic approaches and diverse therapies, time to diagnosis can vary considerably and the definitive diagnosis may be delayed, with some cases not being diagnosed for several years. Endometriosis patients have many unmet needs. A systematic registration and follow-up of endometriosis patients could be useful to obtain an insight into the course of the disease. The validation of biomarkers could contribute to the development of diagnostic and predictive tests which could help select patients for surgical assessment earlier and offer better predictions about patients who might benefit from medical, surgical or other interventions. The aim is also to obtain a better understanding of the etiology, pathogenesis and progression of the disease. Material and Methods: To do this, an online multicenter documentation system was introduced to facilitate the establishment of a prospective multicenter case-control study, the IEEP (International Endometriosis Evaluation Program) study. We report here on the first 696 patients with endometriosis included in the program between June 2013 and June 2015. Results: A documentation system was created, and the structure and course of the study were mapped out with regard to data collection and the collection of biomaterials. Conclusion: The documentation system permits the history and clinical data of patients with endometriosis to be recorded. The IEEP combines this information with biomaterials and uses it for scientific studies. The recorded data can also be used to evaluate clinical quality control measures such as the certification parameters used by the EEL (European Endometriosis League) to assess certified endometriosis centers. PMID:27582581
Puma, Jini; Bennett, Laurie; Cutforth, Nick; Tombari, Chris; Stein, Paul
This instrumental case study documents a community-based participatory evaluation research (CBPER) project that involved a community partner, two graduate students, a faculty member, and an external funder. It highlights the fact that a participatory evaluation model is a viable way to conduct community-based research (CBR) when a community…
Background: Action Research about my 2nd grade classroom in the Buffalo School District. I examined three areas of interest and tried to find some conclusions related to behavior management. Purpose: The purpose of this study is how will implementing procedures, rules, and consequences help improve student behavior. Research Design: Descriptive;…
Marceau, Lisa D; Welch, Lisa C; Pemberton, Victoria L; Pearson, Gail D
A gap in information about pediatric clinical trials exists, and parents remain uncertain about what is involved in research studies involving children. We aimed to understand parent perspectives about pediatric clinical research after viewing the online Children and Clinical Studies (CaCS) program. Using a qualitative descriptive study design, we conducted focus groups with parents and phone interviews with physicians. Three themes emerged providing approaches to improve parent's understanding of clinical research by including strategies where parents (a) hear from parents like themselves to learn about pediatric research, (b) receive general clinical research information to complement study-specific details, and (c) are provided more information about the role of healthy child volunteers. Parents found the website a valuable tool that would help them make a decision about what it means to participate in research. This tool can assist parents, providers, and researchers by connecting general information with study-specific information.
Fawcett, Stephen B.; And Others
Research findings have been used by states to formulate legislation to increase child passenger safety. Case studies from Kansas and Illinois are presented. The process is most successful when researchers are sensitive to the policy making process. The implications for the use of psychological research findings are discussed. (VM)
Yin, Robert K.
It is assumed that evaluators of the future will still be interested in case study methodology. Scenarios that ignore a case study method, that look back to a distinctive case study method, and that see the case study method as an integrating force in the qualitative-quantitative debate are explored. (SLD)
Kelly, Susan E.; Spector, Timothy D.; Cherkas, Lynn F.; Prainsack, Barbara; Harris, Juliette M.
Objectives To establish the views of research volunteers on the consent process; to explore their views on the consent process in different research scenarios; to inform debate on emerging models of consent for participation in research. Design, Setting and Participants 2,308 adult volunteers from the TwinsUK Registry (www.twinsuk.ac.uk) completed an online survey about their views on the consent process for use of their DNA and medical information in research. Their views on the re-consenting process in different scenarios were assessed. Results The majority of volunteers preferred to be informed of the identity of the main researcher of a study in which they are participating, which is contrary to current practice. Over 80% were willing to complete the consent process online instead of face to face. On the whole, respondents did not view their DNA differently from their medical information with regard to the consent process. Research participants were more willing to give broad consent to cover future research if their DNA was to be used by the original researcher than by another researcher, even if the disease under investigation varied, in contrast to the traditional ‘gold standard’ whereby specific consent is required for all new research projects. Discussion In some scenarios, research participants reported that they would be comfortable with not signing a new consent form for future research uses of their data and DNA, and are comfortable with secure, online consent processes rather than traditional face-to-face consent processes. Our findings indicate that the perceived relationship between research participants and researchers plays an important role in shaping preferences regarding the consent process and suggest that this relationship is not captured by traditional consent processes. We argue that the development of new formats of consent should be informed by empirical research on volunteers’ perceptions and preferences regarding the consent
Padilla, Luz A.; Venkatesh, Raam; Daniel, Casey L.; Desmond, Renee A.; Brooks, C. Michael; Waterbor, John W.
The need to familiarize medical students and graduate health professional students with research training opportunities that cultivate the appeal of research careers is vital to the future of research. Comprehensive evaluation of a cancer research training program can be achieved through longitudinal tracking of program alumni to assess the program’s impact on each participant’s career path and professional achievements. With advances in technology and smarter means of communication, effective ways to track alumni have changed. In order to collect data on the career outcomes and achievements of nearly 500 short-term cancer research training program alumni from 1999–2013, we sought to contact each alumnus to request completion of a survey instrument online, or by means of a telephone interview. The effectiveness of each contact method that we used was quantified according to ease of use and time required. The most reliable source of contact information for tracking alumni from the early years of the program was previous tracking results; and for alumni from the later years, the most important source of contact information was university alumni records that provided email addresses and telephone numbers. Personal contacts with former preceptors were sometimes helpful, as were generic search engines and people search engines. Social networking was of little value for most searches. Using information from two or more sources in combination was most effective in tracking alumni. These results provide insights and tools for other research training programs that wish to track their alumni for long-term program evaluation. PMID:25412722
The Information Exchange Procedures (IEP) cost study project of the National Center for Higher Education Management Systems is described and its applicability to six major research universities (MRU) is assessed in this pilot study. The IEP enables peer institutions to compare information about their resources, activities, and educational…
Electronic health records and the Internet will continue to transform how information is accessed and shared. Users of health data such as health professionals, governments, policymakers, researchers and patients themselves need to be able to access the right information at the right time and be confident in the quality of that information, whether personal, aggregated or knowledge based. It is essential to evaluate information systems and applications that claim to improve information quality and access in order to provide evidence that they support healthcare delivery and improve patient outcomes.
challenges and policy options. The most profound insights gleaned from historical analysis will not come as a surprise to many: 1. DoDs actual future needs... HISTORICAL PERSPECTIVES: A REVIEW AND EVALUATION OF 76 STUDIES OF THE DEFENSE RESEARCH ENTERPRISE, 1945-2015 CAMERON KEYS PRESIDENTIAL...relevant historical detail, and prominent policy tensions are emphasized. Views expressed in summaries and evaluations represent only those of the
Taylor, James C.
This is an interim report on the current output of the MRM evaluation research program. During 1998 this research program has used new and existing data to create an important tool for the development and improvement of "maintenance resource management" (MRM). Thousands of surveys completed by participants in airline MRM training and/or behavior change programs have, for the first time, been consolidated into a panel of "MRM Attitudes and Opinion Profiles." These profiles can be used to compare the attitudes about decision making and communication in any given company at any stage in its MRM program with attitudes of a large sample of like employees during a similar period in their MRM involvement. This panel of comparison profiles for attitudes and opinions is a tool to help audit the effectiveness of a maintenance human factors program. The profile panel is the first of several tools envisioned for applying the information accumulating in MRM databases produced as one of the program's long range objectives.
Dowda, Marsha; Sallis, James F.; McKenzie, Thomas L.; Rosengard, Paul; Kohl, Harold W., III
Dissemination and sustainability of evidence-based physical education programs (PE) has been studied rarely. The sustainability of a health-related PE program (SPARK) was independently evaluated in 111 elementary schools in 7 states. Surveys were mailed to schools that had received SPARK curriculum books, training, and follow-up (response rate =…
García Romero, Antonio
The evaluation of R + D activities and the politics that promote them is essential to justify the investment done as well as to optimize their results. In this context, the evaluation should be understood as the group of techniques and procedures that allow obtaining useful information to take decisions in the field of R + D. This article has two main objectives: (i) to present the basic concepts associated with the evaluation of research, and (ii) to offer a general and updated panoramic view of which are the most frequently used methods to evaluate research. For that, in addition to considering the most conventional evaluation, focused on scientific results, we also think about the need of evaluating the impacts that scientific results generate on the social-economic context, and that in the case of biomedical research, these may be presented in terms of quality and life expectancy, improvements in patient care, etc. Therefore, the motivation of present article is to give a modern and updated perspective that allows the reader who is interested to study in-depth this emerging field of Science, if he/she wants.
Beckford-Young, Paulette Vivienne
The purpose of this action research study was to conduct a professional development activity to provide content-area teachers with academic vocabulary strategies to be implemented during instruction on a daily basis. Professional development is essential for teachers to gain new knowledge and skills in order to hone their craft to improve student…
Brown, David Richard; Hernández, Agueda; Saint-Jean, Gilbert; Evans, Siân; Tafari, Ida; Brewster, Luther G; Celestin, Michel J; Gómez-Estefan, Carlos; Regalado, Fernando; Akal, Siri; Nierenberg, Barry; Kauschinger, Elaine D; Schwartz, Robert; Page, J Bryan
Healthy People 2010 made it a priority to eliminate health disparities. We used a rapid assessment response and evaluation (RARE) to launch a program of participatory action research focused on health disparities in an urban, disadvantaged Black community serviced by a major south Florida health center. We formed partnerships with community members, identified local health disparities, and guided interventions targeting health disparities. We describe the RARE structure used to triangulate data sources and guide intervention plans as well as findings and conclusions drawn from scientific literature and epidemiological, historic, planning, clinical, and ethnographic data. Disenfranchisement and socioeconomic deprivation emerged as the principal determinants of local health disparities and the most appropriate targets for intervention.
Brown, David Richard; Hernández, Agueda; Saint-Jean, Gilbert; Evans, Siân; Tafari, Ida; Brewster, Luther G.; Celestin, Michel J.; Gómez-Estefan, Carlos; Regalado, Fernando; Akal, Siri; Nierenberg, Barry; Kauschinger, Elaine D.; Schwartz, Robert; Page, J. Bryan
Healthy People 2010 made it a priority to eliminate health disparities. We used a rapid assessment response and evaluation (RARE) to launch a program of participatory action research focused on health disparities in an urban, disadvantaged Black community serviced by a major south Florida health center. We formed partnerships with community members, identified local health disparities, and guided interventions targeting health disparities. We describe the RARE structure used to triangulate data sources and guide intervention plans as well as findings and conclusions drawn from scientific literature and epidemiological, historic, planning, clinical, and ethnographic data. Disenfranchisement and socioeconomic deprivation emerged as the principal determinants of local health disparities and the most appropriate targets for intervention. PMID:18048802
Ganong, Lawrence H.; Coleman, Marilyn
Sees important aspect of graduate education as learning how to evaluate quality and validity of research. Notes that study of families presents particular challenges. Examines three methods to teach students to critique family research. Sees all three as holding promise in teaching students how to evaluate family research and notes that all three…
Marx, Gary E.
The No Child Left Behind emphasis on teacher quality and its relationship to student achievement has made teacher evaluation an area of increased concern for today's high school principal. Numerous problems associated with the evaluation of teachers have been cited in the literature, including lack of agreement on what constitutes good teaching,…
Franklin, Margery; Cobb, Judith
A current exploratory research project is directed toward developing means for gathering systematic data on nonverbal representation in young children. Tasks involving nonverbal representational functioning have been developed, evaluated in preliminary work with fifteen 4-year-old subjects, and revised. The revised series of tasks consists of four…
Alcaraz, Kassandra I; Weaver, Nancy L; Andresen, Elena M; Christopher, Kara; Kreuter, Matthew W
The Neighborhood Voice is a vehicle customized for conducting health research in community settings. It brings research studies into neighborhoods affected most by health disparities and reaches groups often underrepresented in research samples. This paper reports on the experience and satisfaction of 599 African American women who participated in research on board the Neighborhood Voice. Using bivariate, psychometric, and logistic regression analyses, we examined responses to a brief post-research survey. Most women (71%) reported that they had never previously participated in research, and two-thirds (68%) rated their Neighborhood Voice experience as excellent. Satisfaction scores were highest among first-time research participants (p < .05). Women's ratings of the Neighborhood Voice on Comfort (OR = 4.9; 95% CI = 3.0, 7.9) and Convenience (OR = 1.8; 95% CI = 1.2, 2.9) significantly predicted having an excellent experience. Mobile research facilities may increase participation among disadvantaged and minority populations. Our brief survey instrument is a model for evaluating such outreach.
Bhawsar, Sanjay Vasant; Marathe, Ashlesha Subhash; Ansari, Sadekh Abdul
Statement of Problem: The accuracy and reliability of the methods used for programming the semi-adjustable articulators determine the accuracy in occlusion. The current recommended average settings using the Hanau's formula commonly used by clinicians is questionable, and thus reassessment is needed. This study was carried out to evaluate and compare the lateral condylar guidance: (1) Using the Hanau's formula and the computerized jaw tracking device (Kinesiograph). (2) On the right and left sides using both these methods. Materials and Methods: A total of 20 completely edentulous patients (14 male and 6 females) within 40–60 years of age were selected. Jaw relation was recorded followed by face bow transfer. Extraoral Gothic arch tracing was recorded; three protrusive records were obtained and condylar guidance was calculated. Lateral condylar guidance was then calculated using Hanau's formula, followed by the computerized jaw tracking device. A comparative evaluation was done of the obtained values. The same investigator worked with each of the study participants for the purpose of standardization. Results: The lateral condylar guidance values obtained using the Hanau's formula ranged from 14 to 17° while those obtained using the computerized K7 jaw tracking device ranged from 8 to 40°. Bennett angle values, obtained using the jaw tracking device and Hanau's formula showed statistically significant differences (P < 0.05) using paired t-test (at 95% confidence interval). Bennett angle values of the right and left sides found using the Hanau's formula were almost similar. Difference in the Bennett angle values of the right and left sides were found using the jaw tracking device. However, this difference was not statistically significant (P > 0.05). Conclusion: Based on the results, dentist and dental technicians should consider reassessing the current recommended average settings and use of the Hanau's formula for programming the semi-adjustable articulators
Patton, Michael Quinn
This monograph is one of a continuing series initiated to provide materials for teachers, parents, school administrators, and governmental decision-makers that might encourage reexamination of a range of evaluation issues and perspectives about schools and schooling. This monograph is a description and analysis of two contrasting paradigms: one…
Beck, C T
General criteria for evaluating a research report are addressed. This outline of criteria can be used as a guide for nurses in critiquing research studies. A sample research report is summarized followed by a critique of the study. Readers have an opportunity to practice critiquing by doing their own analyses before reading the critique presented in the article.
Fenton, Evelyn; Harvey, Janet; Sturt, Jackie
This paper presents a conceptual framework and tool kit, generated from the evaluation of five primary care research networks (PCRNs) funded by the then London, National Health Service (NHS) Executive. We employed qualitative methods designed to match the most important characteristics of PCRNs, conducting five contextualized case studies covering the five networks. A conceptual evaluation framework based on a review of the organization science literature was developed and comprised the broad, but inter-related organizational dimensions of structure, processes, boundaries and network self-evaluation as input factors and strategic emphasis as epitomized by network objectives. These dimensions were comprised of more detailed subdimensions designed to capture the potential of the networks to create ideas and knowledge, or intellectual capital, the key construct upon which our evaluation tool kit was based. We considered the congruence, or fit, between network objectives and input factors: greater congruence implied greater ability to achieve implicit and overt objectives. We conclude that network evaluation must take place, over time, recognizing stage of development and potential for long-term viability, but within a generic framework of inputs and outputs. If there is a good fit or congruence between their input factors and network objectives, networks will be internally coherent and able to operate at optimum effectiveness.
Hirose, Akihiko; Nishimura, Tetsuji; Kanno, Jun
Manufactured nanomaterials are one of the most important substances for the nanotechnology. The nanomaterials possess different physicochemical properties from bulk materials. The new properties may lead to novel biological effects and also may or may not cause unknown adverse effects. However, the toxicological evidences are very limited, and there are no standardized evaluation methods at present. Some domestic and international activities are ongoing, in order to share the information or to standardize the methods. In 2005, our institute launched the research on the establishment of health risk assessment methodology of manufactured nanomaterials by funding from the research grants of the Japanese Ministry of Health, Labour and Welfare. The project contains four themes. The first is development of measurement methods of nanomaterials from biological samples. The second is development of dispersion methods in in vitro systems. The third is development of inhalation exposure systems. And the last is development of in vivo systems for evaluating long-term health effects. As evaluation materials, fullerene, titanium oxide and multi-walled carbon nanotubes were chosen because of their high production volumes. In the course of the research project, we revealed that the nanomaterials were competent to cause chronic effects, by analyzing intraperitoneal administration studies and carcinogenic promotion studies. These studies suggested that even aggregated nanomaterials were crumbled into nano-sized particles inside the body during the long-term, and the particles were transferred to other organs. Additionally, long lasting particles/fibers in the particular tissues may cause chronic adverse effects. The phsyco-chemical properties or toxicity mechanism related with these chronic effects were considered to be different from those properties or mechanism related to acute toxicity. Therefore, we suggested that the toxicological characterization of chronic effects by
Effort since the last progress report (September 1979) has been directed toward assessing the potential short and long term benefits of continued development and application and medical research of emission computed tomograhy (ECT). This report contains a review of existing ECT technology, including functional descriptions of current and proposed image systems, for both sngle-photon ECT (SPECT) and positron ECT (PECT) approaches. Medical research and clinical topics to which ECT has been, or may be, applied are presented. One such area of investigation involves the effects of stroke. The application of ECT to laboratory research, and to clinical diagnosis and prognosis, of stroke may result in improved management of the disease. An illustration of the potential savings in the cost of management of stroke due to the effects of applied ECT research is included. The results represent a compilation of data collected from conversations with, and conference presentations by, ECT users, researchers and image system designers, and from a review of the literature.
Enoch, Jay M.; Giraldez, Maria J.; Huang, Doahua; Hirose, Hiroshi; Knowles, Richard A.; Namperumalsamy, P.; LaBree, Lauri; Azen, Stanley P.
Using high luminance point-of-light stimuli, Vernier judgments can be made in the presence of markedly degraded retinal imagery. Without coaching, observers perform center-of-gravity assessments of relative locations of degraded point images. We seek to defined, presurgery, individuals who will derive the most benefit from advanced cataract removal (a form of triage), and to determine which of two cataractous eyes has the better postsurgical visual prognosis. There are incredible and growing backlogs of patients with severe cataracts (and other dense media opacities) in the developing world, and generally, limited resources are available for provision of health care. Postcataract surgical failure rates for good visual function are often high, and only one eye is operated on in over 95% of indigent patients treated. Prior to initiating advanced studies in the developing world, at Berkeley we conducted preliminary research on Vernier acuity test techniques on normal adult subjects. We sought to determine the number of repeat trials necessary; to compare a two-point and a three-point Vernier display; to determine the shape of the measured response function at large gap separations between test points (required when testing advanced cataract patients); to assess the effect(s) of a broad range of uncorrected refractive errors on outcomes; and to consider means to minimize refraction-based errors. From these and prior data and analyses, we defined a protocol for use in the developing world. Using a newly designed and rugged precision instrument, these tests were repeated on an advanced cataract population at Aravind Eye Hospital in Madurai, India. Although we had much prior experience in India, the initial protocol required major revision on site. Necessary changes in test methods and analytical approaches were made, and next stages in this program were planned. And a new and simple gap `visual acuity' (gap `VA') test was added to the protocol, which greatly facilitated
Mo, Hong-yuan; Wang, Ying-jie; Yu, Zhuo-yuan
The Poverty Alleviation Monitoring and Evaluation System (PAMES) is introduced in this paper. The authors present environment platform selection, and details of system design and realization. Different with traditional research of poverty alleviation, this paper develops a new analytical geo-visualization approach to study the distribution and causes of poverty phenomena within Geographic Information System (GIS). Based on the most detailed poverty population data, the spatial location and population statistical indicators of poverty village in Jiangxi province, the distribution characteristics of poverty population are detailed. The research results can provide much poverty alleviation decision support from a spatial-temporal view. It should be better if the administrative unit of poverty-stricken area to be changed from county to village according to spatial distribution pattern of poverty.
Research literature highlights the principal as central to teacher evaluation. However, principal reports do not provide adequate information to document teacher quality. Good teacher evaluation adds multiple data sources such as client surveys, peer reviews of materials, and pupil achievement data, which vary by teacher and setting. Principals…
Schwab, Richard L., Ed.
Seven papers focus on the relationship between research on effective instruction and teacher evaluation (TE). The first two articles depart from previous articles by M. Scriven; the others reflect new research. Topics include using rating scales in TE, improving instruction, at-risk and expert teachers, and supervisor critiquing. (SLD)
From 1932 to 1940, the Progressive Education Association (PEA) conducted its Eight-Year Study. At first, the study appeared to be a poorly funded comparison of two groups of students in secondary schools. During the last four years, as more financial support became available, the Eight-Year Study became a broadly based demonstration of a wide…
Isbell, Kellie; Trutko, John W.; Barnow, Burt S.; Nightengale, Demetra; Pindus, Nancy
This document contains in-depth descriptions and assessments of 17 exemplary employer-based training (EBT) programs that were studied as part of an examination of EBT programs. The case studies are based on site visits to each firm, during which interviews were conducted with company management, supervisors of workers in training, individuals…
Bechar, Shlomit; Mero-Jaffe, Irit
In this paper we share our reflections, as evaluators, on an evaluation where we encountered Excessive Evaluation Anxiety (XEA). The signs of XEA which we discerned were particularly evident amongst the program head and staff who were part of a new training program. We present our insights on the evaluation process and its difficulties, as well as…
Johnson, Terry; Gritz, Mark; Jackson, Russell; Burghardt, John; Boussy, Carol; Leonard, Jan; Orians, Carlyn
This report presents results of a process analysis that describes and documents Job Corps services and operations. Chapter one provides overviews of Job Corps, the national Job Corps study, and the process analysis. Chapter two describes the administrative structure of Job Corps and presents data on the geographic distribution and characteristics…
Pierre, Ketly Dieudonne
There is a need to implement a comprehensive training program to build employees' knowledge, skills, and attitudes in order to improve quality service at ABC Restaurant because of a surge in customer complaints. The purpose of this study was to develop a training program that included an employee handbook as a training tool, a handbook designed…
Mumford, Virginia; Greenfield, David; Hinchcliff, Reece; Moldovan, Max; Forde, Kevin; Westbrook, Johanna I; Braithwaite, Jeffrey
Introduction The Accreditation Collaborative for the Conduct of Research, Evaluation and Designated Investigations through Teamwork—Cost–Benefit Analysis (ACCREDIT-CBA (Acute)) study is designed to determine and make explicit the costs and benefits of Australian acute care accreditation and to determine the effectiveness of acute care accreditation in improving patient safety and quality of care. The cost–benefit analysis framework will be provided in the form of an interactive model for industry partners, health regulators and policy makers, accreditation agencies and acute care service providers. Methods and design The study will use a mixed-method approach to identify, quantify and monetise the costs and benefits of accreditation. Surveys, expert panels, focus groups, interviews and primary and secondary data analysis will be used in cross-sectional and case study designs. Ethics and dissemination The University of New South Wales Human Research Ethics Committee has approved this project (approval number HREC 10274). The results of the study will be reported via peer-reviewed publications, conferences and seminar resentations and will form part of a doctoral thesis. PMID:23396564
DiIorio, Colleen; Bamps, Yvan; Walker, Elizabeth Reisinger; Escoffery, Cam
WebEase (Epilepsy Awareness, Support, and Education) is an online epilepsy self-management program to assist people with taking medication, managing stress, and improving sleep quality. The primary study aims were to determine if those who participated in WebEase demonstrated improvements in medication adherence, perceived stress, and sleep quality. Participants were randomized to a treatment (T) or waitlist control (WCL) group (n=148). At follow-up, participants in the T group reported higher levels of medication adherence than those in the WLC group. Analyses were also conducted comparing those who had completed WebEase modules with those who had not. Those who had completed at least some modules within the WebEase program reported higher levels of self-efficacy and a trend toward significance was observed for the group×time interactions for medication adherence, perceived stress, self-management, and knowledge. The results highlight the usefulness of online tools to support self-management among people with epilepsy.
This report is the second of a series of studies to evaluate research and development (R&D) projects funded by the Automotive Lightweighting Materials (ALM) Program of the Office of Advanced Automotive Technologies (OAAT) of the U.S. Department of Energy (DOE). The objectives of the program evaluation are to assess short-run outputs and long-run outcomes that may be attributable to the ALM R&D projects. The ALM program focuses on the development and validation of advanced technologies that significantly reduce automotive vehicle body and chassis weight without compromising other attributes such as safety, performance, recyclability, and cost. Funded projects range from fundamental materials science research to applied research in production environments. Collaborators on these projects include national laboratories, universities, and private sector firms, such as leading automobile manufacturers and their suppliers. Three ALM R&D projects were chosen for this evaluation: Design and Product Optimization for Cast Light Metals, Durability of Lightweight Composite Structures, and Rapid Tooling for Functional Prototyping of Metal Mold Processes. These projects were chosen because they have already been completed. The first project resulted in development of a comprehensive cast light metal property database, an automotive application design guide, computerized predictive models, process monitoring sensors, and quality assurance methods. The second project, the durability of lightweight composite structures, produced durability-based design criteria documents, predictive models for creep deformation, and minimum test requirements and suggested test methods for establishing durability properties and characteristics of random glass-fiber composites for automotive structural composites. The durability project supported Focal Project II, a validation activity that demonstrates ALM program goals and reduces the lead time for bringing new technology into the marketplace. Focal
Berthelette, Diane; Bilodeau, Henriette; Leduc, Nicole
A review of the existing occupational health literature reveals that several authors have proposed recommendations to increase the effectiveness of interventions that aim to prevent occupational disabilities. However, these recommendations are rarely evidence-based given that research carried out on such interventions is essentially epidemiological and that it generally produces too fragmented results. The contributing factors to explain this phenomenon are identified. The authors support the opinion that the community of occupational health academics should create more opportunities for researchers well-versed in evaluative research based on scientific methods complementary to epidemiology.
Tremper, Charles; Thomas, Sue; Wagenaar, Alexander C.
Evaluations that combine social science and law have tremendous potential to illuminate the effects of governmental policies and yield insights into how effectively policy makers' efforts achieve their aims. This potential is infrequently achieved, however, because such interdisciplinary research contains often overlooked substantive and…
Rafter, David O.
Three common evaluation models are the scientific, interactive, and hybrid. A study of evaluation projects mandated by the Wisconsin legislature revealed that the hybrid model was most effective in achieving policy planning and policy control utilization, the interactive approach provided aid to individual utilization, and the scientific approach…
Wilson, Lynda Law; Rice, Marti; Jones, Carolynn T.; Joiner, Cynthia; LaBorde, Jennifer; McCall, Kimberly; Jester, Penelope M.; Carter, Sheree C.; Boone, Chrissy; Onwuzuligbo, Uzoma; Koneru, Alaya
Introduction: Due to the increasing number of clinical trials conducted globally, there is a need for quality continuing education for health professionals in clinical research manager (CRM) roles. This article describes the development, implementation, and evaluation of a distance-based continuing education program for CRMs working outside the…
Murphy, Gail Tomblin; Alder, Rob; MacKenzie, Adrian; Cook, Amanda; Maddalena, Victor
The evaluation of the Research to Action project was conducted using an Outcome Mapping (OM) methodology (Earl et al. 2001) with a mixed-methods, repeat survey (before/after) study design. This design uses concurrent measurement of process and outcome indicators at baseline and follow-up. The RTA project proved effective at improving work environments and thereby promoting the retention and recruitment of nurses. Nurses involved in the RTA initiatives had a higher perception of leadership and support in their units, improved job satisfaction, increased empowerment and occupational commitment, and a greater intention to stay on the job.The pilot projects were most successful when there were clearly stated objectives, buy-in from nurses, support from the steering committee and management, and adequate communication among stakeholders. Committed coordination and leadership, both locally and nationally, were central to success.Considerable evidence has documented the challenges facing Canada's nursing human resources and their workplaces, such as high levels of turnover, excessive use of overtime and persistent shortages. There is a growing imperative to translate this research into action, and much of the available evidence presents viable policy alternatives for consideration. For example, a recent national synthesis report (Maddalena and Crupi 2008) recommended that, in consultation with stakeholders, processes should be put in place to share knowledge and best practices in nursing management, practice, staffing models and innovations in workplace health and well-being.Nurses across the country report a desire to be more involved in decisions affecting them and their patients (Wortsman and Janowitz 2006). A recent study on the shortage of registered nurses in Canada (Tomblin Murphy et al. 2009) highlighted the need for collaboration among governments, employers, unions and other stakeholders to improve working conditions for nurses. Another report notes the
Langfeldt, Liv; Kyvik, Svein
Researchers undertake a number of different research evaluation tasks, taking up a substantial part of their research time--estimated to about one work month per year for a professor. This paper addresses the various evaluator roles and tasks researchers take on, and the tensions they involve. How the research evaluator role may conflict with the…
Taylor, Ruth; Thomas-Gregory, Annette
This article describes case study research for nursing and healthcare practice. Case study research offers the researcher an approach by which a phenomenon can be investigated from multiple perspectives within a bounded context, allowing the researcher to provide a 'thick' description of the phenomenon. Although case study research is a flexible approach for the investigation of complex nursing and healthcare issues, it has methodological challenges, often associated with the multiple methods used in individual studies. These are explored through examples of case study research carried out in practice and education settings. An overview of what constitutes 'good' case study research is proposed.
Studman, Cliff; Tsheko, G. Nnunu
The impact of change strategies for developing research at an African primarily undergraduate institution is considered using a case study of the University of Botswana. After an analysis of the existing situation, a short research policy, written in understandable terms, was developed. The policy was structured so that it could be used for…
Ryan, Michael C.; Ostmo, Susan; Jonas, Karyn; Berrocal, Audina; Drenser, Kimberly; Horowitz, Jason; Lee, Thomas C.; Simmons, Charles; Martinez-Castellanos, Maria-Ana; Chan, R.V. Paul; Chiang, Michael F.
Information systems managing image-based data for telemedicine or clinical research applications require a reference standard representing the correct diagnosis. Accurate reference standards are difficult to establish because of imperfect agreement among physicians, and discrepancies between clinical vs. image-based diagnosis. This study is designed to describe the development and evaluation of reference standards for image-based diagnosis, which combine diagnostic impressions of multiple image readers with the actual clinical diagnoses. We show that agreement between image reading and clinical examinations was imperfect (689 [32%] discrepancies in 2148 image readings), as was inter-reader agreement (kappa 0.490-0.652). This was improved by establishing an image-based reference standard defined as the majority diagnosis given by three readers (13% discrepancies with image readers). It was further improved by establishing an overall reference standard that incorporated the clinical diagnosis (10% discrepancies with image readers). These principles of establishing reference standards may be applied to improve robustness of real-world systems supporting image-based diagnosis. PMID:25954463
Ryan, Michael C; Ostmo, Susan; Jonas, Karyn; Berrocal, Audina; Drenser, Kimberly; Horowitz, Jason; Lee, Thomas C; Simmons, Charles; Martinez-Castellanos, Maria-Ana; Chan, R V Paul; Chiang, Michael F
Information systems managing image-based data for telemedicine or clinical research applications require a reference standard representing the correct diagnosis. Accurate reference standards are difficult to establish because of imperfect agreement among physicians, and discrepancies between clinical vs. image-based diagnosis. This study is designed to describe the development and evaluation of reference standards for image-based diagnosis, which combine diagnostic impressions of multiple image readers with the actual clinical diagnoses. We show that agreement between image reading and clinical examinations was imperfect (689 [32%] discrepancies in 2148 image readings), as was inter-reader agreement (kappa 0.490-0.652). This was improved by establishing an image-based reference standard defined as the majority diagnosis given by three readers (13% discrepancies with image readers). It was further improved by establishing an overall reference standard that incorporated the clinical diagnosis (10% discrepancies with image readers). These principles of establishing reference standards may be applied to improve robustness of real-world systems supporting image-based diagnosis.
Bormann, B.T.; Homann, P.S.; Bednar, L.; Cairns, M.A.; Barker, J.R.
This research plan provides new knowledge on the range of possibilities--available by managing forests differently--to store more carbon (C) to meet the climate-change action plan (Clinton and Gore 1993) target of returning emissions of greenhouse gases in the United States to 1990 emissions by the year 2000. Specific goals will evaluate effects of forest management strategies on stand-scale C conservation and sequestration, improve the quality and applicability of stand-scale C budgets and methods, and blend research programs within the Corvallis U.S. Environmental Protection Agency (EPA) and Pacific Northwest (PNW) labs.
Malacara, J M
The peer review process for manuscripts submitted for publication to scientific journals and for the evaluation of grant research proposals is unsatisfactory in several respects. We examine here some of the problems related with evaluation of scientific merit. Some criteria for rejection are proposed, i.e. a poor preparation of the manuscript, a lack of a distinct hypothesis, a disagreement between hypothesis and methodology, and a deficient methodology. Other important criteria causes of rejection would be lack of originality of the hypothesis, scarce relevance of the work, and inconsistency in the results. Conversely, interesting work are rejected for invalid objections such as "less than optimal design", "lack of experience of the group" and some conceptual objections which are controversial. In order to improve the peer review process, we propose a larger role of editorial committees in final editorial decisions, an improved mechanism for selection of reviewers, and more explicit criteria for causes of rejection for reviewers and authors.
McKay, Veronica, Ed.; Treffgarne, Carew, Ed.
Papers in this collection address issues related to participatory approaches to assessing impact. The first section, "What Is an Impact Study and How Should We Do It?" contains: (1) "Participatory Impact Assessment" (John Shotton); (2) "Participatory Action Research as an Approach to Impact Assessment" (Victoria…
Cole, Allison; Keppel, Gina A.; Linares, Adriana; Alto, William; Kriegsman, William; Reed, Alex; Holmes, John; Mohanachandran, Mathini; Baldwin, Laura-Mae
Background Practice-Based Research Networks (PBRNs) promote the conduct of research in real-world settings by engaging primary care clinicians as champion research collaborators. Card studies are brief surveys administered to patients or clinicians at the point of care. The objective of this paper is to describe the design and evaluation of a card study methodology that the WWAMI region Practice and Research Network (WPRN) used to develop research partnerships across multiple member sites. Methods We used a collaborative model to develop, implement and disseminate the results of a network-wide card study to assess patient preferences for weight loss in primary care. After the card study data collection was completed, we conducted individual and focus group interviews and a brief survey of participating practice champions. Results Increased research engagement and personal and professional development were the primary motivators for participating in the development of the card study. Increasing research activity at practices and learning information about patients were motivators for implementing the study. Their participation resulted in champions reporting increased confidence in collaborating on research projects as well as the development of new clinical services for patients. Discussion This collaborative model positively influenced research capacity in the WPRN and may be a useful strategy for helping PBRNs conduct translational research. PMID:26177880
Johnson, G.; Heikkilae, M.; Melasuo, T.; Spanner, S.
Realizing the value and potential of PV-power as well as the growing need for increased cooperation and sharing of knowledge in the field of photovoltaics, FINNIDA and UNICEF decided to undertake a study of selected PV-projects. There were two main objectives for the study: To gather, compile, evaluate and share information on the photovoltaic technology appropriate to developing countries, and to promote the interest and competence of Finnish research institutes, consultants and manufacturers in photovoltaic development. For this purpose a joint evaluation of significant, primarily UN-supported projects providing for the basic needs of rural communities was undertaken. The Gambia and Kenya offered a variety of such projects, and were chosen as target countries for the study. The projects were chosen to be both comparable and complimentary. In the Gambia, the main subject was a partially integrated health and telecommunications project, but a long-operating drinking water pumping system was also studied. In Kenya, a health project in the Turkana area was examined, and also a large scale water pumping installation for fish farming. Field visits were made in order to verify and supplement the data gathered through document research and earlier investigations. Individual data gathering sheets for the project form the core of this study and are intended to give the necessary information in an organized and accessible format. The findings could practically be condensed into one sentence: PV-systems work very well, if properly designed and installed, but the resources and requirements of the recipients must be considered to a higher degree.
Ackermann, Eric George
This study develops a set of empirically and theoretically sound citation-based bibliometric indicators of scientific research performance and applies them in an exploratory comparative study of the University of Tennessee-Knoxville's (UTK's) Nutrition Department with three of its peer programs at the University of Florida, the University of…
Sears, Jeanne M; Hogg-Johnson, Sheilah
In 2004, the Washington State Legislature enacted a 3-year pilot program that authorized nurse practitioners to function as attending providers for injured workers. The bill required an evaluation and report to the Legislature to address stakeholder concerns regarding potential impacts on system quality and costs. Subsequent to the report's dissemination, permanent legislation extending the program was passed. The specific objectives of this case study are (1) to document an example of policy-relevant research that had features facilitating direct policy impact and (2) to describe environmental facilitators/barriers and best practices for enhancing the effective impact of evaluation research on policy. Researchers often seek to have an impact on health, health care, and/or healthcare policy. This case study reinforces the importance of (1) ensuring early and ongoing communication with stakeholders, (2) conducting stakeholder analysis to understand underlying interests and values, and (3) encouraging meaningful stakeholder input into the evaluation design process.
Bruno, A. V.
The development of a Monte Carlo simulation of procurement activities at the NASA Ames Research Center is described. Data cover: simulation of the procurement cycle, construction of a performance evaluation model, examination of employee development, procedures and review of evaluation criteria for divisional and individual performance evaluation. Determination of the influences and apparent impact of contract type and structure and development of a management control system for planning and controlling manpower requirements.
Murphy, P. J.; And Others
This report describes evaluations of two courses which were conducted, primarily through participant observation, in 1981. A general introduction looks at simulation in computer assisted learning (CAL) and at use of simulation CAL in the Open University science faculty. The first study discussed was based largely on a tutor's observations of…
Bouwman, Jildau; Dragsted, Lars O.; Drevon, Christian A.; Elliott, Ruan; de Groot, Philip; Kaput, Jim; Mathers, John C.; Müller, Michael; Pepping, Fre; Saito, Jahn; Scalbert, Augustin; Radonjic, Marijana; Rocca-Serra, Philippe; Travis, Anthony; Wopereis, Suzan; Evelo, Chris T.
The challenge of modern nutrition and health research is to identify food-based strategies promoting life-long optimal health and well-being. This research is complex because it exploits a multitude of bioactive compounds acting on an extensive network of interacting processes. Whereas nutrition research can profit enormously from the revolution in ‘omics’ technologies, it has discipline-specific requirements for analytical and bioinformatic procedures. In addition to measurements of the parameters of interest (measures of health), extensive description of the subjects of study and foods or diets consumed is central for describing the nutritional phenotype. We propose and pursue an infrastructural activity of constructing the “Nutritional Phenotype database” (dbNP). When fully developed, dbNP will be a research and collaboration tool and a publicly available data and knowledge repository. Creation and implementation of the dbNP will maximize benefits to the research community by enabling integration and interrogation of data from multiple studies, from different research groups, different countries and different—omics levels. The dbNP is designed to facilitate storage of biologically relevant, pre-processed—omics data, as well as study descriptive and study participant phenotype data. It is also important to enable the combination of this information at different levels (e.g. to facilitate linkage of data describing participant phenotype, genotype and food intake with information on study design and—omics measurements, and to combine all of this with existing knowledge). The biological information stored in the database (i.e. genetics, transcriptomics, proteomics, biomarkers, metabolomics, functional assays, food intake and food composition) is tailored to nutrition research and embedded in an environment of standard procedures and protocols, annotations, modular data-basing, networking and integrated bioinformatics. The dbNP is an evolving enterprise
It was the purpose of this study to investigate and compare the expectations of the school for the child and the expectations based on research findings from the field of child growth and development and to discover the nature of the discrepancy, if any, between these two expectations. Data was gathered for comparing the evaluations of early…
Claycomb, Gregory D.; Venable, Frances A.
In an effort to broaden the selection of research opportunities available to a student registered in a one-semester, upper-level independent study course at a primarily undergraduate institution (PUI), a highly motivated student was asked to select, evaluate, and modify a standard operating procedure (SOP). The student gained valuable experience…
These epidemiological studies may assist in evaluating associations between certain pharmaceuticals and disease risk and contain detailed information on pharmaceutical use and disease risk, including cancer.
Liao, Jian-Feng; Wang, Juan; Liang, Liang; Wu, Yong-Ding; Huang, Mei-Juan; Liu, Tian-Qiang
Background This study aimed to analyze the dynamic changes of the scientific research innovation efficiency of Guangzhou Institute of Respiratory Diseases (GIRD) during the year 2009–2013 to explore the reason for these changes and give some suggestions on how to improve the overall efficiency of the Institute. Methods The panel data used in this study were taken from 19 research teams of GIRD during 2009 to 2013. Data envelopment analysis (DEA) based on Malmquist index (MI) was used to analyze the performance of each research team in terms of productivity changes over time. Data were analyzed using DEAP 2.1 software. Results The annual average increase rate of total factor productivity (TFP), technological progress, technical efficiency, pure technical efficiency, and scale efficiency was 30.4%, 22.5%, 6.4%, 0.9%, and 5.4%, respectively from 2009 to 2013. The scientific research innovation efficiency of the GIRD was generally high and kept on growing. The increase of TFP was mainly caused by the progress of tech, the descending of TFP in some teams should be mainly attributable to the declining pure technical efficiency, and scale efficiency on the whole, maintaining a stable growth at a low speed. Conclusions To achieve higher scientific research innovation, GIRD not only needs to further improve the management level and introduce advanced management mode, but also needs to focus on optimization of resource allocation, as well as to strengthen the talent introduction, and continue to maintain the absorption of new technologies and innovation. PMID:27867545
Paul, Arthur S.; Gill, Tepper L.; Maclin, Arlene P.
A study of NASA's Systems Management Policy (SMP) concluded that the primary methodology being used by the Mission Operations and Data Systems Directorate and its subordinate, the Networks Division, is very effective. Still some unmet needs were identified. This study involved evaluating methodologies, tools, and techniques with the potential for resolving the previously identified deficiencies. Six preselected methodologies being used by other organizations with similar development problems were studied. The study revealed a wide range of significant differences in structure. Each system had some strengths but none will satisfy all of the needs of the Networks Division. Areas for improvement of the methodology being used by the Networks Division are listed with recommendations for specific action.
Christ, Thomas W.
Teaching mixed methods research is difficult. This longitudinal explanatory study examined how two classes were designed, taught, and evaluated. Curriculum, Research, and Teaching (EDCS-606) and Mixed Methods Research (EDCS-780) used a research proposal generation process to highlight the importance of the purpose, research question and…
Halje, Karin; Timpka, Toomas; Ekberg, Joakim; Bång, Magnus; Fröberg, Anders; Eriksson, Henrik
We examined clinicians' and researchers' experiences from participation in collaborative research on the introduction of Internet and mobile information systems (mHealth systems) in psychotherapeutic routines. The study used grounded theory methodology and was set in a collaboration that aimed to develop and evaluate mHealth support of psychotherapy provided to young people. Soundness of the central objects developed in the design phase (the collaboration contract, the trial protocol, and the system technology) was a necessary foundation for successful collaborative mHealth research; neglect of unanticipated organizational influences during the trial phase was a factor in collaboration failure. The experiences gained in this study can be used in settings where collaborative research on mHealth systems in mental health is planned. PMID:27034661
High/Scope Educational Research Foundation, Ypsilanti, MI.
Case studies of eight Home Start programs are given as the third section of an evaluation study. Communities involved are Binghamton, New York; Franklin, North Carolina; Cleveland, Ohio; Harrogate, Tennessee; Houston, Texas; Weslaco, Texas; Millville, Utah; Parkersburg, West Virginia. Although each study varies in format, each describes in detail…
Ferris, Helena A.; Collins, Mary E.
The landscape of medical education is continuously evolving, as are the needs of the learner. The appropriate use of research and evaluation is key when assessing the need for change and instituting one's innovative endeavours. This paper demonstrates how research seeks to generate new knowledge, whereas evaluation uses information acquired from…
Designed as an pilot project to assess the scientific and pedagogical quality of selected digital resources in the Digital Library for Earth System Education (DLESE), the Climate Change Collection is thematic collection of digital resources relating to the topic of global climate change. Developed through the collaborative efforts of an interdisciplinary review team made up of professionals from the fields of climate research, geoscience education, cognitive psychology, and evaluation, the findings of the project suggest that the user needs of the reviewers should be considered in any review process, that there is inherent value in the collaboration of scientists, teachers and related fields in determining the quality of particular resources, and that the process of preparing for and conducting such reviews and annotations is time-consuming and challenging. Drawing from the experience of prior collection development efforts associated with DLESE, including the Community Review System and the Digital Water Education Library, the Climate Change Collection was developed during the Fall of 2004 and Winter of 2005. Through a series of monthly meetings with the review team facilitated by the Principal Investigator acting as Editor for the collection, and assisted by an online workspace known as a SWIKI, the Climate Change Collection was designed as an experiment in streamlined collection development that may help inform future digital library review and collection-building efforts. The initial meetings focused on training the reviewers, setting context for the review process, and discussing the perspectives of the various participants in the review team. Each participant received a stipend for their involvement in the process. A rubric "scorecard" was developed, tested, and fine-tuned by the review team with a focus primarily on scientific accuracy and the potential for effective use in the classroom. Specific concepts relating to aspects of natural climate variability
Background Stress evaluation is a field of strong interest and challenging due to several methodological aspects in the evaluation process. The aim of this study is to propose a study protocol to test a new method (i.e., the Stress Assessment and Research Toolkit) to assess psychosocial risk factors at work. Design This method addresses several methodological issues (e.g., subjective vs. objective, qualitative vs quantitative data) by assessing work-related stressors using different kinds of data: i) organisational archival data (organisational indicators sheet); ii) qualitative data (focus group); iii) worker perception (questionnaire); and iv) observational data (observational checklist) using mixed methods research. In addition, it allows positive and negative aspects of work to be considered conjointly, using an approach that considers at the same time job demands and job resources. Discussion The integration of these sources of data can reduce the theoretical and methodological bias related to stress research in the work setting, allows researchers and professionals to obtain a reliable description of workers’ stress, providing a more articulate vision of psychosocial risks, and allows a large amount of data to be collected. Finally, the implementation of the method ensures in the long term a primary prevention for psychosocial risk management in that it aims to reduce or modify the intensity, frequency or duration of organisational demands. PMID:23799950
Watt, James H.
Provides a detailed description of diverse data collection tools based on the World Wide Web and enumerates their advantages, disadvantages, and logistical challenges. Web-based data collection can offer cost-effective, flexible, and timely solutions to many evaluation needs. (Author/SLD)
The net result of the social-scientific developments in the 19th and 20th centuries is that educational research has inherited a science that is assumed to constitute a disinterested technology of social engineering and a benevolent source of positive social advance. Unfortunately, the social experiment conducted on traditional lines depends upon…
... Advisory Committee on Head Start Research and Evaluation AGENCY: Administration for Children and Families...-establishment of the Advisory Committee on Head Start Research and Evaluation. The Secretary is required by... on the design of the study or studies that provide national analysis of the impact of Head...
An overview of qualitative methods is provided, particularly for reviewers and authors who may be less familiar with qualitative research. A question and answer format is used to address considerations for writing and evaluating qualitative research. When producing qualitative research, individuals ...
Lindenmann, Walter K.
Reports findings of a nationwide survey of public relations professionals to investigate the full extent of recent public relations research activities. Finds a growing recognition that research is an integral part of public relations planning, program development, and evaluation process. Reveals that most public relations research is currently…
Some authors on research methodology are of opinion that research reports are based on the logic of reasoning and that such reports communicate with the reader by presenting logical, coherent arguments (Böhme, 1975:206; Mouton, 1996:69). This view implies that researchers draw specific conclusions and that such conclusions are justified by way of reasoning (Doppelt, 1998:105; Giere, 1984:26; Harre, 1965:11; Leherer & Wagner, 1983 & Pitt, 1988:7). The structure of a research report thus consists mainly of conclusions and reasons for such conclusions (Booth, Colomb & Williams, 1995:97). From this it appears that justification by means of reasoning is a standard procedure in research and research reports. Despite the fact that the logic of research is based on reasoning, that the justification of research findings by way of reasoning appears to be standard procedure and that the structure of a research report comprises arguments, the evaluation or assessment of research, as described in most textbooks on research methodology (Burns & Grove, 1993:647; Creswell, 1994:193; LoBiondo-Wood & Haber, 1994:441/481) does not focus on the arguments of research. The evaluation criteria for research reports which are set in these textbooks are related to the way in which the research process is carried out and focus on the measures for internal, external, theoretical, measurement and inferential validity. This means that criteria for the evaluation of research are comprehensive and they should be very specific in respect of each type of research (for example quantitative or qualitative). When the evaluation of research reports is focused on arguments and logic, there could probably be one set of universal standards against which all types of human science research reports can be assessed. Such a universal set of standards could possibly simplify the evaluation of research reports in the human sciences since they can be used to assess all the critical aspects of research reports
OFFICE OF RESEARCH AND DEVELOPMENT'S FOUR LAB STUDY: TOXICOLOGICCAL AND CHEMICAL EVALUATION OF COMPLEX MIXTURES OF DISINFECTION BY-PRODUCTS (DBPS) AND QUALITY ASSURANCE ACTIVITIES FOR A LARGE U. S. EPA MULTILABORATORY STUDY
Office of Research and Development's Four Lab Study: Toxicological and Chemical Evaluation of Complex Mixtures of Disinfection By-Products (DBPs), and Quality Assurance Activities for a Large U.S. EPA Multilaboratoty Study
Thomas J. Hughes, Project and QA Manager, Expe...
An evaluation of two different pyrolysis concepts which recover energy from solid waste was conducted in order to determine the merits of each concept for integration into a Integrated Utility System (IUS). The two concepts evaluated were a Lead Bath Furnace Pyrolysis System and a Slagging Vertical Shaft, Partial Air Oxidation Pyrolysis System. Both concepts will produce a fuel gas from the IUS waste and sewage sludge which can be used to offset primary fuel consumption in addition to the sanitary disposal of the waste. The study evaluated the thermal integration of each concept as well as the economic impact on the IUS resulting from integrating each pyrolysis concepts. For reference, the pyrolysis concepts were also compared to incineration which was considered the baseline IUS solid waste disposal system.
In its role as a broker between the scientific community and the Congress, the Office of Technology Assessment evaluates the soundness of scientific conclusions for policy makers and ensures that research findings are included in formative policy analysis. (Author)
Kaskowitz, David H.; Norwood, Charles R.
Project Information Packages (PIPs) are informative kits that describe remedial educational programs and contain instructions for installing the projects in a new site. Six such PIPs were evaluated using a norm-referenced procedure applied to standardized test scores. Pretest scores were compared to posttest scores which were calculated according…
Rudner, Lawrence M., Ed.; Schafer, William D., Ed.
This document consists of articles 1 through 14 of volume 6 of "Practical Assessment, Research & Evaluation": (1) "Seven Myths about Literacy in the United States" (Jeff McQuillan); (2) "Implementing Performance Assessment in the Classroom" (Amy Brualdi); (3) "Some Evaluation Questions" (William Shadish); (4) "Item Banking" (Lawrence Rudner); (5)…
The Childhood Obesity Research Demonstration (CORD) project evaluation will determine the extent to which the CORD model of linking primary care (PC) interventions to public health (PH) interventions in multiple community sectors affects BMI and behavior in children (2 to 12 years). The evaluation c...
Piggot-Irvine, Eileen; Rowe, Wendy; Ferkins, Lesley
The focus of this paper is to share thinking about meta-level evaluation of action research (AR), and to introduce indicator domains for assessing and measuring inputs, outputs and outcomes. Meta-level and multi-site evaluation has been rare in AR beyond project implementation and participant satisfaction. The paper is the first of several…
Cope, Diane G
Through data collection methods using a holistic approach that focuses on variables in a natural setting, qualitative research methods seek to understand participants' perceptions and interpretations. Common qualitative research methods include ethnography, phenomenology, grounded theory, and historic research. Another type of methodology that has a similar qualitative approach is case study research, which seeks to understand a phenomenon or case from multiple perspectives within a given real-world context.
Hoehndorf, Robert; Dumontier, Michel; Gkoutos, Georgios V
Ontologies are now pervasive in biomedicine, where they serve as a means to standardize terminology, to enable access to domain knowledge, to verify data consistency and to facilitate integrative analyses over heterogeneous biomedical data. For this purpose, research on biomedical ontologies applies theories and methods from diverse disciplines such as information management, knowledge representation, cognitive science, linguistics and philosophy. Depending on the desired applications in which ontologies are being applied, the evaluation of research in biomedical ontologies must follow different strategies. Here, we provide a classification of research problems in which ontologies are being applied, focusing on the use of ontologies in basic and translational research, and we demonstrate how research results in biomedical ontologies can be evaluated. The evaluation strategies depend on the desired application and measure the success of using an ontology for a particular biomedical problem. For many applications, the success can be quantified, thereby facilitating the objective evaluation and comparison of research in biomedical ontology. The objective, quantifiable comparison of research results based on scientific applications opens up the possibility for systematically improving the utility of ontologies in biomedical research.
Kleinman, Steven; Busch, Michael P; Murphy, Edward L; Shan, Hua; Ness, Paul; Glynn, Simone A.
Background The Recipient Epidemiology and Donor Evaluation Study -III (REDS-III) is a 7-year multicenter transfusion safety research initiative launched in 2011 by the National Heart, Lung, and Blood Institute. Study design The domestic component involves 4 blood centers, 12 hospitals, a data coordinating center, and a central laboratory. The international component consists of distinct programs in Brazil, China, and South Africa which involve US and in-country investigators. Results REDS-III is using two major methods to address key research priorities in blood banking/transfusion medicine. First, there will be numerous analyses of large “core” databases; the international programs have each constructed a donor/donation database while the domestic program has established a detailed research database that links data from blood donors and their donations, the components made from these donations, and data extracts from the electronic medical records of the recipients of these components. Secondly, there are more than 25 focused research protocols involving transfusion recipients, blood donors, or both that are either in progress or scheduled to begin within the next 3 years. Areas of study include transfusion epidemiology and blood utilization; transfusion outcomes; non-infectious transfusion risks; HIV-related safety issues (particularly in the international programs); emerging infectious agents; blood component quality; donor health and safety; and other donor issues. Conclusions It is intended that REDS-III serve as an impetus for more widespread recipient and linked donor-recipient research in the US as well as to help assure a safe and available blood supply in the US and in international locations. PMID:24188564
Abruzzese, R S
The classic critique of research is applied to a systematic evaluation of the components of research reports and company literature related to pressure ulcer products and devices. Emphasis is on the need to control variables that influence the findings; some of these are: relief of pressure, nutrition and hydration, comparability of subjects, the Hawthorne Effect and the Pygmalion Effect. Replication of research before adopting products/devices for protocol use is advocated.
1 DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. Behavioral Response Research Evaluation Workshop (BRREW...N000141512664 http://www.creem.st-and.ac.uk LONG-TERM GOALS The behavioral response of marine mammals to Navy sonar exposure has been a research...The overall objective is to review the status and future of research into behavioral responses of marine mammals to naval sonar exposure in order to
Gogate, Parikshit Madhav; Biswas, Partha; Natarajan, Sundaram; Nayak, Barun Kumar; Gopal, Santhan; Shah, Yogesh; Basak, Samar K
Purpose: To know the perception of young ophthalmologists about their dissertation and academics during residency training in order to improve the research output during present residency programs in India. Methods: A survey was conducted by Academic and Research Committee of the All India Ophthalmological Society, the world's second largest ophthalmic professional's organization, in 2014–2016 of young ophthalmologists (those who completed residency between 2005 and 2012) to gauge usefulness of dissertation or thesis during postgraduate residency. Results: There were 1005 respondents, of whom 531 fulfilled inclusion criteria. On a scale of 0–10, residents rated level of supervision of their dissertation as adequate (mean 5.9/10, standard deviation [SD] = 3.1, median = 6). The level of infrastructure available was for dissertation rated as 5.9/10 (median = 7, SD = 3.1), and 6.2/10 was the score that residents said about value added by the dissertation (median = 7). The dissertation was presented at local (33.5%), state (28.1%), national (15.4%), and international (4%) levels. Students, not supervisors, did most of the local and state level presentations. It was published in some forms at local 210 (39.5%), state (140, 26.4%), national (94, 17.7%), and international (39, 7.3%) levels. On a scale of 0–4, seminars (3/4) and case presentations were (3/4) rated higher than didactic lectures (2.2/4), journal clubs (2.2/4), and wet laboratory (1.1/4). Conclusion: Peer-reviewed publications from Indian residency training dissertations were few. Residents felt dissertation added value to their training, but there was a huge range among the responses. Journal clubs and wet laboratories were not graded high in academic programs, unlike seminars and case presentations. PMID:28300734
Polidano, Cain; Zakirova, Rezida
Working in some capacity is almost considered de rigueur for tertiary students. The reasons for working and the impact this has on both an individual's ability to complete their studies and on their post-study labour market outcomes are only recently receiving attention. Using the 1995 and 1998 cohorts of the Longitudinal Surveys of Australian…
The Accelerator Research Studies program at the University of Maryland, sponsored by the Department of Energy under grant number DE-FG05-91ER40642, is currently in the first year of a three-year funding cycle. The program consists of the following three tasks: TASK A, Study of Transport and Longitudinal Compression of Intense, High-Brightness Beams, TASK B, Study of Collective Ion Acceleration by Intense Electron Beams and Pseudospark Produced High Brightness Electron Beams; TASK C, Study of a Gyroklystron High-power Microwave Source for Linear Colliders. In this report we document the progress that has been made during the past year for each of the three tasks.
Background Few researchers have the data required to adequately understand how the school environment impacts youth health behaviour development over time. Methods/Design COMPASS is a prospective cohort study designed to annually collect hierarchical longitudinal data from a sample of 90 secondary schools and the 50,000+ grade 9 to 12 students attending those schools. COMPASS uses a rigorous quasi-experimental design to evaluate how changes in school programs, policies, and/or built environment (BE) characteristics are related to changes in multiple youth health behaviours and outcomes over time. These data will allow for the quasi-experimental evaluation of natural experiments that will occur within schools over the course of COMPASS, providing a means for generating “practice based evidence” in school-based prevention programming. Discussion COMPASS is the first study with the infrastructure to robustly evaluate the impact that changes in multiple school-level programs, policies, and BE characteristics within or surrounding a school might have on multiple youth health behaviours or outcomes over time. COMPASS will provide valuable new insight for planning, tailoring and targeting of school-based prevention initiatives where they are most likely to have impact. PMID:24712314
... become more involved in this important work. Broad Medical Research Program at The Crohn's & Colitis Foundation (BMRP) Because ... management and treatment of IBD. Members include hospitals, medical centers, clinics, and research facilities that have developed an IBD-related research ...
Coche, Erich; Thomas, A. Toni
Evaluation and results of this program study revealed significant overall improvements in adolescents who had participated in a therapeutic rehabilitation program. Further research needs to be done into areas where the treatment program was a failure. (Author/DEP)
Young, Virginia E.; Ackerson, Linda G.
Reviews a study conducted at the University of Alabama that compared two bibliographic instruction programs by using the Kohl and Wilson criteria to evaluate each method's effect on student term paper bibliographies, discusses the application of evaluation criteria, and offers suggestions to increase the effectiveness of evaluation criteria.…
Jenkins, Todd M.; Boyce, Tawny Wilson; Akers, Rachel; Andringa, Jennifer; Liu, Yanhong; Miller, Rosemary; Powers, Carolyn; Buncher, C. Ralph
Utilizing electronic data capture (EDC) systems in data collection and management allows automated validation programs to preemptively identify and correct data errors. For our multi-center, prospective study we chose to use TeleForm, a paper-based data capture software that uses recognition technology to create case report forms (CRFs) with similar functionality to EDC, including custom scripts to identify entry errors. We quantified the accuracy of the optimized system through a data audit of CRFs and the study database, examining selected critical variables for all subjects in the study, as well as an audit of all variables for 25 randomly selected subjects. Overall we found 6.7 errors per 10,000 fields, with similar estimates for critical (6.9/10,000) and non-critical (6.5/10,000) variables – values that fall below the acceptable quality threshold of 50 errors per 10,000 established by the Society for Clinical Data Management. However, error rates were found to widely vary by type of data field, with the highest rate observed with open text fields. PMID:24709056
Hewitt, L C
Historical research, a method of inquiry that combines science and literature, often supports a common thesis that an informed understanding of nursing history provides insights that can contribute effective approaches to current professional issues. Historical research was formally recognized by the American Nurses Association (ANA) in 1965. A review of 11 recent historical research studies supports the concept that adherence to established standards of research and presentation contributes to the value of historical research. While relating an interesting story is an intrinsic element of historical research, the research gains purpose and meaning when the presentation of data includes a statement of purpose utilizing a research question, a review of literature establishing a relation to the greater nursing community, and a concluding analysis relating the research to current and future professional issues.
Trimble, Micaela; Lázaro, Marila
Participatory research in which experts and non-experts are co-researchers in addressing local concerns (also known as participatory action research or community-based research) can be a valuable approach for dealing with the uncertainty of social-ecological systems because it fosters learning among stakeholders and co-production of knowledge. Despite its increased application in the context of natural resources and environmental management, evaluation of participatory research has received little attention. The objectives of this research were to define criteria to evaluate participatory research processes and outcomes, from the literature on participation evaluation, and to apply them in a case study in an artisanal fishery in coastal Uruguay. Process evaluation criteria (e.g., problem to be addressed of key interest to local and additional stakeholders; involvement of interested stakeholder groups in every research stage; collective decision making through deliberation; and adaptability through iterative cycles) should be considered as conditions to promote empowering participatory research. Our research contributes to knowledge on evaluation of participatory research, while also providing evidence of the positive outcomes of this approach, such as co-production of knowledge, learning, strengthened social networks, and conflict resolution.
Yin, Kai; Wen, MeiPing; Zhang, FeiFei; Yuan, Chao; Chen, Qiang; Zhang, Xiupeng
With the acceleration of urbanization in China, most rural areas formed a widespread phenomenon, i.e., destitute village, labor population loss, land abandonment and rural hollowing. And it formed a unique hollow village problem in China finally. The governance of hollow village was the objective need of the development of economic and social development in rural area for Chinese government, and the research on the evaluation method of rural hollowing was the premise and basis of the hollow village governance. In this paper, several evaluation methods were used to evaluate the rural hollowing based on the survey data, land use data, social and economic development data. And these evaluation indexes were the transition of homesteads, the development intensity of rural residential areas, the per capita housing construction area, the residential population proportion in rural area, and the average annual electricity consumption, which can reflect the rural hollowing degree from the land, population, and economy point of view, respectively. After that, spatial analysis method of GIS was used to analyze the evaluation result for each index. Based on spatial raster data generated by Kriging interpolation, we carried out re-classification of all the results. Using the fuzzy clustering method, the rural hollowing degree in Ningxia area was reclassified based on the two spatial scales of county and village. The results showed that the rural hollowing pattern in the Ningxia Hui Autonomous Region had a spatial distribution characteristics that the rural hollowing degree was obvious high in the middle of the study area but was low around the study area. On a county scale, the specific performances of the serious rural hollowing were the higher degree of extensive land use, and the lower level of rural economic development and population transfer concentration. On a village scale, the main performances of the rural hollowing were the rural population loss and idle land. The
Page, Ellis B.
One of a series of research reports examining objective principles successfully used in other fields which can lend integrity and legitimacy to evaluation, this report presents an overview of operations research (OR) as a potential source of evaluation methodology. The nature of the methods common to this discipline are summarized and the…
Garfunkel, Frank; And Others
This document is a report of research conducted from September 1966 to August 1967 by the Head Start Evaluation and Research Center of Boston University. Eleven studies and projects are reported, many of them in preliminary or incomplete form because either they are ongoing studies or the data analysis is not finished. The 11 studies contain six…
Xu, Yunzhen; Du, Pei; Wang, Jianzhou
As the atmospheric environment pollution has been becoming more and more serious in China, it is highly desirable to develop a scientific and effective early warning system that plays a great significant role in analyzing and monitoring air quality. However, establishing a robust early warning system for warning the public in advance and ameliorating air quality is not only an extremely challenging task but also a public concerned problem for human health. Most previous studies are focused on improving the prediction accuracy, which usually ignore the significance of uncertainty information and comprehensive evaluation concerning air pollutants. Therefore, in this paper a novel robust early warning system was successfully developed, which consists of three modules: evaluation module, forecasting module and characteristics estimating module. In this system, a new dynamic fuzzy synthetic evaluation is proposed and applied to determine air quality levels and primary pollutants, which can be regarded as the research objectives; Moreover, to further mine and analyze the characteristics of air pollutants, four different distribution functions and interval forecasting method are also employed that can not only provide predictive range, confidence level and the other uncertain information of the pollutants future values, but also assist decision-makers in reducing and controlling the emissions of atmospheric pollutants. Case studies utilizing hourly PM2.5, PM10 and SO2 data collected from Tianjin and Shanghai in China are applied as illustrative examples to estimate the effectiveness and efficiency of the proposed system. Experimental results obviously indicated that the developed novel early warning system is much suitable for analyzing and monitoring air pollution, which can also add a novel viable option for decision-makers.
Eisner, Elliot W.
The production and sale of instructional materials are now big business in this country. Hence it is desirable, and probably necessary, to establish standards for such materials. Research in the area of curriculum materials is basically virgin territory. The evaluation of different types of curriculum materials will require the application of…
If correctional evaluation research is to contribute to the accumulation of practical knowledge, it should be designed to test abstract behavioral science principles that explain why a particular type of program should change the future conduct of a specific category of clientele. (Author)
Averch, Harvey A.
This article reviews the principal methods economists and cost benefit analysts use in evaluating research. Two common approaches are surplus measures (combinations of consumer and producer surpluses) and productivity measures. Technical difficulties and political and organizational constraints are discussed for these measures. (SLD)
Rudner, Lawrence M., Ed.; Schafer, William D., Ed.
This document consists of articles 23 through 26 published in the electronic journal "Practical Assessment, Research & Evaluation" in 2001: (23) "Effects of Removing the Time Limit on First and Second Language Intelligence Test Performance" (Jennifer Mullane and Stuart J. McKelvie); (24) "Consequences of (Mis)use of the Texas Assessment of…
Seong, Somi; Popper, Steven W.; Goldman, Charles A.; Evans, David K.; Grammich, Clifford A.
The Brain Korea 21 program (BK21), an effort to improve Korean universities and research, has attracted a great deal of attention in Korea, producing the need to understand how well the program is meeting its goals. RAND developed a logic model for identifying program goals and dynamics, suggested quantitative and qualitative evaluation methods,…
Rudner, Lawrence M., Ed.; Schafer, William D., Ed.
This document consists of papers published in the electronic journal "Practical Assessment, Research & Evaluation" during 2000-2001: (1) "Advantages of Hierarchical Linear Modeling" (Jason W. Osborne); (2) "Prediction in Multiple Regression" (Jason W. Osborne); (3) Scoring Rubrics: What, When, and How?"…
Brown, Joel H.
This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug,…
Burrows, Timothy J.
With the increase in frequency of the use of mixed methods, both in research publications and in externally funded grants there are increasing calls for a set of standards to assess the quality of mixed methods research. The purpose of this mixed methods study was to conduct a multi-phase analysis to create a preliminary rubric to evaluate mixed…
Smith, K.M.; Qin, J.; Weissmann, J.; Euritt, M.A.; Martello, M.T.
This report evaluates the full costs of transportation alternatives on the Houston-Harte Corridor in San Angelo, Texas. The alternatives examined include those considered by the San Angelo District of the Texas Department of Transportation, which are: (1) the continuation of the existing frontage lanes-only configuration and (2) the construction of the mainlanes for completion of the facility. In addition, this study considers each of the above alternatives with transit service along the corridor, resulting in the third and fourth scenarios. The results of MODECOST - a computer model developed by a Center for Transportation Research (CTR) team -- indicate that the addition of mainlanes to the Houston-Harte Corridor is both feasible and cost effective. The case studies conducted as part of this project show that, in many cases, the costs borne by users are equally or more significant than the facility cost in determining the cost implications of various transportation alternatives. The external costs, depending on the volumes of traffic expected along the corridor, may also be substantial. Demonstrating this complex relationship, this case study showed that the capital-intensive Houston-Harte project was, over time, more cost effective than no facility. This study also shows that full-cost analysis is an effective tool for comparing transportation alternatives. Full-cost analysis provides a value for each alternative that may be used as an assessment indicator to policy-makers and transportation professionals.
Salehi, Saeed; And Others
Two years of evaluation studies by the Maryland Education Technology Network (METN) are summarized in this report, which analyzes the effectiveness of school-based technology centers. During the first year of evaluation (1987), four questionnaires were administered at seven pilot schools to students, center coordinators, computer using teachers,…
Schneider, Margaret; Guerrero, Lourdes; Jones, Lisa B.; Tong, Greg; Ireland, Christine; Dumbauld, Jill; Rainwater, Julie
Purpose This pilot study describes the career development programs (i.e., NIH KL2 awards) across five Clinical and Translational Science Award (CTSA) institutions within the University of California (UC) system, and examines the feasibility of a set of common metrics for evaluating early outcomes. Methods A survey of program administrators provided data related to the institutional environment within which each KL2 program was implemented. Application and progress report data yielded a combined data set that characterized KL2 awardees, their initial productivity, and early career outcomes. Results The pilot project demonstrated the feasibility of aggregating common metrics data across multiple institutions. The data indicated that KL2 awardees were an accomplished set of investigators, both before and after the award period, representing a wide variety of disciplines. Awardees that had completed their trainee period overwhelmingly remained active in translational research conducted within an academic setting. Early indications also suggest high rates of success with obtaining research funding subsequent to the KL2 award. Conclusion This project offers a model for how to collect and analyze common metrics related to the education and training function of the CTSA Consortium. Next steps call for expanding participation to other CTSA sites outside of the University of California system. PMID:26602332
Medical research and evaluation facility and studies supporting the Medical Chemical Defense Program. Evaluation of the utility of human skin equivalents for studying HD-induced dermatotoxicity and evaluating antivesicant treatment regimens. Final report
Olson, C.T.; Snider, T.H.; Hobson, D.W.; Logel, C.A.; Johnson, J.B.
Two human skin culture models, also known as human skin equivalents (HSEs), and dermatomed (split thickness) natural human skin (NHS) were assessed for use in studies investigating the dermatotoxic effects of sulfur mustard BIS(2-CHLOROETHYL) SULFIDE; HD. The HSEs examined were model ZK1300 from Advanced Tissue Sciences (ATS, La Jolla, CA) and Epiderm from MatTek Corporation (Ashland, MA). NHS specimens were obtained either fresh from the Ohio State University branch of the Cooperative Human Tissue Network (Columbus, OH), or cryopreserved from the Ohio Valley Tissue and Skin Center (OVTSC, Cincinnati, OH). The utility of each skin model was assessed by histopathology and by several viability indices. Tissue samples were processed for both light and electron microscopy and examined for consistency among HSE lots and among NHS patients in exhibiting normal ultrastructural details. In particular, the samples were examined for the presence of a continuous, intact basement membrane and an epidermal-dermal interface resembling that found in normal, living human skin.
Birko, Stanislav; Dove, Edward S.; Özdemir, Vural
The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger’s Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss’ Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts’ opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency
Birko, Stanislav; Dove, Edward S; Özdemir, Vural
The extent of consensus (or the lack thereof) among experts in emerging fields of innovation can serve as antecedents of scientific, societal, investor and stakeholder synergy or conflict. Naturally, how we measure consensus is of great importance to science and technology strategic foresight. The Delphi methodology is a widely used anonymous survey technique to evaluate consensus among a panel of experts. Surprisingly, there is little guidance on how indices of consensus can be influenced by parameters of the Delphi survey itself. We simulated a classic three-round Delphi survey building on the concept of clustered consensus/dissensus. We evaluated three study characteristics that are pertinent for design of Delphi foresight research: (1) the number of survey questions, (2) the sample size, and (3) the extent to which experts conform to group opinion (the Group Conformity Index) in a Delphi study. Their impacts on the following nine Delphi consensus indices were then examined in 1000 simulations: Clustered Mode, Clustered Pairwise Agreement, Conger's Kappa, De Moivre index, Extremities Version of the Clustered Pairwise Agreement, Fleiss' Kappa, Mode, the Interquartile Range and Pairwise Agreement. The dependency of a consensus index on the Delphi survey characteristics was expressed from 0.000 (no dependency) to 1.000 (full dependency). The number of questions (range: 6 to 40) in a survey did not have a notable impact whereby the dependency values remained below 0.030. The variation in sample size (range: 6 to 50) displayed the top three impacts for the Interquartile Range, the Clustered Mode and the Mode (dependency = 0.396, 0.130, 0.116, respectively). The Group Conformity Index, a construct akin to measuring stubbornness/flexibility of experts' opinions, greatly impacted all nine Delphi consensus indices (dependency = 0.200 to 0.504), except the Extremity CPWA and the Interquartile Range that were impacted only beyond the first decimal point (dependency = 0
Alber, Julia; Paige, Samantha; Castro, Daniela; Singh, Briana
.92, SD 1.67); (3) pulmonary rehabilitation as a model for care (mean 3.72; SD 1.93); (4) quality of care coordination (mean 4.12, SD 2.41); and (5) comprehensive COPD patient education (mean 4.27, SD 2.38). Stakeholder comments on the relative importance of these care coordination topics primarily addressed the importance of comparing strategies for COPD symptom management and evaluating new methods for patient-provider communication. Approximately one half of the virtual panel assembled indicated that a Web-based stakeholder engagement network could enable more online community meetings (n=19/37, 51%) and facilitate more opportunities to suggest, comment on, and vote for new CER ideas in COPD (n=18/37, 49%). Conclusions Members of this unique virtual advisory board engaged in a structured Web-based communication process that identified the most important community-specific COPD care coordination research topics and questions. Findings from this study support the need for more CER that evaluates quality of care measures used to assess the delivery of treatments and interventions among medically underserved patients with COPD. PMID:26268741
Friedman, Myles I.
This document is an interim evaluation report of language development curriculums in full year Head Start programs operating in the five state area the Research and Evaluation Center serves. One experimental study in language development carried on in cooperation with the Texas and Tulane centers is reported in depth. The study was implemented in…
Dockrell, W. B.; And Others
This study of higher education efficiency evaluation consists of five country reports from five different regions of the world: Colombia, Jordan, Malaysia, the Netherlands, and Nigeria. The reports describe the approaches to the evaluation process in each country and in the process highlight common concerns and awareness. The studies were all…
... important work. Broad Medical Research Program at The Crohn's & Colitis Foundation (BMRP) Because the causes of IBD ... etiology, management, therapies, prevention, and eventual cures for Crohn's disease and ulcerative colitis. Learn more about this ...
Beile, Penny M.; Boote, David N.; Killingsworth, Elizabeth K.
Use of dissertation citation analysis for collection evaluation was investigated. Analysis of 1842 education dissertation citations from three institutions suggests the assumption of doctoral student expertise in their use of the scholarly literature may be overstated. For purposes of developing research collections, dependence on dissertation…
O'Donnell, Lisa; Bielby, Gill; Golden, Sarah; Morris, Marian; Walker, Matthew; Maguire, Sue
The Department for Education and Skills (Replace by the Department for Children, Schools and Families as of June 28, 2007) commissioned the National Foundation for Educational Research (NFER) to conduct an evaluation of the Youth Opportunity Fund and Youth Capital Fund (YOF/YCF). This summary presents the main findings from the interim report of…
Background The economic benefits of healthcare research require study so that appropriate resources can be allocated to this research, particularly in developing countries. As a first step, we performed a systematic review to identify the methods used to assess the economic impact of healthcare research, and the outcomes. Method An electronic search was conducted in relevant databases using a combination of specific keywords. In addition, 21 relevant Web sites were identified. Results The initial search yielded 8,416 articles. After studying titles, abstracts, and full texts, 18 articles were included in the analysis. Eleven other reports were found on Web sites. We found that the outcomes assessed as healthcare research payback included direct cost-savings, cost reductions in healthcare delivery systems, benefits from commercial advancement, and outcomes associated with improved health status. Two methods were used to study healthcare research payback: macro-economic studies, which examine the relationship between research studies and economic outcome at the aggregated level, and case studies, which examine specific research projects to assess economic impact. Conclusions Our study shows that different methods and outcomes can be used to assess the economic impacts of healthcare research. There is no unique methodological approach for the economic evaluation of such research. In our systematic search we found no research that had evaluated the economic return of research in low and middle income countries. We therefore recommend a consensus on practical guidelines at international level on the basis of more comprehensive methodologies (such as Canadian Academic of Health Science and payback frameworks) in order to build capacity, arrange for necessary informative infrastructures and promote necessary skills for economic evaluation studies. PMID:20196839
Thompson, Trevor DB; Weiss, Marjorie
Background Research in homeopathy has traditionally addressed itself to defining the effectiveness of homeopathic potencies in comparison to placebo medication. There is now increasing awareness that the homeopathic consultation is in itself a therapeutic intervention working independently or synergistically with the prescribed remedy. Our objective was to identify and evalute potential "active ingredients" of the homeopathic approach as a whole, in a prospective formal case series, which draws on actual consultation data, and is based on the MRC framework for the evaluation of complex interventions. Methods Following on from a theoretical review of how homeopathic care might mediate its effects, 18 patients were prospectively recruited to a case series based at Bristol Homeopathic Hospital. Patients, who lived with one of three index conditions, were interviewed before and after a five visit "package of care". All consultations were recorded and transcribed verbatim. Additional data, including generic and condition-specific questionnaires, artwork and "significant other" reports were collected. Textual data was subject to thematic analysis and triangulated with other sources. Results We judged that around one third of patients had experienced a major improvement in their health over the study period, a third had some improvement and a third had no improvement. Putative active ingredients included the patients' "openness to the mind-body connection", consultational empathy, in-depth enquiry into bodily complaints, disclosure, the remedy matching process and, potentially, the homeopathic remedies themselves. Conclusion This study has has identified, using primary consultation and other data, a range of factors that might account for the effectiveness of homeopathic care. Some of these, such as empathy, are non-specific. Others, such as the remedy matching process, are specific to homeopathy. These findings counsel against the use of placebo-controlled RCT designs in
Northwest Regional Educational Lab., Portland, OR.
This compilation of 17 courseware evaluations gives a general overview of available social studies microcomputer courseware for students in grades 1-12. Each evaluation lists title, date, producer, date of evaluation, evaluating institution, cost, ability level, topic, medium of transfer, required hardware, required software, instructional…
I Geil 48 Benesch 49 Niedenzu B/B+ 1 Marchand 26 El Batouay 9 Tuazon B 24 Maddou 33 Thompson23 Winefordner 21) Lauer 30) Me-’nzer 0’ SalK 7 Lin C 28...APOSR CHEMISTRY RESEARCH- EVALUATION CATE3GORY I CATEGORY TI A+36 Jonas 43 Field A 06 Hubbard 25 Williams 29 Bernstein 24 Smalley 19 Winograd * 14 Rice
Djalalinia, Sh; Owlia, P; Forouzan, A Setareh; Habibi, E; Dejman, M; Eftekhari, M Baradaran; Ghanei, M; Malekafzali, H; Peykari, N
Background: Knowledge production and evaluation are two important functions of health research system (HRS). In this article, we aimed to reveal the correlation between evaluation of health research organizations and health knowledge production promotion. Methods: A comprehensive evaluation system was developed to evaluate the academic performance of national medical science universities on an annual basis. It assess following domains; stewardship, capacity building and knowledge production. Measurable indicators for each domain were assigned, a ‘research profile’ for each department was provided. In this study, we compared the results of annually national Health Research System evaluation findings during 2005–2008. Results: The number of scientific articles has been increased from 4672 to 8816 during 2005 to 2008. It is mentionable that, the number of articles which has been published in indexed data bases has risen too. This fact could be related to directed policy for more international publication of scientific articles from Iran. The proportion of total articles to the number of academic members was 1.14 in 2008, comparing to 0.84 in 2005. It means that this proportion have increased about twice (0.7 Vs 0.45) during mentioned time. Moreover, other scientific products such as authored books based on domestic researches and cited articles in textbooks have increased according to special attention to knowledge production by policy makers. Conclusion: We conclude that Health System Research evaluation could be used as a mean for implementing policies and promoting knowledge production. PMID:23113133
Wanger, Charles B.; Childress, Judith
A journal evaluation study was conducted at the National Oceanic and Atmospheric Administration (NOAA) libraries to assist in subscription renewals, collection relevance enhancement, and determination of efficient methodology. Data collection included a use study, circulation and inter-library loan statistics, core journals, questionnaires, costs,…
Rid, Annette; Wendler, David
Essentially all guidelines and regulations require that biomedical research studies have an acceptable risk-benefit profile. However, these documents offer little concrete guidance for implementing this requirement and determining when it is satisfied. As a result, those charged with risk-benefit evaluations currently assess the risk-benefit profile of biomedical research studies in unsystematic ways, raising concern that some research participants are not being protected from excessive risks and that some valuable studies involving acceptable risk are being rejected. The present paper aims to address this situation by delineating the first comprehensive framework, which is based on existing guidelines and regulations as well as the relevant literature, for risk-benefit evaluations in biomedical research.
Hashim, Aslinda M.; Romli, Fakaruddin Fahmi; Zainal Osman, Zosipha
Nowadays Immersive Multimedia covers most usage in tremendous ways, such as healthcare/surgery, military, architecture, art, entertainment, education, business, media, sport, rehabilitation/treatment and training areas. Moreover, the significant of Immersive Multimedia to directly meet the end-users, clients and customers needs for a diversity of feature and purpose is the assembly of multiple elements that drive effective Immersive Multimedia system design, so evaluation techniques is crucial for Immersive Multimedia environments. A brief general idea of virtual environment (VE) context and `realism' concept that formulate the Immersive Multimedia environments is then provided. This is followed by a concise summary of the elements of VE assessment technique that is applied in Immersive Multimedia system design, which outlines the classification space for Immersive Multimedia environments evaluation techniques and gives an overview of the types of results reported. A particular focus is placed on the implications of the Immersive Multimedia environments evaluation techniques in relation to the elements of VE assessment technique, which is the primary purpose of producing this research. The paper will then conclude with an extensive overview of the recommendations emanating from the research.
Analyzed data for 167 social sciences classes and 65 faculty members to study the relationship between faculty research productivity and student evaluations of teaching (SETs). A significant positive relationship between research productivity and SETs emerges when the distribution of citations is corrected for skewness. (SLD)
Yin, Robert K.
In the last 10 years, there has been increased use of case study methodology, with accompanying refinement and improvement of the methods. Case studies have become legitimate research methods in evaluation, but it is too soon to say whether improvements in methodology are really resulting in improvements in the case studies conducted. (SLD)
Jones, Kerina H; Ford, David V; Jones, Chris; Dsilva, Rohan; Thompson, Simon; Brooks, Caroline J; Heaven, Martin L; Thayer, Daniel S; McNerney, Cynthia L; Lyons, Ronan A
With the current expansion of data linkage research, the challenge is to find the balance between preserving the privacy of person-level data whilst making these data accessible for use to their full potential. We describe a privacy-protecting safe haven and secure remote access system, referred to as the Secure Anonymised Information Linkage (SAIL) Gateway. The Gateway provides data users with a familiar Windows interface and their usual toolsets to access approved anonymously-linked datasets for research and evaluation. We outline the principles and operating model of the Gateway, the features provided to users within the secure environment, and how we are approaching the challenges of making data safely accessible to increasing numbers of research users. The Gateway represents a powerful analytical environment and has been designed to be scalable and adaptable to meet the needs of the rapidly growing data linkage community.
Leach, Ronald J.
The purpose of this project was to study the feasibility of reusing major components of a software system that had been used to control the operations of a spacecraft launched in the 1980s. The study was done in the context of a ground data processing system that was to be rehosted from a large mainframe to an inexpensive workstation. The study concluded that a systematic approach using inexpensive tools could aid in the reengineering process by identifying a set of certified reusable components. The study also developed procedures for determining duplicate versions of software, which were created because of inadequate naming conventions. Such procedures reduced reengineering costs by approximately 19.4 percent.
Cronin, Paul; Rawson, James V; Heilbrun, Marta E; Lee, Janie M; Kelly, Aine M; Sanelli, Pina C; Bresnahan, Brian W; Paladin, Angelisa M
Incomplete reporting hampers the evaluation of results and bias in clinical research studies. Guidelines for reporting study design and methods have been developed to encourage authors and journals to include the required elements. Recent efforts have been made to standardize the reporting of clinical health research including clinical guidelines. In this article, the reporting of diagnostic test accuracy studies, screening studies, therapeutic studies, systematic reviews and meta-analyses, cost-effectiveness assessments (CEA), recommendations and/or guidelines, and medical education studies is discussed. The available guidelines, many of which can be found at the Enhancing the QUAlity and Transparency Of health Research network, on how to report these different types of health research are also discussed. We also hope that this article can be used in academic programs to educate the faculty and trainees of the available resources to improve our health research.
Sutphin, Dean; Newsom-Stewart, Mhora
A pilot study was conducted to field test instruments that could be used to assess, evaluate, and improve curricula to be used in the Agri Tech Prep 2000 (ATP 2000) project. The project features a 4-year tech prep program linking New York high school and postsecondary curricula to prepare students for careers in agriculture or acceptance into a…
Furlong, John; Salisbury, Jane
The Best Practice Research Scholarship programme (BPRS) was one of a series of initiatives designed by the English Department for Educational Studies (DfES) between 2000 and 2003, to support teachers' continuing professional development. Each year, around 1,000 Scholarships of up to 3,000 British pounds each, were awarded to serving classroom…
The Czech research evaluation policy was rooted in an instrumental paradigm of policy process and evidence embodied in metrics-based cost-benefit logic. But this framework disintegrated when confronted with actual institutional interests. Based on the ethnography of university departments, this study shows how academics challenged the notion of…
Labin, Susan N.; Duffy, Jennifer L.; Meyers, Duncan C.; Wandersman, Abraham; Lesesne, Catherine A.
The continuously growing demand for program results has produced an increased need for evaluation capacity building (ECB). The "Integrative ECB Model" was developed to integrate concepts from existing ECB theory literature and to structure a synthesis of the empirical ECB literature. The study used a broad-based research synthesis method with…
Coelho, Ardigleusa Alves; Martiniano, Cláudia Santos; Brito, Ewerton Willian Gomes; Negrão, Oswaldo Gomes Corrêa; Arcêncio, Ricardo Alexandre; Uchôa, Severina Alice da Costa
OBJECTIVE: to verify whether the tuberculosis control program (TCP) is evaluable and to examine the feasibility of building an evaluation model in apriority municipality for the control of tuberculosis. METHOD: this evaluability study was conducted in a municipality in northeastern Brazil. For data collection, documental analysis and interviews with key informants were performed. For indicator validation, the nominal group technique was adopted. RESULTS: the details of TCP were described, and both the logical model and the classification framework for indicators were developed and agreed up on, with the goal of characterizing the structural elements of the program, defining the structure and process indicators, and formulating the evaluation questions. CONCLUSION: TCP is evaluable. Based on logical operational analysis, it was possible to evaluate the adequacy of the program goals for the control of tuberculosis. Therefore, the performance of a summative evaluation is recommended, with a focus on the analysis of the effects of tuberculosis control interventions on decreasing morbidity and mortality. PMID:25493675
HOLMES, DAVID S.; AND OTHERS
THREE STUDIES OF PRESCHOOL CHILDREN ARE INCLUDED IN THIS EVALUATION REPORT. (1) "'NEURAL CONDUCTIVITY' AND ACHIEVEMENT IN CULTURALLY DEPRIVED STUDENTS." NEURAL CONDUCTIVITY WAS INFERRED FROM A CORRELATION BETWEEN PUPILLARY RESPONSE AND CHILDREN'S PRESCHOOL PERFORMANCE. COMPLICATIONS IN ACQUIRING AND USING THE NECESSARY EQUIPMENT RESULTED…
Zeren Özer, Dilek; Güngör, Sema Nur; Özkan, Muhlis
This study evaluates, through the employment of scientific methods and techniques, a total of 107 Biology projects submitted by secondary education students to the Bursa Region Coordinatorship of TUBITAK (a region which encompasses the municipalities of Afyonkarahisar, Balikesir, Bilecik, Canakkale, Eskisehir, Kutahya, and Yalova). The projects…
Arnold, Jenny; Clarke, David
The purpose of this paper is to justify and reflect upon the way in which video technologies were employed in data generation for a study of student agency in a science classroom using discursive psychology. The research was designed with the purpose of providing new understanding of how students develop a sense of themselves as responsible agents…
... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation criteria for research proposals. 3406.20... RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE 1890 INSTITUTION CAPACITY BUILDING GRANTS PROGRAM Review and Evaluation of a Research Proposal § 3406.20 Evaluation criteria for...
Office of Postsecondary Education, US Department of Education, 2012
The International Research and Studies Program supports surveys, studies, and instructional materials development to improve and strengthen instruction in modern foreign languages, area studies, and other international fields. The purpose of the program is to improve and strengthen instruction in modern foreign languages, area studies and other…
Risser, John J.; Tulley, John E.
A research study at Pasadena City College in 1975-76 evaluated a computer based career guidance program, SIGI (System of Interactive Guidance and Information), designed by Educational Testing Service to assist community college students in improving their ability to make career decisions. Students identified as desiring aid in career guidance were…
Morahan, Page S; Yamagata, Hisashi; McDade, Sharon A; Richman, Rosalyn; Francis, Ray; Odhner, Victoria C
Since the mid-1990s, the protection of human subjects through institutional review boards (IRBs) has progressively broadened in scope. In this case study, the authors describe their challenges in effectively handling IRB processes to conduct educational and social sciences research within academic health centers, particularly (1) complications in conducting longitudinal interinstitutional research that involves multiple IRBs, each with different procedures that changed over ten years; and (2) factors affecting consent form and survey response rates when applying the biomedical IRB process to obtain the consent of human subjects for participation in social and educational research. The authors had a unique opportunity to follow the effect of changes in consent forms (from no form to a one-page form to a three-page form requiring signature of a witness), ways of administration (in person or by mail), and time of administration (at the time of the program or years later) on consent form and survey response rates among medical and dental school faculty members. The authors explore the extended timelines required for data collection and increased costs in dealing with these issues, as well as the effects on response rates of consent form language and administration procedures. The authors recommend strategies to lessen adverse effects of dealing with multiple IRBs at different institutions for social science and educational research, and discuss policy implications for funders, institutions and investigators.
Charlton, Karen; Menyanu, Elias; Biritwum, Richard Berko; Naidoo, Nirmala; Pieterse, Chiné; Madurai, Savathree (Lorna); Baumgartner, Jeannine; Asare, George A; Thiele, Elizabeth; Schutte, Aletta E; Kowal, Paul
Introduction Attempting to curb the rising epidemic of hypertension, South Africa implemented legislation in June 2016 mandating maximum sodium levels in a range of manufactured foods that contribute significantly to population salt intake. This natural experiment, comparing two African countries with and without salt legislation, will provide timely information on the impact of legislative approaches addressing the food supply to improve blood pressure in African populations. This article outlines the design of this ongoing prospective nested cohort study. Methods and analysis Baseline sodium intake was assessed in a nested cohort of the WHO Study on global AGEing and adult health (WHO-SAGE) wave 2 (2014–2015), a multinational longitudinal study on the health and well-being of adults and the ageing process. The South African cohort consisted of randomly selected households (n=4030) across the country. Spot and 24-hour urine samples are collected in a random subsample (n=1200) and sodium, potassium, creatinine and iodine analysed. Salt behaviour and sociodemographic data are captured using face-to-face interviews, alongside blood pressure and anthropometric measures. Ghana, the selected control country with no formal salt policy, provided a nested subsample (n=1200) contributing spot and 24-hour urine samples from the SAGE Ghana cohort (n=5000). Follow-up interviews and urine collection (wave 3) in both countries will take place in 2017 (postlegislation) to assess change in population-level sodium intake and blood pressure. Ethics and dissemination SAGE was approved by the WHO Ethics Review Committee (reference number RPC149) with local approval from the North-West University Human Research Ethics Committee and University of the Witwatersrand Human Research Ethics Committee (South Africa), and University of Ghana Medical School Ethics and Protocol Review Committee (Ghana). The results of the study will be published in peer-reviewed international journals
In this article I argue for the defining importance of document study for researchers in curriculum. Two examples of previous analyses are provided, one demonstrating an approach to language analysis of the "Australian Curriculum: English" from the Literature strand, the other a study of the relationship of curricula to each other in…
Delin, G.N.; Landon, M.K.; Anderson, J.L.; Dowdy, R.H.
The Management Systems Evaluation Area (MSEA) program is part of a multi-scale, inter-agency initiative to evaluate the effects of agricultural management systems on water quality. The program resulted from the integration of the U.S. Department of Agriculture (USDA) Research Plan for Water Quality and the U.S Geological Survey (USGS) Mid-Continent Herbicide Initiative and is part of the President's Water Quality Initiative. The mid-continental corn belt was selected for study because it is an area where about 60% of the Nation's pesticides and nitrogen fertilizers are used.
Abdoler, Emily; Roberson-Nay, Roxann; Pine, Daniel S.; Wendler, David
Abstract Objectives: Many guidelines and regulations allow children and adolescents to be enrolled in research without the prospect of clinical benefit when it poses minimal risk. However, few systematic methods exist to determine when research risks are minimal. This situation has led to significant variation in minimal risk judgments, raising concern that some children are not being adequately protected. To address this concern, we describe a new method for implementing the widely endorsed “risks of daily life” standard for minimal risk. This standard defines research risks as minimal when they do not exceed the risks posed by daily life activities or routine examinations. Methods: This study employed a conceptual and normative analysis, and use of an illustrative example. Results: Different risks are composed of the same basic elements: Type, likelihood, and magnitude of harm. Hence, one can compare the risks of research and the risks of daily life by comparing the respective basic elements with each other. We use this insight to develop a systematic method, direct comparative analysis, for implementing the “risks of daily life” standard for minimal risk. The method offers a way of evaluating research procedures that pose the same types of risk as daily life activities, such as the risk of experiencing anxiety, stress, or other psychological harm. We thus illustrate how direct comparative analysis can be applied in practice by using it to evaluate whether the anxiety induced by a respiratory CO2 challenge poses minimal or greater than minimal risks in children and adolescents. Conclusions: Direct comparative analysis is a systematic method for applying the “risks of daily life” standard for minimal risk to research procedures that pose the same types of risk as daily life activities. It thereby offers a method to protect children and adolescents in research, while ensuring that important studies are not blocked because of unwarranted concerns about
Driven by an impetus to standardize, numerous checklists have been devised to address quality in qualitative research, but these standards and the mindset driving them offer no language with which to speak about taste, or the aesthetic sensibilities that play such a key role in evaluating the goodness of any object. In this article, quality appraisal in qualitative research is considered in the context of taste, that is, in the discernment involved in judging the value of research and in the recognition of the key role reviewer preferences, sensibilities and membership in one or more taste communities play in these judgements. The evaluation of a study is accomplished by evaluating one or more reports from that study, and such reports may be conceived as art forms amenable to the same criteria for appraisal as poems or paintings. Taste implies judgements about the quality of objects and a person's ability to sift through and select from a store of knowledge that knowledge appropriate to judge its value. What binds a community of practitioners (here reviewers of qualitative studies) together is taste-making, or the constant refinements of judgements concerning what constitutes good and bad practice.
Research and evaluation are tools that can help validate experiential education practice and provide a better understanding of it. Defines types of research and evaluation and discusses the benefits of these activities. Reasons for conducting research include (1) gaining support and credibility; (2) program improvement; and (3) marketing. (KS)
Hella, R.; Locke, E.; Ream, S.
High power laser welding was evaluated for fabricating space vehicle boosters. This evaluation was made for 1/4 in. and 1/2 in. aluminum (2219) and 1/4 in. and 1/2 in. D6AC steel. The Avco HPL 10 kW industrial laser was used to perform the evaluation. The objective has been achieved through the completion of the following technical tasks: (1) parameter study to optimize welding and material parameters; (2) preparation of welded panels for MSFC evaluation; and (3) demonstration of the repeatability of laser welding equipment. In addition, the design concept for a laser welding system capable of welding large space vehicle boosters has been developed.
Whipple, Ellen E.; Hughes, Anne; Bowden, Susan
This article examines the experience of 24 BSW students in a faculty-mentored undergraduate research experience (URE) over the course of 1 academic year. In particular, we sought to better understand students' self-perceived sense of competency across 15 specific research skills. In addition, we examined the URE's impact on students' knowledge…
Medical Research and Evaluation Facility (MREF) and studies supporting the Medical Chemical Defense Program on Task 89-01: Screening of candidate pretreatment and therapeutic compounds in in vivo models. Final report Jul 89-Sep 91
Olson, C.T.; Kiser, R.C.; Dill, G.S.
This task was a continuation of Task 86-29 initiated for Contract D. It provided in vivo screens for evaluating the efficacy of candidate pretreatment and treatment compounds submitted by the Drug Assessment Division of U.S. Army Medical Research of Chemical Defense against soman, tabun, and/or cyanide. A total of 578 compounds were received for testing and their maximum solubility in-vehicles comparable with in vivo testing in mice was determined. Range-finding and median lethal dose determinations following IM and/or oral administrations were conducted for 436 compounds submitted for nerve agent screening and range finding and median lethal dose determinations following IP administration were conducted for up to 142 compounds submitted for cyanide screening. Of 332 compounds evaluated, 154 passed the GD treatment efficacy evaluation, and 90 of 156 compounds submitted passed the GA treatment efficacy evaluation. For pretreatment studies against a GD challenge, 224 of 379 compounds submitted passed the IM efficacy evaluation and 96 of 143 compounds submitted passed the oral efficacy evaluation. Only 12 of 133 compounds evaluated as cyanide pretreatment compounds passed the efficacy evaluations. The mission of Task 89-01 was combined under Task 91-20 for the duration of Contract DAMD17-89-C-9050.
Brandenburg, Marci D.; Doss, Alan; Frederick, Tracie E.
The goal of this study was to conduct an outcomes-based evaluation of the National Cancer Institute-Frederick (NCI-F) Scientific Library’s Laptop Librarian service, where librarians took a laptop and spent time in research buildings. The authors used statistics from the Laptop Librarian sessions, a NCI-F community-wide online survey, and in-person interviews to evaluate the service. The Laptop Librarian service increased the accessibility of librarians and saved patrons’ time. Users gained useful information and expressed overall satisfaction with the service. The Laptop Librarian service proves to be a useful means for increasing access to librarians and providing users with necessary information at this government research facility. PMID:20677065
Brandenburg, Marci D; Doss, Alan; Frederick, Tracie E
The goal of this study was to conduct an outcomes-based evaluation of the National Cancer Institute-Frederick (NCI-F) Scientific Library's Laptop Librarian service, where librarians took a laptop and spent time in research buildings. The authors used statistics from the Laptop Librarian sessions, a NCI-F community-wide online survey, and in-person interviews to evaluate the service. The Laptop Librarian service increased the accessibility of librarians and saved patrons' time. Users gained useful information and expressed overall satisfaction with the service. The Laptop Librarian service proves to be a useful means for increasing access to librarians and providing users with necessary information at this government research facility.
Jarrett, Robert D.
An evaluation of historic flood estimates in mountainous areas in Colorado was made to assess their accuracy. The purpose of this evaluation is to enhance awareness of the need to assess the accuracy of historic flood peaks, particularly floods of record, because they are such a critical factor in flood-plain management, design of hydraulic structures in flood plains, and related environmental studies. Research needs based on a proposed river-system-process approach are suggested. A critical need exists for interdisciplinary documentation of extreme-flood processes, particularly to improve methods to directly measure extreme floods and quantify total energy losses. Such research will benefit the public through improved engineering designs and environmental investigations.
Moyer, Kerry L.
Four evaluation methods for determining educational policy are objectivism; subjectivism; emotive-imperative; and instrumentalism. For the objectivist, the rationale for undertaking an evaluation is based on empirical verification or non-verification of claims of existing policies or activities. Secondly, the objectivist is interested in…
Terzi, Alberto; Bertolaccini, Luca
In this short review, we’ll try to specify the differences between evaluation procedures of groups of data, as they present to researchers. The way and time data are gathered defines the type of study is going to shape. When we observe a cluster of data without deliberately interfering with the process we mean to evaluate, we perform an observational study. Observational studies are the main topic of this issue. Upon the contrary, experimental studies imply the direct action of the observer on the study population in order to define the role of a given exposure. The topic of experimental study design will be covered in another issue of this series. PMID:27747029
Liberty, Kathleen A.; Laver, Alison; Sabatino, Deborah
This article contrasts the traditional relationships between researchers and subjects in traditional rehabilitation evaluation and research with relationships between researchers and clients-consumers in new methodologies. Collaborative research, characterized by shared power and non-hierarchical authority between client-consumers and researchers…
Alexander, Leslie B.; Richman, Kenneth A.
This article addresses ethical dilemmas experienced by street-level research and evaluation workers recruiting and gathering data in community-based research projects. The authors focus on a subgroup of street-level research workers, whom they call research extenders (REs), employed because they share important characteristics with the target…
Creswell, John W.
When institutional personnel assess faculty research performance, they should consider the extent to which the institution rewards research, ways to encourage faculty to be productive, criteria for evaluating research performance, and the specific steps useful in reviewing research performance within academic units. (Author/MSE)
Reed, Winifred L., Ed.; Decker, Scott H., Ed.
This collection of papers presents a representative selection of the National Institute of Justice's portfolio of gang-related research. The 10 papers are: (1) "A Decade of Gang Research: Findings of the National Institute of Justice Gang Portfolio" (Scott H. Decker); (2) "The Evolution of Street Gangs: An Examination of Form and…
Grantham, W. D.; Smith, P. M.; Deal, P. L.
Piloted-simulator studies were conducted to determine takeoff and landing operating procedures for a supersonic cruise research transport concept that result in predicted noise levels which meet current Federal Aviation Administration (FAA) certification standards. With the use of standard FAA noise certification test procedures, the subject simulated aircraft did not meet the FAA traded-noise-level standards during takeoff and landing. However, with the use of advanced procedures, this aircraft meets the traded-noise-level standards for flight crews with average skills. The advanced takeoff procedures developed involved violating some of the current Federal Aviation Regulations (FAR), but it was not necessary to violate any FAR noise-test conditions during landing approach. Noise contours were also determined for some of the simulated takeoffs and landings in order to indicate the noise-reduction advantages of using operational procedures other than standard.
Goeman, Dianne; Michael, J; King, J; Luu, Huy; Emmanuel, Claire; Koch, S
Objective The aim of the Vietnamese Dementia talking-book was to address low health literacy in older people of Vietnamese background living with dementia through the provision of an online resource to help individuals, their families and carers better understand and manage this condition and provide information about available dementia services. Design This qualitative study used codesign and participatory action research to develop and refine the talking-book in consultation with expert stakeholders, a consumer advocacy group and the Vietnamese community to assess its utility and ensure cultural and linguistic appropriateness and relevance. Participants 59 members of the Vietnamese community, 11 stakeholders from community health services and ethnic agencies, consumer advocacy groups and the research team participated in the codesign and refinement of the talking-book. 22 members of the Vietnamese community appraised the final product. Setting Vietnamese community planned activity groups in the Western, Northern and Southern suburbs of Melbourne, Australia. Results Our codesign study outlines the process required to develop a Vietnamese Dementia Talking-Book resource partnering with consumers and expert stakeholders to identify consumer need, selection of the content and appropriate language level, construction of the book, measuring acceptability of the talking-book, modification based on feedback and production and dissemination. Feedback on the final version of the talking-book revealed widespread consensus that the book enhanced the knowledge of members of the Vietnamese community in regard to understanding dementia and navigation and accessing of available services. Conclusions This free internationally available online Vietnamese Dementia Talking-Book facilitates improved dementia-related health literacy in the Vietnamese community. The book also serves as a tool to facilitate the provision of care to Vietnamese people living with memory loss by assisting
Sindhwani, R.; Kumar, S.; Goyal, P.
Meteorological parameters play a very significant and crucial role in simulating regional air quality. This study has been carried to evaluate the performance of WRF model to various combinations of physical parameterization schemes for predicting surface and upper air meteorology around the capital city of India, Delhi popularly known as National Capital Region (NCR). Eight sensitivity experiments has been conducted to find the best combination of the parameterization schemes for the study area during summer (4th - 18th April, 2010 ) season. The model predicted surface temperatures at 2m, relative humidity at 2m and wind speeds at 10m are compared with the observations from Central Pollution Control Board (at Dwarka and Shadipur monitoring stations) and Indian Meteorological Department (VIDP and VIDD stations) whereas the upper-air potential temperature profile and wind speed profile are validated using Wyoming Weather Web data archive at VIDD station. The qualitative and quantitative analysis of simulations indicate that for temperature and relative humidity, the combination consisting of Yonsei Unversity (YSU) as the Planetary Boundary Layer (PBL) scheme, the Monin Obhukhov as the surface layer (SL) scheme along with NOAH land surface model (LSM) has been found to be performing better than other combinations. The combination consisting of Mellor Yamada Janjic (Eta) as the PBL scheme, Monin Obhukhov Janjic (Eta) as the SL scheme and Noah LSM performs reasonably well in reproducing the observed wind conditions. This indicates that the selection of parameterization schemes may depend on the intended application of the model for a given region.
At least half of Portugal's scientific research “units” will receive either no cash or only limited funds over the next five years from the country's main funding agency, the Science and Technology Foundation (FCT).
Argues that empiricism has a role as a complement to humanistic methodologies in composition research. Humanistic methodologies yield the stuff of hypotheses; empirically proven hypotheses provide further ground for humanistic interpretation. (MS)
This review examines the modeling research needs to support environmental decision-making for the 303(d) requirements for development of total maximum daily loads (TMDLs) and related programs such as 319 Nonpoint Source Program activities, watershed management, stormwater permits...
This article explores perspectives on qualitative research and the variety of views concerning rigour in the research process. Evaluating and ensuring the quality of research are essential considerations for practitioners who are appraising evidence to inform their practice or research. Several criteria and principles for evaluating quality in qualitative research are presented, recognising that their application in practice is influenced by the qualitative methodology used. The article examines a range of techniques that a qualitative researcher can use to promote rigour and apply it to practice.
This evaluation plan, which is updated annually, provides a synthesis of the various evaluation activities of Mid-continent Research for Education and Learning (McREL). During 1999, the fourth year of the Laboratory's contract period with the Office of Educational Research and Improvement, special studies and integrated studies were designed to…
Wang, Litao; Zhang, Yang; Wang, Kai; Zheng, Bo; Zhang, Qiang; Wei, Wei
An extremely severe and persistent haze event occurred over the middle and eastern China in January 2013, with the record-breaking high concentrations of fine particulate matter (PM2.5). In this study, an online-coupled meteorology-air quality model, the Weather Research and Forecasting Model with Chemistry (WRF/Chem), is applied to simulate this pollution episode over East Asia and northern China at 36- and 12-km grid resolutions. A number of simulations are conducted to examine the sensitivities of the model predictions to various physical schemes. The results show that all simulations give similar predictions for temperature, wind speed, wind direction, and humidity, but large variations exist in the prediction for precipitation. The concentrations of PM2.5, particulate matter with aerodynamic diameter of 10 μm or less (PM10), sulfur dioxide (SO2), and nitrogen dioxide (NO2) are overpredicted partially due to the lack of wet scavenging by the chemistry-aerosol option with the 1999 version of the Statewide Air Pollution Research Center (SAPRC-99) mechanism with the Model for Simulating Aerosol Interactions and Chemistry (MOSAIC) and the Volatility Basis Set (VBS) for secondary organic aerosol formation. The optimal set of configurations with the best performance is the simulation with the Gorddard shortwave and RRTM longwave radiation schemes, the Purdue Lin microphysics scheme, the Kain-Fritsch cumulus scheme, and a nudging coefficient of 1 × 10-5 for water vapor mixing ratio. The emission sensitivity simulations show that the PM2.5 concentrations are most sensitive to nitrogen oxide (NOx) and SO2 emissions in northern China, but to NOx and ammonia (NH3) emissions in southern China. 30% NOx emission reductions may result in an increase in PM2.5 concentrations in northern China because of the NH3-rich and volatile organic compound (VOC) limited conditions over this area. VOC emission reductions will lead to a decrease in PM2.5 concentrations in eastern China
Bai, Sen; Liao, Xiaofeng; Chen, Jinyu; Liu, Yijun; Wang, Xiao
This paper discussed the evaluation problem of image scrambling degree (ISD). Inspired by the evaluation method of image texture characteristics, three new metrics for assessing objectively the ISD were proposed. The first method utilized the performance of energy concentration of Walsh transformation (WT), which took into account the properties that a good ISD measurement method should be contented. The second method used angular second moment (ASM) of image gray level co-occurrence matrix (GLCM). The third method combined the entropy of GLCM with image texture characteristic. Experimental results show that the proposed metrics are effective to assess the ISD, which correlates well with subjective assessment. Considering the computational complexity, the first evaluation method based on WT is remarkably superior to the method based on ASM and GLCM in terms of the time cost.
Researchers using qualitative methodologies appear to be particularly prone to having their study designs called into question by research ethics or funding agency review committees. In this paper, the author considers the issue of communicating qualitative research study designs in the context of institutional research ethics review and offers…
MALEKZADEH, Reza; AKHONDZADEH, Shahin; EBADIFAR, Asghar; BARADARAN EFTEKHARI, Monir; OWLIA, Parviz; GHANEI, Mostafa; FALAHAT, Katayoun; HABIBI, Elham; SOBHANI, Zahra; DJALALINIA, Shirin; PAYKARI, Niloofar; MOJARRAB, Shahnaz; ELTEMASI, Masoumeh; LAALI, Reza
Background: Governance is one of the main functions of Health Research System (HRS) that consist of four essential elements such as setting up evaluation system. The goal of this study was to introduce a new web based research evaluation model in Iran. Methods: Based on main elements of governance, research indicators have been clarified and with cooperation of technical team, appropriate software was designed. Three main steps in this study consist of developing of mission-oriented program, creating enabling environment and set up Iran Research Medical Portal as a center for research evaluation. Results: Fifty-two universities of medical sciences in three types have been participated. After training the evaluation focal points in all of medical universities, access to data entry and uploading all of documents were provided. Regarding to mission – based program, the contribution of medical universities in knowledge production was 60% for type one, 31% for type two and 9% for type three. The research priorities based on Essential National Health Research (ENHR) approach and mosaic model were gathered from universities of medical sciences and aggregated to nine main areas as national health research priorities. Ethical committees were established in all of medical universities. Conclusion: Web based research evaluation model is a comprehensive and integrated system for data collection in research. This system is appropriate tool to national health research ranking. PMID:27957437
Aimed at those individuals who are in a position to hire or promote educational researchers or evaluators, this paper provides some practical suggestions for assessing these personnel. Selection of a research or evaluation (R and E) firm is not treated separately from the task of hiring an individual; the quality of work done by a firm depends…
Anninos, Loukas N.
The bibliometric methodology is an established technique for research evaluation as it offers an objective determination and comparison of research performance. This paper aims to critically assess some standard bibliometric indicators commonly used (based on publication and citation counts) to evaluate academic units, and examine whether there…
Herman, Joan; And Others
The papers in this monograph address an issue of importance to educational policy and practice: the use of testing and evaluation to assess the quality of education and to facilitate school improvement. The authors consider the traditional role that testing has played in accountability and the role that assessment and evaluation can and should…
Gao, Hong-yang; Li, Qing-na; Zhao, Yang; Li, Bo; Rui, Gao
Current clinical evaluation of literature quality has various ways. Most of them lay special emphasis on the evaluation of the design quality, but the evaluation of the implementation process quality is not perfect. Especially data management is not fully emphasized during the enforcement of clinical trials. Data from clinical research were bases for evaluating clinical findings. Although strict specifications and requirements for data management might be strictly written clearly in research protocols, they were not embodied in current clinical research evidence evaluation system. Data management is an important part of implementing the whole clinical trial process, which is a comprehensive reflection of data collecting, logging, sorting, and managing. Its objective is to obtain high quality research data for statistical analysis, thereby coming to a true and reliable conclusion. In order to overall evaluating clinical design and implement, we suggest that present quality evaluation indicators of clinical trails should be completed, and add data management quality evaluation during the whole implement process. Data management plans, standards and requirements for data checking, and management regulations for disobeying data and exception data should be added in quality evaluation indicators for clinical research evidence. The effect of data management quality on clinical research evidence evaluation should be emphasized.
Cordero-Villafáfila, Amelia; Ramos-Brieva, Jesus A
The RC algorithm quantitatively evaluates the personal impact factor of the scientific production of isolated researchers. The authors propose an adaptation of RC to evaluate the personal impact factor of research centers, hospitals and other research groups. Thus, these could be classified according to the accredited impact of the results of their scientific work between researchers of the same scientific area. This could be useful for channelling budgets and grants for research.
Evaluation is an important tool to develop and retain skilled employees. It should be used to recognize employees that are performing well, to identify areas for growth and to provide employees with clear, explicit feedback about their performance. An agreed upon appraisal system lets employees know what is expected, what is recognized and…
Rose, Janet; Godin, Donn
The Charleston County School District's efforts to increase the percentage of students meeting high school graduation requirements at the appropriate age and the percentage of students who graduate within 6 years of entry into grade 9 require a well-designed plan for monitoring their success. Evaluation of those efforts depends upon the use of…
Struyk, Raymond J.; Damon, Mawadda; Haddaway, Samuel R.
The international community has identified a positive link between good governance and economic development. There is an increasing appreciation of the effective role that local policy research organizations (PROs) can play in providing evidence-based policy recommendations as the basis for sound legislation and in assessing the efficacy of…
Allensworth, Nicole J.
Social penetration has been described by S.W. Littlejohn (1992) as "the process of increasing disclosure and intimacy in a relationship." The phrase "social penetration" originated with I. Altman and D. Taylor, the foremost researchers in this area. From other theories, Altman and Taylor developed a unified theory which…
... Evaluation and Research (CBER) is announcing an invitation to sponsors of investigational new drug (IND... HUMAN SERVICES Food and Drug Administration Center for Biologics Evaluation and Research eSubmitter Pilot Evaluation Program for Investigational New Drug Applications AGENCY: Food and Drug...
Ntiri, Daphne Williams, Ed.
This document contains an evaluation handbook for adult literacy programs and feedback from/regarding the evaluation instruments developed during the project titled Adult Literacy and Evaluation Research Team (also known as Project ALERT), a two-phase project initiated by the Detroit Literacy Coalition (DLC) for the purpose of developing and…
Buckingham, Robert W., III; Foley, Susan H.
Pressure for greater accountability is being exerted on programs for care of terminally ill and increasing demand for evaluation research. Components, implications, and limitations of evaluation systems are discussed, and their application in the terminal care setting addressed. Buckingham evaluation of hospice home care service is cited as a…
Zhang, Shaoqiang; Han, Weiqiang; Cui, Lanfang
In some professional image application fields, we need to test some key parameters of the CMOS camera and evaluate the performance of the device. Aiming at this requirement, this paper proposes a perfect test method to evaluate the CMOS camera. Considering that the CMOS camera has a big fixed pattern noise, the method proposes the `photon transfer curve method' based on pixels to measure the gain and the read noise of the camera. The advantage of this method is that it can effectively wipe out the error brought by the response nonlinearity. Then the reason of photoelectric response nonlinearity of CMOS camera is theoretically analyzed, and the calculation formula of CMOS camera response nonlinearity is deduced. Finally, we use the proposed test method to test the CMOS camera of 2560*2048 pixels. In addition, we analyze the validity and the feasibility of this method.
A University of Washington study that found professors who are easy graders receive better evaluations than those who are tougher, and another study showing faculty enthusiasm alone raises student evaluations, have shaken a long-standing consensus among researchers that student evaluations are a good measure of a teacher's skills. Most…
Zhang, Tao; Maron, Deborah J.; Charles, Christopher C.
This article reports results from an empirical usability evaluation of Human-Animal Bond Research Initiative Central as part of the effort to develop an open access research repository and collaboration platform for human-animal bond researchers. By repurposing and altering key features of the original HUBzero system, Human-Animal Bond Research…
Funding organisations are increasingly asking academics to show evidence of the economic and social value generated by their research. These requests have often been associated with the emergence of a so-called "new social contract for research" and are related to the implementation of new research evaluation systems. Although the…
Design-based implementation research offers the opportunity to rethink the relationships between intervention, research, and situation to better attune research and evaluation to the program development process. Using a heuristic called the intervention development curve, I describe the rough trajectory that programs typically follow as they…
Ryan, Marybeth; Aloe, Karen
Research utilization and evidence-based practice are processes that require nurses to have research knowledge and skills. Yet many nurses are fearful of research and avoid reading nursing research studies or using research in their practice. Members of a hospital's Nursing Research Team developed nursing research self-study modules for use by the nursing staff. The goal of this innovative project was to enhance a nurse's ability to critically read nursing research studies and determine their usefulness for practice. As a result, it is hoped that nurses will be more knowledgeable about research and more comfortable participating in the evidence-based practice and research utilization processes. The development, implementation, and evaluation of nursing research self-study modules are described and implications for nursing practice identified.
The National Institute on Alcohol Abuse and Alcoholism (NIAAA) supports research to elucidate the specific genetic factors, now largely unknown, which underlie susceptibility to alcoholism and its medical complications (including fetal alcohol syndrome). Because of the genetic complexity and heterogeneity of alcoholism, identification of the multiple underlying factors will require the development of new study designs and methods of analysis of data from human families. While techniques of genetic analysis of animal behavioral traits (e.g., targeted gene disruption, quantitative trait locus (QTL) mapping) are more powerful that those applicable to humans (e.g., linkage and allelic association studies), the validation of animal behaviors as models of aspects of human alcoholism has been problematic. Newly developed methods for mapping QTL influencing animal behavioral traits can not only permit analyses of human family data to be directly informed by the results of animal studies, but can also serve as a novel means of validating animal models of aspects of alcoholism. 55 refs.
Studies to evaluate advanced technology relative to chemical upper stages and orbit-to-orbit stages are reported. The work described includes: development of LH2/LOX stage data, development of data to indicate stage sensitivity to engine tolerance, modified thermal routines to accommodate storable propellants, added stage geometries to computer program for monopropellant configurations, determination of the relative gain obtainable through improvement of stage mass fraction, future propulsion concepts, effect of ultrahigh chamber-pressure increases, and relative gains obtainable through improved mass fraction.
Harper, Gary W.; Neubauer, Leah C.; Bangi, Audrey K.; Francisco, Vincent T.
Transdisciplinary research and evaluation projects provide valuable opportunities to collaborate on interventions to improve the health and well-being of individuals and communities. Given team members’ diverse backgrounds and roles or responsibilities in such projects, members’ perspectives are significant in strengthening a project’s infrastructure and improving its organizational functioning. This article presents an evaluation mechanism that allows team members to express the successes and challenges incurred throughout their involvement in a multisite transdisciplinary research project. Furthermore, their feedback is used to promote future sustainability and growth. Guided by a framework known as organizational development, the evaluative process was conducted by a neutral entity, the Quality Assurance Team. A mixed-methods approach was utilized to garner feedback and clarify how the research project goals could be achieved more effectively and efficiently. The multiple benefits gained by those involved in this evaluation and implications for utilizing transdisciplinary research and evaluation teams for health initiatives are detailed. PMID:18936267
Munafo, Marcus R.; Pfeiffer, Thomas; Altmejd, Adam; Heikensten, Emma; Almenberg, Johan; Bird, Alexander; Chen, Yiling; Wilson, Brad; Johannesson, Magnus; Dreber, Anna
The 2014 Research Excellence Framework (REF2014) was conducted to assess the quality of research carried out at higher education institutions in the UK over a 6 year period. However, the process was criticized for being expensive and bureaucratic, and it was argued that similar information could be obtained more simply from various existing metrics. We were interested in whether a prediction market on the outcome of REF2014 for 33 chemistry departments in the UK would provide information similar to that obtained during the REF2014 process. Prediction markets have become increasingly popular as a means of capturing what is colloquially known as the ‘wisdom of crowds’, and enable individuals to trade ‘bets’ on whether a specific outcome will occur or not. These have been shown to be successful at predicting various outcomes in a number of domains (e.g. sport, entertainment and politics), but have rarely been tested against outcomes based on expert judgements such as those that formed the basis of REF2014. PMID:26587243
The US DOE was and is instrumental to NFRC's beginning and its continued success. The 2005 to 2009 funding enables NFRC to continue expanding and create new, improved ratings procedures. Research funded by the US DOE enables increased fenestration energy rating accuracy. International harmonization efforts supported by the US DOE allow the US to be the global leader in fenestration energy ratings. Many other governments are working with the NFRC to share its experience and knowledge toward development of their own national fenestration rating process similar to the NFRC's. The broad and diverse membership composition of NFRC allows anyone with a fenestration interest to come forward with an idea or improvement to the entire fenestration community for consideration. The NFRC looks forward to the next several years of growth while remaining the nation's resource for fair, accurate, and credible fenestration product energy ratings. NFRC continues to improve its rating system by considering new research, methodologies, and expanding to include new fenestration products. Currently, NFRC is working towards attachment energy ratings. Attachments are blinds, shades, awnings, and overhangs. Attachments may enable a building to achieve significant energy savings. An NFRC rating will enable fair competition, a basis for code references, and a new ENERGY STAR product category. NFRC also is developing rating methods to consider non specular glazing such as fritted glass. Commercial applications frequently use fritted glazing, but no rating method exists. NFRC is testing new software that may enable this new rating and contribute further to energy conservation. Around the world, many nations are seeking new energy conservation methods and NFRC is poised to harmonize its rating system assisting these nations to better manage and conserve energy in buildings by using NFRC rated and labeled fenestration products. As this report has shown, much more work needs to be done to
Davidow, Jason H.; Bothe, Anne K.; Bramlett, Robin E.
Purpose: This article presents, and explains the issues behind, the Stuttering Treatment Research Evaluation and Assessment Tool (STREAT), an instrument created to assist clinicians, researchers, students, and other readers in the process of critically appraising reports of stuttering treatment research. Method: The STREAT was developed by…
Li, Yuan H.; Modarresi, Shahpar; Yang, Yu N.
Summative evaluations have often been undertaken to determine the impact of educational programs on student academic achievement employing a quasi-experimental design. The summative finding is expected to be less misleading if a statistical model is performed on a dataset including a sound matched sample as a control group. This is because an…
... identification of areas where future research may be needed, and a review of possible research methodologies. In... Employment & Training Administration Office of Policy Development Evaluation and Research; Call for Papers; Biennial National Research Conference on ``Workforce Investment Issues in the United States'';...
The paper presents a rapid scanning of the state of the art of research and evaluation of Outward Bound and related educational programs. Initial comments outline criteria for assessing internal and external validity of studies. Distinctions are made between research, evaluation, measurement, judgement, and public relations. The work of Rosen,…
Microarrays have had a significant impact on many areas of biology. However, there are still many fertile research areas that would benefit from microarray analysis but are limited by the amount of biological material that can be obtained (e.g. samples obtained by small biopsy, f...
Carney, Jennifer; Martinez, Alina; Dreier, John; Neishi, Kristen; Parsad, Amanda
The National Science Foundation's Integrative Graduate Education and Research Traineeship (IGERT) program supports students in science, technology, engineering, and mathematics (STEM) fields who participate in university-developed interdisciplinary graduate training experiences. Faculty members at each IGERT site develop a series of education…
Talavera, Juan O; Wacher-Rodarte, Niels H; Rivas-Ruiz, Rodolfo
The need to solve a clinical problem leads us to establish a starting point to address (risk, prognosis or treatment studies), all these cases seek to attribute causality. Clinical reasoning described in the book Clinical Epidemiology. The architecture of clinical research, offers a simple guide to understanding this phenomenon. And proposes three basic components: baseline, maneuver and outcome. In this model, different systematic errors (bias) are described, which may be favored by omitting characteristics of the three basic components. Thus, omissions in the baseline characteristics cause an improper assembly of the population and susceptibility bias, omissions in the application or evaluation of the maneuver provoke performance bias, and omissions in the assessment of out-come cause detection bias and transfer bias. Importantly, if this way of thinking facilitates understanding of the causal phenomenon, the appropriateness of the variables to be selected in the studies to which attribute or not causality, require additional arguments for evaluate clinical relevance.
The author deals with 3 possible types of epidemiological studies in community mental health services: studies on the efficiency measuring the difference between the objectives of each team and the results; studies on the distribution between the teams and within each team, institutionalised models and implicit defensive modalities elaborated by the staff against the fear of the insane; studies on the populations considered at risk by psychoanalytical theories en vogue (depressive mothers, relationship anomalies). These studies would have the advantage to limit the "etiopathogenic pretentions" in psychiatry and avoid the "realistic slide" of imaginary constructions (myths or fiction of origin) which the community health service psychiatrist needs to work with but which has only an uncertain relationship with historical truth.
Evaluated is the treatment of diabetic retinopathy (blindness due to ruptured vessels of the retina as a side effect of diabetes), and described is a research project comparing two types of photocoagulation treatment. (DB)
Brock, Thomas; Mayer, Alexander K.; Rutschow, Elizabeth Zachry
This chapter explores the role that research and evaluation play in supporting comprehensive reform in community colleges, focusing on lessons from two major initiatives: Achieving the Dream and Completion by Design.
Morgan, Sonya J; Pullon, Susan R H; Macdonald, Lindsay M; McKinlay, Eileen M; Gray, Ben V
Case study research is a comprehensive method that incorporates multiple sources of data to provide detailed accounts of complex research phenomena in real-life contexts. However, current models of case study research do not particularly distinguish the unique contribution observation data can make. Observation methods have the potential to reach beyond other methods that rely largely or solely on self-report. This article describes the distinctive characteristics of case study observational research, a modified form of Yin's 2014 model of case study research the authors used in a study exploring interprofessional collaboration in primary care. In this approach, observation data are positioned as the central component of the research design. Case study observational research offers a promising approach for researchers in a wide range of health care settings seeking more complete understandings of complex topics, where contextual influences are of primary concern. Future research is needed to refine and evaluate the approach.
Monsen, Marie A.
The Bureau of Indian Affairs' (BIA) Higher Education Program was evaluated in order to provide valid information for decision making. Data gathered by a questionnaire administered to 2,736 students in a previous study was refined by applying the chi-square test of significant differences to certain student characteristics and variables. Each area…
Starting with the significance and the conduction of research teaching, this paper further puts forward and analyzes several patterns of research teaching, discusses the particular role of teachers in these patterns and proposes some strategies as well as suggestions.
Mckenzie, J. R.; Brumaghim, S. H.
The 23 organizations queried represent government, carrier, and manufacturing interests in air, marine, rail, and surface transportation systems. Results indicate a strong need for common terminology and data analysis/reporting techniques. The various types of ride criteria currently in use are discussed, particularly in terms of their respective data base requirements. A plan of action is proposed for fulfilling the ride technology needs identified by this study.
A set of 13 key characteristics is presented as a framework for educational evaluation studies: (1) program's stage of development when evaluator is appointed; (2) program's openness to revision; (3) program uniformity from site to site; (4) specificity of program objectives; (5) evaluator's independence; (6) evaluator's orientation to value…
US Department of Health and Human Services, 2012
Congress first called for the Advisory Committee on Head Start Research and Evaluation (the "Committee") in its 1998 reauthorization of the Head Start program, with a requirement that the Secretary of Health and Human Services convene a panel of experts to inform the Department about the design of a newly required national evaluation of…
Soares de Mello, Joao Carlos C. B.; Lins, Marcos P. E.; Soares de Mello, Maria Helena C.; Gomes, Eliane G.
Compares the efficiency of calculus classes and evaluates two kinds of classes: traditional and others that use computational methods in teaching. Applies quantitative evaluation methods using two operational research tools, multicriteria decision aid methods (mainly using the MACBETH approach) and data development analysis. (Author/YDS)
Ntiri, Daphne Williams, Ed.
The Adult Literacy and Evaluation Research Team (also known as Project ALERT) was a project conducted by the Detroit Literacy Coalition (DLC) at Wayne State University in 1993-1994 to develop and pilot a user-friendly program model for evaluating literacy operations of community-based organizations throughout Michigan under the provisions of…
Ansay, Sylvia J.; Perkins, Daniel F.; Nelson, John
Although focus groups continue to gain popularity in marketing and social science research, their use in program evaluation has been limited. Here we demonstrate how focus groups can benefit evaluators, program staff, policy makers and administrators by providing an in-depth understanding of program effectiveness from the perspective of…
Dymond, Stacy K.
This article proposes a model for evaluating inclusive schools. Key elements of the model are inclusion of stakeholders in the evaluation process through a participatory action research approach, analysis of program processes and outcomes, use of multiple methods and measures, and obtaining perceptions from diverse stakeholder groups. (Contains…
Downer, Martin C.; Blinkhorn, Anthony S.
Objective: (1) to provide a commentary on a conference held at the University of Manchester entitled Researching Water Fluoridation: Evaluation and Surveillance; (2) to synthesize from the proceedings of the meeting suggestions for future research and public health surveillance. Method: The main points and problematic issues raised by the speakers…
An overview of several projects will be presented on a research program currently underway at ORD’s Ground Water and Ecosystems Restoration Division (GWERD) to evaluate CAFO impacts on ground water quality. The overall research objectives are to characterize the potential for gro...
von Davier, Alina A.; Holland, Paul W.; Livingston, Samuel A.; Casabianca, Jodi; Grant, Mary C.; Martin, Kathleen
This study examines how closely the kernel equating (KE) method (von Davier, Holland, & Thayer, 2004a) approximates the results of other observed-score equating methods--equipercentile and linear equatings. The study used pseudotests constructed of item responses from a real test to simulate three equating designs: an equivalent groups (EG)…
The off-task behavior demonstrated by the study participants appears to interfere with classroom instruction, contribute to poor academic performance and in many instances lead to disciplinary actions such as suspension. The purpose of the study entailed determining if formal corrective feedback has an effect on the off-task/on-task behavior of…
Rey, Lynda; Tremblay, Marie-Claude; Brousselle, Astrid
Developmental evaluation (DE), essentially conceptualized by Patton over the past 30 years, is a promising evaluative approach intended to support social innovation and the deployment of complex interventions. Its use is often justified by the complex nature of the interventions being evaluated and the need to produce useful results in real time.…
Grotelueschen, Arden; McQuarrie, Duncan
Major objectives of this Adult Education Research Conference workshop were sixfold: to examine in detail the Stake Countenance Model of Evaluation as a potential conceptual framework for adult education evaluation; practice using it to identify and categorize relevant variables and relationships; design evaluation plans for typical adult education…
Klein, Julie T
Interdisciplinarity has become a widespread mantra for research, accompanied by a growing body of publications. Evaluation, however, remains one of the least-understood aspects. This review of interdisciplinary and transdisciplinary research evaluation categorizes lessons from the emergent international literature on the topic reviewed in 2007. It defines parallels between research performance and evaluation, presents seven generic principles for evaluation, and reflects in the conclusion on changing connotations of the underlying concepts of discipline, peer, and measurement. Interdisciplinary and transdisciplinary research performance and evaluation are both generative processes of harvesting, capitalizing, and leveraging multiple expertise. Individual standards must be calibrated, and tensions among different disciplinary, professional, and interdisciplinary approaches carefully managed in balancing acts that require negotiation and compromise. Readiness levels are strengthened by antecedent conditions that are flexible enough to allow multiple pathways of integration and collaboration. In both cases, as well, new epistemic communities must be constructed and new cultures of evidence produced. The multidisciplinary-interdisciplinary-transdisciplinary research environment spans a wide range of contexts. Yet seven generic principles provide a coherent framework for thinking about evaluation: (1) variability of goals; (2) variability of criteria and indicators; (3) leveraging of integration; (4) interaction of social and cognitive factors in collaboration; (5) management, leadership, and coaching; (6) iteration in a comprehensive and transparent system; and (7) effectiveness and impact.
Shamat, N. ); Crumpler, E. ); Roddan, A. )
Measuring and controlling organic emissions from incineration processes has become a major environmental concern in recent years. The US Environmental Protection Agency (EPA) recently proposed a regulation for sewage sludge incinerators under section 405(d) of the Clean Water Act that will require all sludge incinerators to monitor total hydrocarbon emissions (THCs) on a continuous basis. Such a requirement would be part of National Pollutant Discharge Elimination (NPDES) permits and site-specific THC limits would be established for facilities based on a risk assessment of organic emissions. Before EPA can finalize the proposed requirement, THC monitoring must be successfully conducted in a plant environment and the system required by any final regulation must be kept in operation so that facilities can comply with their permits. The Metropolitan Waste Control Commission (MWCC) in St. Paul, Minn., and Rosemount Analytical Division in La Habre, Calif., entered into a joint agreement with EPA to demonstrate a hot' THC monitoring system to detect THCs in stack gases. The objectives of the study are to determine the feasibility of THC monitoring of sludge incinerator emissions; evaluate the long term reliability, cost of operation, and consistency of a continuous THC monitoring system in an incinerator environment; and determine the correlation of THC stack concentration to incinerator and scrubber operating conditions, carbon monoxide concentration, and specific VOC emissions.
This paper first briefly reviews the concept of intelligibility as it has been employed in both English as a Lingua Franca (ELF) and world Englishes (WE) research. It then examines the findings of the Lingua Franca Core (LFC), a list of phonological features that empirical research has shown to be important for safeguarding mutual intelligibility…
Rosen, David J.; Mulcahy, Gene
This newsletter comprises four sections: (1) the educational philosophy and objectives of Shanti, a public alternative school in Hartford, Connecticut; (2) Rosen's statements about the difficulties of finding an evaluation model for alternative schools and the implications of the methodology that he later used in evaluating the Shanti school in…
Lobo, Roanna; Crawford, Gemma; Hallett, Jonathan; Laing, Sue; Mak, Donna B; Jancey, Jonine; Rowell, Sally; McCausland, Kahlia; Bastian, Lisa; Sorenson, Anne; Tilley, P J Matt; Yam, Simon; Comfort, Jude; Brennan, Sean; Doherty, Maryanne
Evaluation of public health programs, services and policies is increasingly required to demonstrate effectiveness. Funding constraints necessitate that existing programs, services and policies be evaluated and their findings disseminated. Evidence-informed practice and policy is also desirable to maximise investments in public health. Partnerships between public health researchers, service providers and policymakers can help address evaluation knowledge and skills gaps. The Western Australian Sexual Health and Blood-borne Virus Applied Research and Evaluation Network (SiREN) aims to build research and evaluation capacity in the sexual health and blood-borne virus sector in Western Australia (WA). Partners' perspectives of the SiREN model after 2 years were explored. Qualitative written responses from service providers, policymakers and researchers about the SiREN model were analysed thematically. Service providers reported that participation in SiREN prompted them to consider evaluation earlier in the planning process and increased their appreciation of the value of evaluation. Policymakers noted benefits of the model in generating local evidence and highlighting local issues of importance for consideration at a national level. Researchers identified challenges communicating the services available through SiREN and the time investment needed to develop effective collaborative partnerships. Stronger engagement between public health researchers, service providers and policymakers through collaborative partnerships has the potential to improve evidence generation and evidence translation. These outcomes require long-term funding and commitment from all partners to develop and maintain partnerships. Ongoing monitoring and evaluation can ensure the partnership remains responsive to the needs of key stakeholders. The findings are applicable to many sectors.
Using National and State Assessments To Evaluate the Performance of State Education Systems: Learning from the Cases of Kentucky and Maine. Research Report. Statewide Systemic Initiatives (SSI) Study.
Lee, Jaekyung; McIntire, Walter G.
This study examined two major questions: do national and state assessments provide consistent information on the performance of state education systems, and what accounts for discrepancies between national and state assessment results if they are found? Data came from national and state assessments in grade 4 and grade 8 mathematics from 1992 to…
Eash, Maurice J.; And Others
Child Parent Centers (CPC) have been established in selected disadvantaged areas to provide systematic educational experiences for preschool children as young as three years of age. This study provides an update on the current state of the CPC and its latest adaption, the Child Parent Expansion (CPX) Program. A three-year, longitudinal evaluation…
Bittner, A. C. Jr; Carter, R. C.; Kennedy, R. S.; Harbeson, M. M.; Krause, M.
The goal of the Performance Evaluation Tests for Environmental Research (PETER) Program was to identify a set of measures of human capabilities for use in the study of environmental and other time-course effects. 114 measures studied in the PETER Program were evaluated and categorized into four groups based upon task stability and task definition. The Recommended category contained 30 measures that clearly obtained total stabilization and had an acceptable level of reliability efficiency. The Acceptable-But-Redundant category contained 15 measures. The 37 measures in the Marginal category, which included an inordinate number of slope and other derived measures, usually had desirable features which were outweighed by faults. The 32 measures in the Unacceptable category had either differential instability or weak reliability efficiency. It is our opinion that the 30 measures in the Recommended category should be given first consideration for environmental research applications. Further, it is recommended that information pertaining to preexperimental practice requirements and stabilized reliabilities should be utilized in repeated-measures environmental studies.
Hao, Lichao; Huang, Aibo; Lai, Canxiong; Chen, Xing; Hao, Mingming; Chen, Honglei; Lu, Guoguang; Huang, Yun; En, Yunfei
Reliability is an important index to ensure the application of infrared focal plane arrays (IRFPAs) in complex environment, and it becomes a major bottleneck problem of IRFPAs' development. Because of the characteristics such as type, nature, quantity, location and distribution et al, bad pixel which contains initial bad pixel and used bad pixel has outstanding advantage for failure analysis and reliability evaluation of IRFPAs. In this paper, the structure of IRPFAs has been introduced in detail, and the damage mechanisms of used bad pixel also have been analyzed deeply. At the same time, the feasibility to study IRPFAs' damage stress, failure position, damage mechanism has been discussed all around. The research of bad pixel can be used to optimize the structure and process, meanwhile it also can improve the accuracy of bad pixel identification and replacements.
Vrugt, J. A.
The ever increasing pace of computational power, along with continued advances in measurement technologies and improvements in process understanding has stimulated the development of increasingly complex physics based models that simulate a myriad of processes at different spatial and temporal scales. Reconciling these high-order system models with perpetually larger volumes of field data is becoming more and more difficult, particularly because classical likelihood-based fitting methods lack the power to detect and pinpoint deficiencies in the model structure. In this talk I will give an overview of our latest research on process-based model calibration and evaluation. This approach, rooted in Bayesian theory, uses summary metrics of the calibration data rather than the data itself to help detect which component(s) of the model is (are) malfunctioning and in need of improvement. A few case studies involving hydrologic and geophysical models will be used to demonstrate the proposed methodology.
Mulvey, Kevin P.; Hayashi, Susan W.; Hubbard, Susan M.; Kopstien, Andrea; Huang, Judy Y.
Introduces the special section that focuses on four major studies under the treatment improvement protocols (TIPs) evaluation project. Provides an overview of each article, and addresses the value of using a theory-driven approach to dissemination research. (SLD)
Arias Valencia, Samuel Andrés; Hernández Pinzón, Giovanna
As well as protecting the rights of participants, a study's ethics must encompass the quality of its execution. As such, international standards have been established for studies involving human subjects. The objective of this review is to evaluate the usefulness of the Guide to Good Clinical Practice and "study monitoring" as tools useful to producing quality research. The Guide provides scientific ethics and quality standards for designing, conducting, registering, and notifying studies involving human subjects. By implementing specific processes and procedures, study monitoring seeks to ensure that research is followed and evaluated from inception, through execution and closure, thus producing studies with high quality standards.
Arimoto, Azusa; Gregg, Misuzu F; Nagata, Satoko; Miki, Yuko; Murashima, Sachiyo
Evaluation of doctoral programs in nursing is becoming more important with the rapid increase in the programs in Japan. This study aimed to evaluate doctoral nursing programs by faculty members and to analyze the relationship of the evaluation with educational and research activities of faculty members in Japan. Target settings were all 46 doctoral nursing programs. Eighty-five faculty members from 28 programs answered the questionnaire, which included 17 items for program evaluation, 12 items for faculty evaluation, 9 items for resource evaluation, 3 items for overall evaluations, and educational and research activities. A majority gave low evaluations for sources of funding, the number of faculty members and support staff, and administrative systems. Faculty members who financially supported a greater number of students gave a higher evaluation for extramural funding support, publication, provision of diverse learning experiences, time of supervision, and research infrastructure. The more time a faculty member spent on advising doctoral students, the higher were their evaluations on the supportive learning environment, administrative systems, time of supervision, and timely feedback on students' research. The findings of this study indicate a need for improvement in research infrastructure, funding sources, and human resources to achieve quality nursing doctoral education in Japan.
Observational study of the development and evaluation of a fertility preservation patient decision aid for teenage and adult women diagnosed with cancer: the Cancer, Fertility and Me research protocol
Jones, G L; Hughes, J; Mahmoodi, N; Greenfield, D; Brauten-Smith, G; Skull, J; Gath, J; Yeomanson, D; Baskind, E; Snowden, J A; Velikova, G; Collins, K; Stark, D; Phillips, R; Lane, S; Bekker, H L
Introduction Women diagnosed with cancer and facing potentially sterilising cancer treatment have to make time-pressured decisions regarding fertility preservation with specialist fertility services while undergoing treatment of their cancer with oncology services. Oncologists identify a need for resources enabling them to support women's fertility preservation decisions more effectively; women report wanting more specialist information to make these decisions. The overall aim of the ‘Cancer, Fertility and Me’ study is to develop and evaluate a new evidence-based patient decision aid (PtDA) for women with any cancer considering fertility preservation to address this unmet need. Methods and analysis This is a prospective mixed-method observational study including women of reproductive age (16 years +) with a new diagnosis of any cancer across two regional cancer and fertility centres in Yorkshire, UK. The research involves three stages. In stage 1, the aim is to develop the PtDA using a systematic method of evidence synthesis and multidisciplinary expert review of current clinical practice and patient information. In stage 2, the aim is to assess the face validity of the PtDA. Feedback on its content and format will be ascertained using questionnaires and interviews with patients, user groups and key stakeholders. Finally, in stage 3 the acceptability of using this resource when integrated into usual cancer care pathways at the point of cancer diagnosis and treatment planning will be evaluated. This will involve a quantitative and qualitative evaluation of the PtDA in clinical practice. Measures chosen include using count data of the PtDAs administered in clinics and accessed online, decisional and patient-reported outcome measures and qualitative feedback. Quantitative data will be analysed using descriptive statistics, paired sample t-tests and CIs; interviews will be analysed using thematic analysis. Ethics and dissemination Research Ethics Committee
Baxter, Pamela; Jack, Susan
Qualitative case study methodology provides tools for researchers to study complex phenomena within their contexts. When the approach is applied correctly, it becomes a valuable method for health science research to develop theory, evaluate programs, and develop interventions. The purpose of this paper is to guide the novice researcher in…
McCormick, Bryan P.
Reviews the rationale for and implications of case study research in therapeutic recreation, examining: what can be learned from studying a single case; issues of validity and reliability; ethical conduct of research; and the practice of case study research (case protocol, case selection, collecting data, analyzing and interpreting data, and…
Kuyare, Mukta Sunil; Sarve, Parag Vijayrao; Dalal, Komal S.; Tripathi, Raakhi K.
Introduction: Conducting medical research is not limited to academia and pharmaceutical industry but even multispeciality hospitals need to venture in this area along with patient care. To develop research culture among well-established non-acedemic hospital is always difficult and challenging task. This article attempts to evaluate the performance of the department in ‘Research naïve’ hospital in the last two years and review the strengths and challenges it faced at each step. Methods: This was a retrospective document analysis study evaluating the steps towards setting and sustaining of Medical Research Department of Bhaktivedanta Hospital during the period of January 2013 to June 2015 (30 Months). The authors developed a checklist (along with performance indicators) to assess the Preparatory phase and Activity phase of the research department which were evaluated by Institute Quality Management Team. Each step of both phases was also reviewed in terms of strengths and challenges as perceived by the authors. Results: During 2 year journey of research naïve Hospital, Institute had witnessed Hospital initiated (n=24, 59%) and sponsored projects (n=17, 41%) in all specialties. HRC reviewed (n=2.13) projects per meeting for administrative consideration while IEC reviewed (n=2.15) projects for scientific and ethical review. Challenges during preparatory phases were circumvent by immense cooperation of hospital management for initial investment, sensitization through research workshops for consultants, established procedures and trained support manpower and constant encouragement by research coordinator. Conclusion: Considering evaluation of 41 studies in very first 2 years in ‘Research naive non academic institute demonstrated successful implementation of trio model of Hospital Research Committee for administrative review, IEC for scientific-ethical review, centralized MRD for coordinating all research projects under one roof which may act as role model for
Northwest Regional Educational Lab., Portland, OR.
This compilation of 11 courseware evaluations gives a general overview of available social studies microcomputer courseware for students in grades 3-12. Each evaluation lists title, date, producer, date of evaluation, evaluating institution, cost, ability level, topic, medium of transfer, required hardware, required software, instructional…
Water resources research institutes, as authorized by the Water Resources Research Act of 1984 (Public Law 98-242), are located in each state and in the District of Columbia, Guam, Puerto Rico , and the Virgin Islands. Public Law 98-242 mandated an onsite evaluation of each of these institutes to determine whether ' . . .the quality and relevance of its water resources research and its effectiveness as an institution for planning, conducting, and arranging for research warrant its continued support in the national interest. ' The results of these evaluations, which were conducted between September 1985 and June 1987, are summarized. The evaluation teams found that all 54 institutes are meeting the basic objectives of the authorizing legislation in that they: (1) use the grant funds to support research that addresses water problems of state and regional concern; (2) provide opportunities for training of water scientists through student involvement on research projects; and (3) promote the application of research results through preparation of technical reports and contributions to the technical literature. The differences among institutes relate primarily to degrees of effectiveness, and most often are determined by the financial, political, and geographical contexts in which the institutes function and by the quality of their leadership. (Lantz-PTT)
Citation analysis is widely used to evaluate the performance of individual researchers, journals, and universities. Its outcome plays a crucial role in the decision-making process of ranking applicants for an academic position. A number of indicators, including the h-index reflecting both scientific productivity and its relevance in medical fields, are available through the Web of Knowledge( sm ) and Scopus®. In the field of occupational medicine, the adoption of the h-index in assessing the value of core journals shows some advantages compared with traditional bibliometrics and may encourage researchers to submit their papers. Although evaluation of the overall individual performance for academic positions should assess several aspects, scientific performance is usually based on citation analysis indicators. Younger researchers should be aware of the new approach based on transparent threshold rules for career promotion and need to understand the new evaluation systems based on metrics.
Ioannidis, John P A; Fanelli, Daniele; Dunne, Debbie Drake; Goodman, Steven N
As the scientific enterprise has grown in size and diversity, we need empirical evidence on the research process to test and apply interventions that make it more efficient and its results more reliable. Meta-research is an evolving scientific discipline that aims to evaluate and improve research practices. It includes thematic areas of methods, reporting, reproducibility, evaluation, and incentives (how to do, report, verify, correct, and reward science). Much work is already done in this growing field, but efforts to-date are fragmented. We provide a map of ongoing efforts and discuss plans for connecting the multiple meta-research efforts across science worldwide.
RESEARCH (PETER): COLLECTED PAPERS ,Robert S. Kennedy, Alvah C. Bittner, Jr., Robert C. Carter, Michele Krause, (Mary M. Harbeson, Denise B. McCafferty...EVALUATION TESTS FOR ENVIRONMENTAL RESEARCH (PETER): COLLECTED PAPERS Robert S. Kennedy, Alvah C. Bittner, Jr., Robert C. Carter, Michele Krause, Mary M...characteristics (defined in 1. Alvares, K. M., & Hulin , C. L. Two explana Table 1) for each score. The remaining columns of tions of temporal changes
Sewell, R.T.; Wu, S.C.
This report documents research pertaining to conservatism and variability in seismic risk estimates. Specifically, it examines whether or not artificial motions produce unrealistic evaluation demands, i.e., demands significantly inconsistent with those expected from real earthquake motions. To study these issues, two types of artificial motions are considered: (a) motions with smooth response spectra, and (b) motions with realistic variations in spectral amplitude across vibration frequency. For both types of artificial motion, time histories are generated to match target spectral shapes. For comparison, empirical motions representative of those that might result from strong earthquakes in the Eastern U.S. are also considered. The study findings suggest that artificial motions resulting from typical simulation approaches (aimed at matching a given target spectrum) are generally adequate and appropriate in representing the peak-response demands that may be induced in linear structures and equipment responding to real earthquake motions. Also, given similar input Fourier energies at high-frequencies, levels of input Fourier energy at low frequencies observed for artificial motions are substantially similar to those levels noted in real earthquake motions. In addition, the study reveals specific problems resulting from the application of Western U.S. type motions for seismic evaluation of Eastern U.S. nuclear power plants.
Villasís-Keever, Miguel Ángel; Miranda-Novales, María Guadalupe
In clinical research that takes place in health-care areas, most of the studies are performed with human beings as research subjects. The main objectives of these studies are to know the characteristics of one or more groups, the behavior of human diseases, the etiology or causes of diseases, to identify the best diagnostic tools, or to establish the best treatment for a condition or disease in particular. Additionally, some studies are classified as basic bio-medical research; in these investigations, the subjects of study are laboratory animals, tissues, cells, or molecules. In general terms, the objectives of these studies are to understand the physiology, pathogenesis, or biological mechanisms that could explain functions or alterations in one or more systems or body organs. This article will only address clinical research designs.
Amo, Courtney; Cousins, J. Bradley
The study of the consequences of evaluation, or more specifically of evaluation use or utilization, represents a significant portion of the body of research on evaluation. Much has been written on the evolution of the multidimensional concept of evaluation use, most recently the examination of consequences of evaluation that are not a function of…
A consortium of Universities, located in northwest Ohio have received funds to conduct a comprehensive evaluation of land applied biosolids in that state. This USDA funded study includes observing land application practices and evaluating biosolids, soils, runoff water and bioaer...
Birnbaum, Marvin L; Daily, Elaine K; O'Rourke, Ann P
Studies of the health aspect of disasters focus either on the epidemiology of disasters to define the causes and the progression from a hazard to a disaster, or the evaluations of interventions provided during any phase of a disaster. Epidemiological disaster research studies are undertaken for the purposes of: (1) understanding the mechanisms by which hazards evolve into a disaster; (2) determining ways to mitigate the risk(s) that a specific hazard will progress into a disaster; (3) predicting the likely damages and needs of the population-at-risk for an event; and (4) identifying potential measures to increase the resilience of a community to future events. Epidemiological disaster research utilizes the Conceptual, Temporal, and Societal Frameworks to define what occurs when a hazard manifests as an event that causes a disaster. The findings from such studies should suggest interventions that could augment the absorbing, buffering, or/and response capacities to lessen the probability of similar damages occurring from the next event. Ultimately, the use of these Frameworks in studying the health aspects of a disaster will help define what to expect in a specific setting and the standards and best practices upon which education, training, competencies, performance, and professionalization will be built.
Many states with preschool programs, as well as other interested organizations and individuals, have undertaken research and evaluation efforts to improve their understanding of state preschool program implementation, results, and impacts. A 2004 review by Gilliam and Zigler examined state efforts to evaluate preschool programs from 1997 to 2003.…
Bacon, Donald R.; Paul, Pallab; Stewart, Kim A.; Mukhopadhyay, Kausiki
Much has been written about the evaluation of faculty research productivity in promotion and tenure decisions, including many articles that seek to determine the rank of various marketing journals. Yet how faculty evaluators combine journal quality, quantity, and author contribution to form judgments of a scholar's performance is unclear. A…
Zornes, Deborah; Ferkins, Lesley; Piggot-Irvine, Eileen
The focus of this paper is to share thinking about networks in action research (AR) and to consider their role, purpose, and how networks' outcomes and impacts might be evaluated. Networks are often a by-product of AR projects, yet research focused on the network itself as part of a project is rare. The paper is one of several associated with the…
Permsuwan, Unchalee; Guntawongwan, Kansinee; Buddhawongsa, Piyaluk
The discount rates and time horizons used in a health technology assessment (HTA) can have a significant impact on the results, and thus the prioritization of technologies. Therefore, it is important that clear guidance be provided on the appropriate discount rates for cost and health effect and appropriate time horizons. In this paper we conduct a review of relevant case studies and guidelines and provide guidance for all researchers conducting economic evaluations of health technologies in the Thai context. A uniform discount rate of 3% is recommended for both costs and health effects in base case analyses. A sensitivity analysis should also be conducted, with a discount range of 0-6%. For technologies where the effects are likely to sustain for at least 30y ears, a rate of 4% for costs and 2% for health effects is recommended. The time horizon should be long enough to capture the full costs and effects of the programs.
Caldwell, Kay; Henshaw, Lynne; Taylor, Georgina
A new framework for critiquing health-related research is presented in this article. More commonly used existing frameworks tend to have been formulated within the quantitative research paradigm. While frameworks for critiquing qualitative research exist, they are often complex and more suited to the needs of students engaged in advanced levels of study. The framework presented in this article addresses both quantitative and qualitative research within one list of questions. It is argued that this assists the 'novice' student of nursing and health-related research with learning about the two approaches to research by giving consideration to aspects of the research process that are common to both approaches and also that differ between quantitative and qualitative research.
Munter, Charles; Cobb, Paul; Shekell, Calli
One purpose of education research is to develop and rigorously evaluate the effectiveness of programs for supporting students' learning and achievement. The Institute of Education Sciences has amplified that purpose (Shadish & Cook, 2009) and attempted to improve the methodological standards for conducting such work--primarily through the What…
Wan, Thomas T.H.
An integrated perspective consists of macro- and micro-level approaches to health policy research and evaluation is presented. Analytical strategies are suggested for policy analysis, targeting on health disparities at individual and population levels. This systems approach enables investigators to view how scientific public policy analysis can be implemented to assess policy impacts. In this special issue, five papers are introduced. PMID:25419221
Wan, Thomas T H
An integrated perspective consists of macro- and micro-level approaches to health policy research and evaluation is presented. Analytical strategies are suggested for policy analysis, targeting on health disparities at individual and population levels. This systems approach enables investigators to view how scientific public policy analysis can be implemented to assess policy impacts. In this special issue, five papers are introduced.
... 9 Animals and Animal Products 1 2013-01-01 2013-01-01 false Products for research and evaluation. 104.4 Section 104.4 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE, DEPARTMENT..., species of animals or cell cultures involved, degree of inactivation or attenuation, recommendations...
... 9 Animals and Animal Products 1 2014-01-01 2014-01-01 false Products for research and evaluation. 104.4 Section 104.4 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE, DEPARTMENT..., species of animals or cell cultures involved, degree of inactivation or attenuation, recommendations...
... 9 Animals and Animal Products 1 2012-01-01 2012-01-01 false Products for research and evaluation. 104.4 Section 104.4 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE, DEPARTMENT..., species of animals or cell cultures involved, degree of inactivation or attenuation, recommendations...
Hekelman, Francine P.; And Others
An instrument to measure the 13 personal characteristics of productive researchers described by C. J. Bland and others (1986, 1990) was developed and evaluated. The total eligible sample was 404 full-time assistant professor faculty members in the tenure track at Case Western Reserve University in Cleveland (Ohio). A random sample of 100…
... 9 Animals and Animal Products 1 2011-01-01 2011-01-01 false Products for research and evaluation. 104.4 Section 104.4 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE, DEPARTMENT OF AGRICULTURE VIRUSES, SERUMS, TOXINS, AND ANALOGOUS PRODUCTS; ORGANISMS AND VECTORS PERMITS...
... 9 Animals and Animal Products 1 2010-01-01 2010-01-01 false Products for research and evaluation. 104.4 Section 104.4 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE, DEPARTMENT OF AGRICULTURE VIRUSES, SERUMS, TOXINS, AND ANALOGOUS PRODUCTS; ORGANISMS AND VECTORS PERMITS...
The Childhood Obesity Research Demonstration (CORD) project links public health and primary care interventions in three projects described in detail in accompanying articles in this issue of Childhood Obesity. This article describes a comprehensive evaluation plan to determine the extent to which th...
Záhorec, Ján; Hašková, Alena; Munk, Michal
The paper presents the results of an international research on a comparative assessment of the current status of computer science education at the secondary level (ISCED 3A) in Slovakia, the Czech Republic, and Belgium. Evaluation was carried out based on 14 specific factors gauging the students' point of view. The authors present qualitative…
Graphics research history shows that some topics have been studied heavily while others have been almost entirely neglected. Furthermore, researchers have used many different methods of defining and measuring effects such as legibility and comprehension, and this, together with vagueness in reporting, makes it difficult to compare studies and draw…
Rodriguez, Fernando; Ng, Annalyn; Shah, Priti
The authors examined college students' ability to critically evaluate scientific evidence, specifically, whether first- and second-year students noticed when poor interpretations were drawn from research evidence. Fifty students evaluated a set of eight psychological studies, first in an informal context, then again in a critical-thinking context.…
Sargent, Michael Steven
The purpose of this study was to identify if a relationship existed between the implementation of professional evaluation processes and the use of research-based teaching practices, factoring in both perceptions of principals and practicing teachers. The variables of professional development on the evaluation model and the principal's years of…
Reports on a study of evaluation in research article abstracts across disciplines. Results show differences in the manifestation, number, and type of explicit evaluations in the abstracts belonging to different disciplines in the field of the humanities, social and natural sciences. Also revealed differences in the rhetorical structure of the…
Wicker, Sandra J.
Evaluating library collections by comparing them to bibliographies has a long history in research libraries. This evaluative study examined all 107 titles within the "Women in Botany" section of the Herbarium Library at The Ohio State University (OSU). The Herbarium is not part of the OSU Library system, but functions as a satellite to…
Milko, Emily; Wu, Diane; Neves, Justin; Neubecker, Alexander Wolfgang; Lavis, John; Ranson, Michael Kent
Evaluation researchers have confirmed the importance of conference evaluation, but there remains little research on the topic, perhaps in part because evaluation methodology related to conference impact is underdeveloped. We conducted a study evaluating a 4-day long health conference, the Second Global Symposium on Health Systems Research (HSR), which took place in Beijing in November 2012. Using a conference evaluation framework and a mixed-methods approach that involved in-conference surveys, in-conference interviews and 7-month post-conference interviews, we evaluated the impact of the Symposium on attendees' work and the field of health systems research. The three major impacts on participants' work were new knowledge, new skills and new networks, and many participants were able to provide examples of how obtaining new knowledge, skills or collaborations had changed the way they conduct their work. Participants noted that the Symposium influenced the field of HSR only in so far as it influenced the capacity of stakeholders, but did not lead to any high level agenda or policy changes, perhaps due to the insufficient length of time (7 months) between the Symposium and post-conference follow-up. This study provides an illustration of a framework useful for conference organizers in the evaluation of future conferences, and of a unique methodology for evaluation researchers.
Debrand, Thierry; Dourgnon, Paul
The Institut de Recherche et Documentation en Economie de la Santé (IRDES) Workshop on Applied Health Economics and Policy Evaluation aims at disseminating health economic research's newest findings and enhancing the community's capacity to address issues that are relevant to public policy. The 2010 program consisted of 16 articles covering a vast range of topics, such as health insurance, social health inequalities and health services research. While most of the articles embedded theoretical material, all had to include empirical material in order to favor more applied and practical discussions and results. The 2010 workshop is to be the first of a series of annual workshops in Paris gathering together researchers on health economics and policy evaluation. The next workshop is to be held at IRDES in June 2011.
Ashcroft, S. C.
An evaluation and research program was designed to determine user satisfaction and the practicality, reliability, and maintainability of the Digicassette (or Portable Braille Recorder--PBR) and to study the braille reading and writing functions. Ten PBRs were placed with 14 students and 14 adults. Products of the research program included training…
Regal, David M.; Whittington, David H.
The goal of this research was to help us understand the display requirements for a synthetic vision system for the High Speed Civil Transport (HSCT). Four experiments were conducted to examine the effects of different levels of perceptual cue complexity in displays used by pilots in a flare and landing task. Increased levels of texture mapping of terrain and runway produced mixed results, including harder but shorter landings and a lower flare initiation altitude. Under higher workload conditions, increased texture resulted in an improvement in performance. An increase in familiar size cues did not result in improved performance. Only a small difference was found between displays using two patterns of high resolution texture mapping. The effects of increased perceptual cue complexity on performance was not as strong as would be predicted from the pilot's subjective reports or from related literature. A description of the role of a synthetic vision system in the High Speed Civil Transport is provide along with a literature review covering applied research related to perceptual cue usage in aircraft displays.
Head Start Evaluation and Research Center, University of Kansas. Report No. VIID, a Case Study Illustrating an Experimental Design for Evaluating the Effects of Shaping Gross Motor Coordination in a 31 Month Old Child.
Michealis, Mary Lou; Etzel, Barbara C.
A multiple baseline design for modifying the gross motor coordination of a 31-month-old boy suspected of suffering from congenital brain damage was conducted at the University of Kansas Infant Study Laboratory. The primary purpose of the study was to establish, by experimental procedures, the desired, but absent, behavior of walking, getting up,…
Describes the development and application of a model for social studies program evaluations. A case study showing how the model's three-step process was used to evaluate the Improving Citizenship Education Project in Fulton County, Georgia is included. (AM)
A recent series of articles instructed PACU nurses on steps in developing pencil-and-paper instruments for research studies. What questions should PACU nurses ask when considering the use of existing pencil-and-paper instruments for use in research studies? The purpose of this article is to present nine steps in critiquing existing instrument before conducting research studies. Included are ethical considerations when using instruments and a checklist to assist PACU nurses in critiquing existing instruments.
The IUE research studies comprises 118 separate research programs involving observations, data analysis, and research conducted of the IUE satellite and the NASA Astrophysics Data Program. Herein are presented 92 programs. For each program there is a title, program ID, name of the investigator, statement of work, summary of results, and list of publications.
Dilts, David M
Clinical research management (CRM) is a critical resource for the management of clinical trials and it requires proper evaluation. This article advances a model of evaluation that has three local levels, plus one global level, for evaluating the value of CRM. The primary level for evaluation is that of the study or processes level. The managerial or aggregate level concerns management of the portfolio of trials under the control of the CRM office. The third, often overlooked level of evaluation, is the strategic level, whose goal is encapsulated in the phrase, "doing the right trials, while doing trials right." The global ("plus one") evaluation level concerns the need to evaluate the ever-increasing number of multi-institutional and multinational studies. As there are host of evaluation metrics, this article provides representative examples of metrics at each level and provides methods that can aid in the selecting appropriate metrics for an organization.
Holloway, D C; Wiczai, L J; Carlson, E T
The purpose of this study was to evaluate a computerized information system, the Professional Activity Study-Medical Audit Program (PAS-MAP), when used by the medical staff of a hospital to conduct medical care evaluation studies. PAS-MAP was compared to a manual system for collecting data not contained on the face sheets of medical records. The results indicated that, compared to the manual system, PAS-MAP: was less costly if more than 41 per cent of hospitalized patients were included in medical care evaluation studies; was as timely as the manual system for data it could provide but provided fewer clinical data elements than physicians requested; and was less protective against human error. Three decision makers assigned weights indicating the relative importance of these results. The weights were combined in an additive model to arrive at a score for each system. Based on these scores, the manual system was recommended for implementation.
Monitoring, evaluation, and surveillance measure how well public health programs operate over time and achieve their goals. As countries approach malaria elimination, these activities will need to shift from measuring reductions in morbidity and mortality, to detecting infections (with or without symptoms) and measuring transmission. Thus, the monitoring and evaluation and surveillance research and development agenda needs to develop the tools and strategies that will replace passive surveillance of morbidity with active and prompt detection of infection, including confirmation of interruption of transmission by detecting present and past infections, particularly in mobile populations. The capacity to assess trends and respond without delay will need to be developed, so that surveillance itself becomes an intervention. Research is also needed to develop sensitive field tests that can detect low levels of parasitaemia, together with strategies for their implementation. Other areas to explore include the rigorous evaluation of the utility of more detailed maps of disease and infection incidence and prevalence, the development of new maps to inform programmatic responses and the use of surveillance technologies based on cell phone or real-time internet Web-based reporting. Because any new strategies for monitoring and evaluation and surveillance for eradication have major implications for program implementation, research is also needed to test systems of delivery for acceptability, feasibility, efficiency, cost-effectiveness, and community engagement. Finally, there is a clear need to systematically review the information from past elimination efforts for malaria and other infectious diseases. PMID:21311581
Three of the most challenging problems in the custody evaluation field follow from: (1) the difficulties involved in adapting data derived from group studies or traditional tests into a form for individual cases; (2) the absence of clear and compelling guidelines to aggregate the information collected in a comprehensive evaluation; and (3) the…
Cooke, Jo; Nancarrow, Susan; Dyas, Jane; Williams, Martin
Background This paper describes an evaluation of an initiative to increase the research capability of clinical groups in primary and community care settings in a region of the United Kingdom. The 'designated research team' (DRT) approach was evaluated using indicators derived from a framework of six principles for research capacity building (RCB) which include: building skills and confidence, relevance to practice, dissemination, linkages and collaborations, sustainability and infrastructure development. Methods Information was collated on the context, activities, experiences, outputs and impacts of six clinical research teams supported by Trent Research Development Support Unit (RDSU) as DRTs. Process and outcome data from each of the teams was used to evaluate the extent to which the DRT approach was effective in building research capacity in each of the six principles (as evidenced by twenty possible indicators of research capacity development). Results The DRT approach was found to be well aligned to the principles of RCB and generally effective in developing research capabilities. It proved particularly effective in developing linkages, collaborations and skills. Where research capacity was slow to develop, this was reflected in poor alignment between the principles of RCB and the characteristics of the team, their activities or environment. One team was unable to develop a research project and the funding was withdrawn at an early stage. For at least one individual in each of the remaining five teams, research activity was sustained beyond the funding period through research partnerships and funding successes. An enabling infrastructure, including being freed from clinical duties to undertake research, and support from senior management were found to be important determinants of successful DRT development. Research questions of DRTs were derived from practice issues and several projects generated outputs with potential to change daily practice, including the
Burton, Christopher R; Rycroft-Malone, Jo
Objective To systematically review how process evaluations are currently designed, what methodologies are used and how are they developed alongside or within neurological rehabilitation trials. Methods This mixed-methods systematic review had two evidence streams: stream I, studies reporting process evaluations alongside neurorehabilitation trials research and stream II, methodological guidance on process evaluation design and methodology. A search strategy was designed for each evidence stream. Data regarding process evaluation core concepts and design issues were extracted using a bespoke template. Evidence from both streams was analysed separately and then synthesised in a final overarching synthesis proposing a number of recommendations for future research. Results A total of 124 process evaluation studies, reporting on 106 interventions, were included in stream I evidence. 30 studies were included as stream II evidence. Synthesis 1 produced 9 themes, and synthesis 2 identified a total of 8 recommendations for process evaluation research. The overall synthesis resulted in 57 ‘synthesis recommendations’ about process evaluation methodology grouped into 9 research areas, including the use of theory, the investigation of context, intervention staff characteristics and the delivery of the trial intervention. Conclusions There remains no consensus regarding process evaluation terminology within the neurological rehabilitation field. There is a need for process evaluations to address the nature and influence of context over time. Process evaluations should clearly describe what intervention staff bring to a trial, including skills and experience prior to joining the research. Process evaluations should monitor intervention staff's learning effects and the possible impact that these may have on trial outcomes. PMID:28186944
Evaluation studies can provide feedback on implementation, support continuous improvement, and increase understanding of evaluation systems' impact on teaching and learning. Despite the importance of educator evaluation studies, states often need support to prioritize and fund them. Successful studies require expertise, time, and a shared…
Radford, R. C.; Schelhorn, A. E.; Siracuse, R. J.; Till, R. D.; Wasserman, R.
The results of a design review study and evaluation of the XV-15 Tilt Rotor Research Aircraft for flying qualities research application are presented. The objectives of the program were to determine the capability of the XV-15 aircraft and the V/STOLAND system as a safe, inflight facility to provide meaningful research data on flying qualities, flight control systems, and information display systems.
Knibbe, Marie Vannozzi; Dusewicz, Russell A.
A study of the Center for Literacy's (CFL) program was conducted to provide information on retention and attrition in an urban, open-entry/open-exit, individualized, goal-based literacy program. An exploratory analysis that used student and tutor records from 1985 through 1989 provided a summary of demographics and attendance patterns. This…
Winke, Paula; Gass, Susan; Myford, Carol
This study investigated whether raters' second language (L2) background and the first language (L1) of test takers taking the TOEFL iBT® Speaking test were related through scoring. After an initial 4-hour training period, a group of 107 raters (mostly of learners of Chinese, Korean, and Spanish), listened to a selection of 432 speech samples that…
This study applied an analytical technique called Data Envelopment Analysis (DEA) to calculate the relative technical efficiency of 95 academic research libraries, all members of the Association of Research Libraries. DEA, with the proper model of library inputs and outputs, can reveal best practices in the peer groups, as well as the technical…
This study examines the influence of action research on California community college practitioners' attitudes, beliefs, and behavior using the Center for Urban Education's (CUE) Equity Scorecard tools and process. This developmental evaluation study began March 2011 and concluded April 2012. The pseudonym of the field site studied is Las Flores…
Brown, Barry S.
A series of followup investigations exploring the impact of methadone maintenance treatment, methadone detoxification treatment, therapeutic communities, and outpatient drug-free treatment for the drug abuser was conducted. Limitations of these modalities were revealed in the followup studies. Implications for treatment and policy include: (1)…
Mattila, Lea-Riitta; Koivisto, Virpi; Häggman-Laitila, Arja
The purpose of this descriptive study was to evaluate the learning that takes place in a research process of nursing students when writing their Bachelor's theses and to describe the learning outcomes in utilizing research knowledge. The sample comprised nursing students from a Finnish polytechnic. All of them worked with their Bachelor's theses. The data were collected by a questionnaire constructed for this study and 257 nursing students participated in the study. The data were analysed by SPSS 10.0 software. The students knew the steps of the research process moderately well. Most of the students responded that research results had been implemented in nursing practice. More than half of the students found the attitudes towards research positive in their clinical placements. Students' self-evaluation of learning outcomes was positive and they felt able to use research knowledge. The results indicated improving learning outcomes during the working process of the Bachelor's thesis. Working with the Bachelor's thesis is an effective way to lead the students to use research knowledge. The results are useful in guiding the students through their Bachelor's theses as well as in developing the curriculum and working life.
Dubowitz, Howard; Christian, Cindy W; Hymel, Kent; Kellogg, Nancy D
Physicians play an important role in the forensic evaluation of suspected child abuse and neglect. There has been considerable progress in the medical field, helping distinguish findings related to maltreatment from other conditions or circumstances. Nevertheless, important questions remain. This article covers several of these questions and proposes a research agenda concerning five main topics: sexual abuse, neglect, fractures, abusive head trauma, and physicians work in interdisciplinary settings. The suggestions are hardly inclusive, but offer suggestions the authors think are priorities, and ones that research could reasonably address. By providing some background to gaps in our knowledge, this paper should be of interest to a broader audience than just medical professionals.
The aim of this study was to evaluate the feasibility of Quick Response (QR) codes and mobile devices in the context of Finnish basic education. The feasibility was analyzed through a mobile learning framework, which includes the core characteristics of mobile learning. The study is part of a larger research where the aim is to develop a…
Smith, D. E.; Thomson, J. F.
Experimental study evaluates radioprotective drugs administered before exposure either orally or intravenously. Specifically studied are the sources of radiation, choice of radiation dose, choice of animals, administration of drugs, the toxicity of protective agents and types of protective drug.
National Science Foundation, Washington, DC. National Science Board.
The results of a study of university/industry research interactions are presented, along with four reports on collaboration, and an annotated bibliography. The study, "Current U.S University/Industry Research Connections" (Lois S. Peters, Herbert I. Fusfeld, and others), involved on-site interviews with 66 companies and 61 public and…
Shan, G. H.; Lv, S. F.; Ma, K.
Water environment protection is a global and urgent problem that requires correct and precise evaluation. Evaluation methods have been studied for many years; however, there is a lack of research on the methods of assessing the water regulation ability of dams. Currently, evaluating the ability of dams has become a practical and significant research orientation because of the global water crisis, and the lack of effective ways to manage a dam's regulation ability has only compounded this. This paper firstly constructs seven evaluation factors and then develops two evaluation approaches to implement the factors according to the features of the problem. Dams of the Yin Shang ecological control section in the Huai He River basin are selected as an example to demonstrate the method. The results show that the evaluation approaches can produce better and more practical suggestions for dam managers.
Waghmare, Lalitbhushan S; Rawekar, Alka; Mishra, Ved Prakash
Introduction Medical education can be enormously benefitted from research. Since clinicians/medical teachers are directly involved in teaching learning processes, they should participate in Educational Research (ER) practices to generate evidence and insights about teaching learning. Faculty Development Program (FDP) has a positive influence amongst health professionals and therefore can prove to be of consequence in instilling a strong educational research culture. Aim Present study was undertaken to evaluate the efficacy of a Faculty Development Fellowship Program in Medical Education to foster educational research culture amongst medical teachers. Materials and Methods Study utilized the Kirkpatrick model of program evaluation for evaluating the fellowship program. It aimed to evaluate the third level of the model i.e., “Change in Behaviour” of participants (n=40) after completion of the course. The tool used was a pre-validated survey questionnaire consisting of five items. Results Study population was sparsely aware about educational research and had never attempted the same (100%) before joining the fellowship program. A 32.5% faculty with average professional experience of seven years undertook new educational projects after the fellowship and knowledge gained during fellowship program helped them in guiding educational research (coded into four categories) at their workplaces. Conclusion There is a need, to direct effort towards focused training for educational research through FDPs for medical teachers. This will encourage academicians and clinicians to become active in ER and guide policies in Teaching Learning Practices in Medical Education. PMID:28208883
Palounek, Andrea P. T
The WMC Database is ultimately envisioned to hold a collection of experimental data, design information, and information from computational models. This project was a first attempt at using the Database to access experimental data and extract information from it. This evaluation shows that the Database concept is sound and robust, and that the Database, once fully populated, should remain eminently usable for future researchers.
The purpose of the summer undergraduate internship program for research in environmental studies is to provide an opportunity for well-qualified students to undertake an original research project as an apprentice to an active research scientist in basic environmental research. The students are offered research topics at the Medical University in the scientific areas of pharmacology and toxicology, epidemiology and risk assessment, environmental microbiology, and marine sciences. Students are also afforded the opportunity to work with faculty at the University of Charleston, SC, on projects with an environmental theme. Ten well-qualified students from colleges and universities throughout the eastern United States were accepted into the program.
Marcelino-Jesus, Elsa; Sarraipa, Joao; Jardim-Goncalves, Ricardo
In a world increasingly more competitive and in a constantly development and growth it's important that companies have economic tools, like frameworks to help them to evaluate and validate the technology development to better fits in each company particular needs. The paper presents an evaluation approach for research project pilot applications to stimulate its implementation and deployment, increasing its adequacy and acceptance to their stakeholders and consequently providing new business profit and opportunities. Authors used the DECIDE evaluation framework as a major guide to this approach, which was tested in the iSURF project to support the implementation of an interoperability service utility for collaborative supply chain planning across multiple domains supported by RFID devices.
Critelli, Joseph W; Bivona, Jenny M
This article is the first systematic review of the research literature on women's rape fantasies. Current research indicates that between 31% and 57% of women have fantasies in which they are forced into sex against their will, and for 9% to 17% of women these are a frequent or favorite fantasy experience. Erotic rape fantasies are paradoxical: they do not appear to make sense. Why would a person have an erotic and pleasurable fantasy about an event that, in real life, would be abhorrent and traumatic? In this article, the major theories of women's rape fantasies are evaluated both rationally and empirically. These theories explain rape fantasies in terms of masochism, sexual blame avoidance, openness to sexuality, sexual desirability, male rape culture, biological predisposition to surrender, sympathetic physiological activation, and adversary transformation. This article evaluates theory and research, makes provisional judgments as to which theories appear to be most viable, and begins the task of theoretical integration to arrive at a more complete and internally consistent explanation for why many women engage in erotic rape fantasies. Methodological critiques and programs for future research are presented throughout.
Urban, Jennifer Brown; Hargraves, Monica; Trochim, William M
Evolutionary theory, developmental systems theory, and evolutionary epistemology provide deep theoretical foundations for understanding programs, their development over time, and the role of evaluation. This paper relates core concepts from these powerful bodies of theory to program evaluation. Evolutionary Evaluation is operationalized in terms of program and evaluation evolutionary phases, which are in turn aligned with multiple types of validity. The model of Evolutionary Evaluation incorporates Chen's conceptualization of bottom-up versus top-down program development. The resulting framework has important implications for many program management and evaluation issues. The paper illustrates how an Evolutionary Evaluation perspective can illuminate important controversies in evaluation using the example of the appropriate role of randomized controlled trials that encourages a rethinking of "evidence-based programs". From an Evolutionary Evaluation perspective, prevailing interpretations of rigor and mandates for evidence-based programs pose significant challenges to program evolution. This perspective also illuminates the consequences of misalignment between program and evaluation phases; the importance of supporting both researcher-derived and practitioner-derived programs; and the need for variation and evolutionary phase diversity within portfolios of programs.
Benzley, Janet; And Others
The Salt Lake City School District (SLCSD) teacher evaluation system, which includes peer review and assistance for deficient teachers, was instituted in 1975. The Performance Assistance program provides for strong, experienced teachers (peer reviewers) to work with teachers identified by their principals as deficient. This study addresses the…
... National Estuarine Research Reserves AGENCY: National Oceanic and Atmospheric Administration (NOAA), Office... intent to evaluate the performance of the Elkhorn Slough (California) National Estuarine Research Reserve. The National Estuarine Research Reserve evaluation will be conducted pursuant to sections 312 and...
Brandt, Heather M; Freedman, Darcy A; Friedman, Daniela B; Choi, Seul Ki; Seel, Jessica S; Guest, M Aaron; Khang, Leepao
Documentary filmmaking approaches incorporating community engagement and awareness raising strategies may be a promising approach to evaluate community-based participatory research. The study purpose was 2-fold: (1) to evaluate a documentary film featuring the formation and implementation of a farmers' market and (2) to assess whether the film affected awareness regarding food access issues in a food-desert community with high rates of obesity. The coalition model of filmmaking, a model consistent with a community-based participatory research (CBPR) approach, and personal stories, community profiles, and expert interviews were used to develop a documentary film (Planting Healthy Roots). The evaluation demonstrated high levels of approval and satisfaction with the film and CBPR essence of the film. The documentary film aligned with a CBPR approach to document, evaluate, and disseminate research processes and outcomes.
de Anda, Diane
This article discusses the difficulties in conducting intervention research or evaluating intervention programs in a school setting. In particular, the problems associated with randomization and obtaining control groups are examined. The use of quasi-experimental designs, specifically a paired comparison design using the individual as his or her…
Che, Jinxi; Yang, Haiqiang; Gao, Bo
Lidar (Light Detection and Range) is a brand-new field and research hotspot. Ranging lidar is studied in this paper. Specifically, its basic working principle and photoelectric jamming mechanism are introduced. Then, the ranging error jamming success rate rule is developed for laser distance deception jamming. And the effectiveness evaluation of laser blinding jamming is based on the influence level on ranging accuracy and ranging function. The results have some reference value to evaluation of jamming test effectiveness.
Ali, Hussnain; Lobo, Arthur P.; Loizou, Philipos C.
This paper discusses the design, development, features, and clinical evaluation of a personal digital assistant (PDA)-based platform for cochlear implant research. This highly versatile and portable research platform allows researchers to design and perform complex experiments with cochlear implants manufactured by Cochlear Corporation with great ease and flexibility. The research platform includes a portable processor for implementing and evaluating novel speech processing algorithms, a stimulator unit which can be used for electrical stimulation and neurophysio-logic studies with animals, and a recording unit for collecting electroencephalogram/evoked potentials from human subjects. The design of the platform for real time and offline stimulation modes is discussed for electric-only and electric plus acoustic stimulation followed by results from an acute study with implant users for speech intelligibility in quiet and noisy conditions. The results are comparable with users’ clinical processor and very promising for undertaking chronic studies. PMID:23674422
Bates, Imelda; Ansong, Daniel; Bedu-Addo, George; Agbenyega, Tsiri; Akoto, Alex Yaw Osei; Nsiah-Asare, Anthony; Karikari, Patrick
Background In developing countries the ability to conduct locally-relevant health research and high quality education are key tools in the fight against poverty. The objective of our study was to evaluate the effectiveness of a novel UK accredited, learner-designed research skills course delivered in a teaching hospital in Ghana. Methods Study participants were 15 mixed speciality health professionals from Komfo Anokye Teaching Hospital, Kumasi, Ghana. Effectiveness measures included process, content and outcome indicators to evaluate changes in learners' confidence and competence in research, and assessment of the impact of the course on changing research-related thinking and behaviour. Results were verified using two independent methods. Results 14/15 learners gained research competence assessed against UK Quality Assurance Agency criteria. After the course there was a 36% increase in the groups' positive responses to statements concerning confidence in research-related attitudes, intentions and actions. The greatest improvement (45% increase) was in learners' actions, which focused on strengthening institutional research capacity. 79% of paired before/after responses indicated positive changes in individual learners' research-related attitudes (n = 53), 81% in intention (n = 52) and 85% in action (n = 52). The course had increased learners' confidence to start and manage research, and enhanced life-long skills such as reflective practice and self-confidence. Doing their own research within the work environment, reflecting on personal research experiences and utilising peer support and pooled knowledge were critical elements that promoted learning. Conclusion Learners in Ghana were able to design and undertake a novel course that developed individual and institutional research capacity and met international standards. Learning by doing and a supportive peer community at work were critical elements in promoting learning in this environment where tutors were scarce
The aim of this study is to compare the risk perception levels of Basketball athletes in Turkish League teams according to some variables. In this research the "general screening model," which is one of the descriptive screening methods, was used. While the population of the study consists of athletes actively engaged in the Turkish…
Background Translational medical research literature has increased rapidly in the last few decades and played a more and more important role during the development of medicine science. The main aim of this study is to evaluate the global performance of translational medical research during the past few decades. Methods Bibliometric, social network analysis, and visualization technologies were used for analyzing translational medical research performance from the aspects of subject categories, journals, countries, institutes, keywords, and MeSH terms. Meanwhile, the co-author, co-words and cluster analysis methods were also used to trace popular topics in translational medical research related work. Results Research output suggested a solid development in translational medical research, in terms of increasing scientific production and research collaboration. We identified the core journals, mainstream subject categories, leading countries, and institutions in translational medical research. There was an uneven distribution of publications at authorial, institutional, and national levels. The most commonly used keywords that appeared in the articles were “translational research”, “translational medicine”, “biomarkers”, “stroke”, “inflammation”, “cancer”, and “breast cancer”. Conclusions The subject categories of “Research & Experimental Medicine”, “Medical Laboratory Technology”, and “General & Internal Medicine” play a key role in translational medical research both in production and in its networks. Translational medical research and CTS, etc. are core journals of translational research. G7 countries are the leading nations for translational medical research. Some developing countries, such as P.R China, also play an important role in the communication of translational research. The USA and its institutions play a dominant role in the production, collaboration, citations and high quality articles. The research trends in
Haiqi, Zhang; Yuhua, Zhang
Describes a study that characterized research performance in China through the number of papers published in periodicals and the number of citations received by those papers covered by the "Science Citation Index" database from 1987 to 1993. Distribution of cited disciplines and ranking of research institutes are discussed. (LRW)
Clayton, Dwight; Smith, Cyrus
The purpose of the Materials Aging and Degradation (MAaD) Pathway of the Department of Energy's Light Water Reactor Sustainability (LWRS) Program is to develop the scientific basis for understanding and predicting longterm environmental degradation behavior of material in nuclear power plants and to provide data and methods to assess the performance of systems, structures, and components (SSCs) essential to safe and sustained nuclear power plant operations. The understanding of aging-related phenomena and their impacts on SSCs is expected to be a significant issue for any nuclear power plant planning for long-term operations (i.e. service beyond the initial license renewal period). Management of those phenomena and their impacts during long-term operations can be better enable by improved methods and techniques for detection, monitoring, and prediction of SSC degradation. The MAaD Pathway R and D Roadmap for Concrete, 'Light Water Reactor Sustainability Nondestructive Evaluation for Concrete Research and Development Roadmap', focused initial research efforts on understanding the recent concrete issues at nuclear power plants and identifying the availability of concrete samples for NDE techniques evaluation and testing.  An overview of the research performed by ORNL in these two areas is presented here.
Clayton, Dwight; Smith, Cyrus
The purpose of the Materials Aging and Degradation (MAaD) Pathway of the Department of Energy's Light Water Reactor Sustainability (LWRS) Program is to develop the scientific basis for understanding and predicting longterm environmental degradation behavior of material in nuclear power plants and to provide data and methods to assess the performance of systems, structures, and components (SSCs) essential to safe and sustained nuclear power plant operations. The understanding of aging-related phenomena and their impacts on SSCs is expected to be a significant issue for any nuclear power plant planning for long-term operations (i.e. service beyond the initial license renewal period). Management of those phenomena and their impacts during long-term operations can be better enable by improved methods and techniques for detection, monitoring, and prediction of SSC degradation. The MAaD Pathway R&D Roadmap for Concrete, "Light Water Reactor Sustainability Nondestructive Evaluation for Concrete Research and Development Roadmap", focused initial research efforts on understanding the recent concrete issues at nuclear power plants and identifying the availability of concrete samples for NDE techniques evaluation and testing.  An overview of the research performed by ORNL in these two areas is presented here.
Hooshmand, Elaheh; Tourani, Sogand; Ravaghi, Hamid; Ebrahimipour, Hossein
Lack of scientific and confirmed researches and expert knowledge about evaluation systems for clinical governance development in Iran have made studies on different evaluation systems for clinical governance development a necessity. These studies must provide applied strategies to design criteria of implementing clinical governance for hospital's accreditation. This is a descriptive and comparative study on development of clinical governance models all over the world. Data have been gathered by reviewing related articles. Models have been studied in comprehensive review method. The evaluated models of clinical governance development were Australian, NHS, SPOCK and OPTIGOV. The final aspects extracted from these models were Responsiveness, Policies and Strategies, Organizational Structure, Allocating Resources, Education and Occupational Development, Performance Evaluation, External Evaluation, Patient Oriented Approach, Risk Management, Personnel's Participation, Information Technology, Human Resources, Research and Development, Evidence Based Medicine, Clinical Audit, Health Technology Assessment and Quality. These results are applicable for completing the present criteria which evaluating clinical governance application and provide practical framework to evaluate country's hospital on the basis of clinical governance elements.
Belew, W.W.; Wood, B.L.; Marle, T.L.; Reinhardt, C.L.
The results of a series of telephone interviews with groups of users of information on solar energy storage are described. In the current study only high-priority groups were examined. Results from 2 groups of researchers are analyzed: DOE-Funded Researchers and Non-DOE-Funded Researchers. The data will be used as input to the determination of information products and services the Solar Energy Research Institute, the Solar Energy Information Data Bank Network, and the entire information outreach community should be preparing and disseminating.
Moed, Henk F
This paper presents an overview of research assessment methodologies developed in the field of evaluative bibliometrics, a subfield of quantitative science and technology studies, aimed to construct indicators of research performance from a quantitative statistical analysis of scientific-scholarly documents. Citation analysis is one of its key methodologies. The paper illustrates the potentialities and limitations of the use of bibliometric indicators in research assessment. It discusses the relationship between metrics and peer review; databases used as sources of bibliometric analysis; the pros and cons of indicators often applied, including journal impact factors, Hirsch indices, and normalized indicators of citation impact; and approaches to the bibliometric measurement of institutional research performance.
Youtie, Jan; Corley, Elizabeth A
Despite the increasing investment in multi-year federally funded science and technology centers in universities, there are few studies of how these centers engage in learning and change based on information submitted from various agents in the oversight and evaluation process. One challenge is how to manage and respond to this evaluative information, especially when it is conflicting. Although the center can learn and adapt in response to this information, it can also become subject to a vicious circle of continuous restructuring and production of documentation to address various and potentially inconsistent recommendations. In this paper we illustrate the effects of such a dynamic based on our experiences as external evaluators of the $25 million NSF-funded Learning in Informal and Formal Environments (LIFE) Center. The case study presents an analysis of annual reports and strategic planning documents along with other sources of evidence to illustrate the evolution of center organizational approaches in response to evaluations by external review panels, center evaluators, program managers, and other external stakeholders. We conclude with suggestions for how evaluators may help centers ease the cost of learning and reduce the likelihood of a vicious circle.
Lanigan, Mary L.
Most employees do not like to be evaluated because they fear the process and people involved. Although optimal performance evaluators can minimize people's anxieties about being assessed, actual performance evaluators can perpetuate employees' fears and, worse, lower their job performances and morale. A case study illustrates the actions of an…
Risser, John J.; Tulley, John E.
A pilot study evaluation of SIGI (System of Interactive Guidance and Information) at Pasadena City College in 1974-75 tested the effectiveness of an experimental research design for an expanded field test of the system the following year. (SIGI is a computer based career guidance program designed by Educational Testing Service to assist community…
An NCI press release about the launch of the Detroit Research on Cancer Survivors (ROCS) study, which will look at factors affecting cancer progression, recurrence, mortality, and quality of life among African-American cancer survivors.
Lee, Rebecca E.; Mehta, Paras; Thompson, Debbe; Bhargava, Alok; Carlson, Coleen; Kao, Dennis; Layne, Charles S.; Ledoux, Tracey; O'Connor, Teresia; Rifai, Hanadi; Gulley, Lauren; Hallett, Allen M.; Kudia, Ousswa; Joseph, Sitara; Modelska, Maria; Ortega, Dana; Parker, Nathan; Stevens, Andria
Abstract Introduction: The Childhood Obesity Research Demonstration (CORD) project links public health and primary care interventions in three projects described in detail in accompanying articles in this issue of Childhood Obesity. This article describes a comprehensive evaluation plan to determine the extent to which the CORD model is associated with changes in behavior, body weight, BMI, quality of life, and healthcare satisfaction in children 2–12 years of age. Design/Methods: The CORD Evaluation Center (EC-CORD) will analyze the pooled data from three independent demonstration projects that each integrate public health and primary care childhood obesity interventions. An extensive set of common measures at the family, facility, and community levels were defined by consensus among the CORD projects and EC-CORD. Process evaluation will assess reach, dose delivered, and fidelity of intervention components. Impact evaluation will use a mixed linear models approach to account for heterogeneity among project-site populations and interventions. Sustainability evaluation will assess the potential for replicability, continuation of benefits beyond the funding period, institutionalization of the intervention activities, and community capacity to support ongoing program delivery. Finally, cost analyses will assess how much benefit can potentially be gained per dollar invested in programs based on the CORD model. Conclusions: The keys to combining and analyzing data across multiple projects include the CORD model framework and common measures for the behavioral and health outcomes along with important covariates at the individual, setting, and community levels. The overall objective of the comprehensive evaluation will develop evidence-based recommendations for replicating and disseminating community-wide, integrated public health and primary care programs based on the CORD model. PMID:25679060
Mittal, Rekha; Mahesh, G.
Purpose: The purpose of this research is to identify and evaluate the collections within digital libraries and repositories in India available in the public domain. Design/methodology/approach: The digital libraries and repositories were identified through a study of the literature, as well as internet searching and browsing. The resulting digital…
Sou, Gryphon; Zhou, Pinqiu
Background: With the accession of the PRC to the WTO, Chinese education market is open to the educational service providers of the foreign countries. They are keen to offer MBA Degree programs to the Career Managers in the Mainland. Aims: This research studies program evaluation and so forth the quality assessment of a MBA degree program in the…
Berry, R. F., Jr.
A specification utilized for the nondestructive evaluation of socket type pipe joints at Langley Research Center (LaRC) is discussed. The scope of hardware shall include, but is not limited to, all common pipe fittings: tees, elbows, couplings, caps, and so forth, socket type flanges, unions, and valves. In addition, the exterior weld of slip on flanges shall be inspected using this specification. At the discretion of the design engineer, standard practice engineer, Fracture Mechanics Engineering Section, Pressure Systems Committee, or other authority, four nondestructive evaluation techniques may be utilized exclusively, or in combination, to inspect socket type welds. These techniques are visual, radiographic, magnetic particle, and dye penetrant. Under special circumstances, other techniques (such as eddy current or ultrasonics) may be required and their application shall be guided by the appropriate sections of the American Society of Mechanical Engineers (ASME) Boiler and Pressure Vessel Code (B&PVC).
Patterson, Sophie; Cescon, Angela; Samji, Hasina; Cui, Zishan; Yip, Benita; Lepik, Katherine J; Moore, David; Lima, Viviane D; Nosyk, Bohdan; Harrigan, P Richard; Montaner, Julio S G; Shannon, Kate; Wood, Evan; Hogg, Robert S
Since 1986, antiretroviral therapy (ART) has been available free of charge to individuals living with HIV in British Columbia (BC), Canada, through the BC Centre of Excellence in HIV/AIDS (BC-CfE) Drug Treatment Program (DTP). The Highly Active Antiretroviral Therapy (HAART) Observational Medical Evaluation and Research (HOMER) cohort was established in 1996 to maintain a prospective record of clinical measurements and medication profiles of a subset of DTP participants initiating HAART in BC. This unique cohort provides a comprehensive data source to investigate mortality, prognostic factors and treatment response among people living with HIV in BC from the inception of HAART. Currently over 5000 individuals are enrolled in the HOMER cohort. Data captured include socio-demographic characteristics (e.g. sex, age, ethnicity, health authority), clinical variables (e.g. CD4 cell count, plasma HIV viral load, AIDS-defining illness, hepatitis C co-infection, mortality) and treatment variables (e.g. HAART regimens, date of treatment initiation, treatment interruptions, adherence data, resistance testing). Research findings from the HOMER cohort have featured in numerous high-impact peer-reviewed journals. The HOMER cohort collaborates with other HIV cohorts on both national and international scales to answer complex HIV-specific research questions, and welcomes input from external investigators regarding potential research proposals or future collaborations. For further information please contact the principal investigator, Dr Robert Hogg (firstname.lastname@example.org).
McCoy, Leah P., Ed.
Proceedings of Annual Research Forum. 34 studies. Cultural Awareness in Secondary Spanish (Amy Allen), Writing in Mathematics (Lindsey L. Bakewell), Homework: Assignment Methods and Student Engagement (Lia Beresford), Current Events and Social Studies (Jennie Marie Biser), Authentic Assessments in Social Studies (Carl Boland), Assessment in High…
Shaner, A. J.; Shipp, S. S.; Allen, J.; Kring, D. A.
The Center for Lunar Science and Exploration (CLSE), a collaboration between the Lunar and Planetary Institute and NASA's Johnson Space Center, is one of seven member teams of the NASA Lunar Science Institute (NLSI). In addition to research and exploration activities, the CLSE team is deeply invested in education and outreach. In support of NASA's and NLSI's objective to train the next generation of scientists, CLSE's High School Lunar Research Projects program is a conduit through which high school students can actively participate in lunar science and learn about pathways into scientific careers. The objectives of the program are to enhance 1) student views of the nature of science; 2) student attitudes toward science and science careers; and 3) student knowledge of lunar science. In its first three years, approximately 140 students and 28 teachers from across the United States have participated in the program. Before beginning their research, students undertake Moon 101, a guided-inquiry activity designed to familiarize them with lunar science and exploration. Following Moon 101, and guided by a lunar scientist mentor, teams choose a research topic, ask their own research question, and design their own research approach to direct their investigation. At the conclusion of their research, teams present their results to a panel of lunar scientists. This panel selects four posters to be presented at the annual Lunar Science Forum held at NASA Ames. The top scoring team travels to the forum to present their research. Three instruments have been developed or modified to evaluate the extent to which the High School Lunar Research Projects meets its objectives. These three instruments measure changes in student views of the nature of science, attitudes towards science and science careers, and knowledge of lunar science. Exit surveys for teachers, students, and mentors were also developed to elicit general feedback about the program and its impact. The nature of science
Belew, W.W.; Wood, B.L.; Marle, T.L.; Reinhardt, C.L.
This report describes the results of a series of telephone interviews with groups of users of information on ocean energy systems. These results, part of a larger study on many different solar technologies, identify types of information each group needed and the best ways to get information to each group. The report is 1 of 10 discussing study results. The overall study provides baseline data about information needs in the solar community. Only high-priority groups were examined. Results from 2 groups of researchers are analyzed in this report: DOE-Funded Researchers and Non-DOE-Funded Researchers. The data will be used as input to the determination of information products and services the Solar Energy Research Institute, the Solar Energy Information Data Bank Network, and the entire information outreach community should be preparing and disseminating.
Youtie, Jan; Corley, Elizabeth A.
Despite the increasing investment in multi-year federally funded science and technology centers in universities, there are few studies of how these centers engage in learning and change based on information submitted from various agents in the oversight and evaluation process. One challenge is how to manage and respond to this evaluative…
The main task of research ethics committees (RECs) is to assess research studies before their start. In this study, 24 RECs that evaluate medical research were sent questionnaires about their structure and functions. The RECs were divided into two separate groups: those working in university hospital districts (uRECs) and those in central hospital districts (non-uRECs). The two groups were different in many respects: the uRECs were bigger in size, covered a wider range of disciplines (both medical and non-medical), had better resources and more frequent and regular meetings. After the survey was performed and analysed, the Medical Research Act was amended so that only hospital districts with a medical faculty in their region had a duty to establish ethics committees. After the amendment, the number of RECs evaluating medical research in Finland decreased from 25 to 9. The ethics committees that remained had wider expertise and were better equipped already by the time of this survey. Only one non-uREC was continuing its work, and this was being done under the governance of a university hospital district. Simple measures were used for qualitative analysis of the work of RECs that evaluate medical research. These showed differences between RECs. This may be helpful in establishing an ethics committee network in a research field or administrational area.
It is only since the independance of Togo, in 1958, and after 3 General Census, (1958-59, 1970, 1981), followed immediately by post-census surveys, that a solid basis of statistical data has been available for demographic research. But it is only after 1970, with the creation of the Benin University, and its Demographic Research Unit, the arrival of researchers at the ORSTOM Center of Lome, and of the demographers trained at the IFORD and IDP, that real demographic research has existed. Since then, the ORSTOM has conducted a study on the dynamics of population (fertility, migration, nuptiality, mortality) and its socioeconomic consequences on the agricultural economy of the Plateau Region (1975-1979). It is currently conducting a study in North Togo, comparing demographic data (nuptiality, fertility, infant mortality, family structure) with socioeconomic data (system of land property, women's activity, wives' status in polygamic families), for a better understanding of the influence of demographic reproduction on global social reproduction. The Demographic Research Unit led several studies on fertility in Southeast Togo and Lome. Several other surveys by the department of statistics and the IFORD, by the INRS, as well as student these from diverse schools of Benin University, are studying demo-geography, demo-economy, and demo-sociology. Still, the main problems are the bad quality of the data on fertility and mortality, and the inconsistancy of civil registration. But the interest of the present administration for demographic information may lead to the creation of a "Population Unit" assisting the government, to the definition of a status for researchers, and to the participation of Togo in the new program of Demographic and Health Surveys planned for 35 countries by the Westinghouse Institute for Resource Development.
Tremmel, Michael J.; Garner, S. M.; Schmidt, S. J.; Wisniewski, J. P.; Agol, E.
Graduate students in the astronomy department at the University of Washington began the Pre-Major in Astronomy Program (Pre-MAP) after recognizing that underrepresented students in STEM fields are not well retained after their transition from high school. Pre-MAP is a research and mentoring program that begins with a keystone seminar where they learn astronomical research techniques that they apply to research projects conducted in small groups. Students also receive one-on-one mentoring and peer support for the duration of the academic year and beyond. Successful Pre-MAP students have declared astronomy and physics majors, expanded their research projects beyond the fall quarter, presented posters at the UW Undergraduate Research Symposium, and received research fellowships and summer internships. Here we examine the success of the program in attracting underrepresented minorities and in facilitating better STEM retention and academic performance among incoming UW students. We use the University of Washington Student Database to study both the performance of Pre-MAP students and the overall UW student body over the past 8 years. We show that Pre-MAP students are generally more diverse than the overall UW population and also come in with a variety of different math backgrounds, which we show to be an important factor on STEM performance for the overall UW population. We find that that Pre-MAP students are both more academically successful and more likely to graduate in STEM fields than their UW peers, regardless of initial math placement.
Mark, Melvin M.; And Others
The role of content validity in policy-relevant research is illustrated in a study contrasting results of surveys concerning public opinion toward gun control. Inadequate content validity threatened inferences about the overall level of support for gun control, but not about opinion difference between sexes or respondents of varying political…
Christie, Christina A.; Fleischer, Dreolin Nesbitt
To describe the recent practice of evaluation, specifically method and design choices, the authors performed a content analysis on 117 evaluation studies published in eight North American evaluation-focused journals for a 3-year period (2004-2006). The authors chose this time span because it follows the scientifically based research (SBR)…
Tragus, Robin; Cody, Jannine D
There is a need for metrics that describe the full range of services provided by a clinical research unit; given that services have expanded to include such things as investigator training, regulatory compliance monitoring, and budget negotiations. We developed a tool and methodology that allows tracking of these expanded services. This not only allowed us to more accurately describe the work of the research unit staff, but to monitor the status of a study across the entire study lifespan from the idea to the publication. In addition to measuring work, it allows us to anticipate future needs in clinical staff and expertise because we are involved very early in study planning. We also expect that by analyzing these data from many studies over time, we will identify process barriers that will direct future program improvement.
Stillman, Frances; Hartman, Anne; Graubard, Barry; Gilpin, Elizabeth; Chavis, David; Garcia, John; Wun, Lap-Ming; Lynn, William; Manley, Marc
Describes the conceptual design, research framework, evaluation components, and analytic strategies that are guiding the evaluation of a demonstration-research effort, the American Stop Smoking Intervention Study (ASSIST). The ASSIST evaluation is a unique analysis of the relationships among social context, public-health activity, tobacco use, and…
Czaja, Sara J.; Lee, Chin Chin; Branham, Janice; Remis, Peggy
Purpose of the Study: The objectives of this study were to evaluate a community-based basic computer and Internet training program designed for older adults, provide recommendations for program refinement, and gather preliminary information on program sustainability. Design and Methods: The program was developed by the OASIS Institute, a nonprofit…
Hardre, Patricia; Cox, Michelle
Expectations and the way they are communicated can influence employees' motivation and performance. Previous research has demonstrated individual effects of workplace climate and individual differences on faculty productivity. The present study focused on the characteristics of institutional performance standards, evaluation processes and…
Ganpat, Wayne G.; Isaac, Wendy-Ann P.; Brathwaite, Richard A. I.; Bekele, Isaac
In this study, farmers were engaged in a participatory research project and their attitudes evaluated. The purpose was to identify the characteristics of farmers who are favourably predisposed towards meaningful participation in the process. Several cover crops were tested for possible use in the management of watergrass ("Commelina…
This report presents the results of a dissemination project, the objectives of which were: (1) to conduct a set of conferences at several predominantly Negro colleges for the reporting of research results from a study in which these schools had previously participated, (2) to evaluate the effectiveness of these conferences with respect to…
The purpose of this study was to conduct a comprehensive process evaluation of Fit for Life Steps (FFLS), a community based participatory research (CBPR) influenced intervention focused on improving physical activity and health in residents of the Lower Mississippi Delta. A comprehensive framework f...
Borgman, Christine L.; And Others
Reports on the Online Access to Knowledge (OAK) Project, which developed software to support end user access to a Department of Energy database based on the skill levels and needs of energy researchers. The discussion covers issues in development, evaluation, and the study of user behavior in designing an interface tailored to a special…
Szalacha, Laura A.
In spite of its short history, education that is inclusive of LGBTQ issues has developed in three major paradigms: (1) safety; (2) equity; and (3) critical theory. A review of research and program evaluation of teacher education with regard to LGBTQ reveals only a limited number of studies--most of which fall within either the safety or equity…
Ragno, Kerry Sullivan
The purpose of this dissertation was to evaluate the effectiveness of an Early Childhood Development Associate of Applied Science (AAS) degree program at one community college as part of an ongoing action research project. Prior to this dissertation study, external and internal barriers prevented the associate degree program stakeholders from…
Davis, Sarita; Gervin, Derrick; White, Garrick; Williams, Aisha; Taylor, Angela; McGriff, Ebony
This study organized a participatory action research team to investigate Council on Social Work Education policies and their effect on the teaching and production of evaluation at the master's level. Data were collected in the form of 282 theses, 27 surveys, and 7 telephone interviews with field instructors to examine the use of evidence-based…
Since 1969 the International Planned Parenthood Federation has worked with the government of Botswana in setting up family planning services. An evaluation of the family planning aspects of the program were carried out. This is a summary of three research studies and some general comments. Included is: (1) an introduction to Botswana and the…
Goldhaber-Fiebert, Jeremy D.; Snowden, Lonnie R.; Wulczyn, Fred; Landsverk, John; Horwitz, Sarah M.
Objectives: With over 1 million children served by the US Child Welfare system at a cost of $20 billion annually, this study examines the economic evaluation literature on interventions to improve outcomes for children at risk for and currently involved with the system, identifies areas where additional research is needed, and discusses the use of…
Ross, Amy J.; Kosmo, Joseph J.; Janoiko, Barbara A.; Bernard, Craig; Splawn, Keith; Eppler, Dean B.
During the first two weeks of September 2005, the National Aeronautics and Space Administration (NASA) Johnson Space Center (JSC) Advanced Extravehicular Activity (AEVA) team led the field test portion of the 2005 Research and Technology Studies (RATS). The Desert RATS field test activity is the culmination of the various individual science and advanced engineering discipline areas year-long technology and operations development efforts into a coordinated field test demonstration under representative (analog) planetary surface terrain conditions. The purpose of the RATS is to drive out preliminary exploration concept of operations EVA system requirements by providing hands-on experience with simulated planetary surface exploration extravehicular activity (EVA) hardware and procedures. The RATS activities also are of significant importance in helping to develop the necessary levels of technical skills and experience for the next generation of engineers, scientists, technicians, and astronauts who will be responsible for realizing the goals of the Constellation Program. The 2005 Desert RATS was the eighth RATS field test and was the most systems-oriented, integrated field test to date with participants from NASA field centers, the United States Geologic Survey (USGS), industry partners, and research institutes. Each week of the test, the 2005 RATS addressed specific sets of objectives. The first week focused on the performance of surface science astro-biological sampling operations, including planetary protection considerations and procedures. The second week supported evaluation of the Science, Crew, Operations, and Utility Testbed (SCOUT) proto-type rover and its sub-systems. Throughout the duration of the field test, the Communications, Avionics, and Infomatics pack (CAI-pack) was tested. This year the CAI-pack served to provide information on surface navigation, science sample collection procedures, and EVA timeline awareness. Additionally, 2005 was the first
Welsh, Jennifer M.
The way in which graduate students attending British universities approach their one year of research study and the problems they encounter as graduate students were studied as part of an investigation into postgraduate education undertaken at the University of Aberdeen. Of the 77 students, 56 (39 Ph.D., 17 Master's candidates) were registered in…
Cassady, Helen; Clarke, Gill; Latham, Ann-Marie
This paper outlines action research that was undertaken as a part of a DfES Best Practice Research Scholarship (BPRS). The aims of the research were, firstly, to investigate how girls at Key Stage 3 and 4 feel about evaluating and being evaluated in dance and, secondly, to devise a range of evaluation tasks which enable pupils both to evaluate…
Berche, Bertrand; Holovatch, Yuri; Kenna, Ralph; Mryglod, Olesya
In recent years, evaluation of the quality of academic research has become an increasingly important and influential business. It determines, often to a large extent, the amount of research funding flowing into universities and similar institutes from governmental agencies and it impacts upon academic careers. Policy makers are becoming increasingly reliant upon, and influenced by, the outcomes of such evaluations. In response, university managers are increasingly attracted to simple metrics as guides to the dynamics of the positions of their various institutions in league tables. However, these league tables are invariably drawn up by inexpert bodies such as newspapers and magazines, using arbitrary measures and criteria. Terms such as “critical mass” and “h-index” are bandied about without understanding of what they actually mean. Rather than accepting the rise and fall of universities, departments and individuals on a turbulent sea of arbitrary measures, we suggest it is incumbent upon the scientific community itself to clarify their nature. Here we report on recent attempts to do that by properly defining critical mass and showing how group size influences research quality. We also examine currently predominant metrics and show that these fail as reliable indicators of group research quality.
Auselmi, J. A.; Weinberg, L. W.; Yurczyk, R. F.; Nelson, W. G.
A research project to investigate antiskid braking systems for the space shuttle vehicle was conducted. System from the Concorde, Boeing 747, Boeing 737, and Lockheed L-1011 were investigated. The characteristics of the Boeing 737 system which caused it to be selected are described. Other subjects which were investigated are: (1) trade studies of brake control concepts, (2) redundancy requirements trade study, (3) laboratory evaluation of antiskid systems, and (4) space shuttle hardware criteria.
Poirrier, G P
A 3-year collaborative study was conducted by the department head of baccalaureate nursing and the director of writing at a southern university in Louisiana. The research was designed to test the effectiveness of an intense writing-to-learn curriculum intervention incorporated into a required introductory nursing course. Writing-to-learn strategies used in this study were designed to foster personal involvement in the subject matter, improve data comprehension, and encourage critical thinking (Dobie & Poirrier, 1995). The findings reported in this study represent Part III of a 3-year investigation into the effectiveness of using writing-to-learn strategies in freshman nursing classes.
Macdonald, Ranald; Wisdom, James
This practice-oriented book brings together research and evaluation approaches and supporting case studies from educational researchers and teachers. The emphasis is on changing practice in higher education and the research that underpins desirable development. Following an introduction, chapter 1 presents Educational Development Changing Practice…
Ekandem, Joshua I; Davis, Timothy A; Alvarez, Ignacio; James, Melva T; Gilbert, Juan E
The use of brain computer interface (BCI) devices in research and applications has exploded in recent years. Applications such as lie detectors that use functional magnetic resonance imaging (fMRI) to video games controlled using electroencephalography (EEG) are currently in use. These developments, coupled with the emergence of inexpensive commercial BCI headsets, such as the Emotiv EPOC ( http://emotiv.com/index.php ) and the Neurosky MindWave, have also highlighted the need of performing basic ergonomics research since such devices have usability issues, such as comfort during prolonged use, and reduced performance for individuals with common physical attributes, such as long or coarse hair. This paper examines the feasibility of using consumer BCIs in scientific research. In particular, we compare user comfort, experiment preparation time, signal reliability and ease of use in light of individual differences among subjects for two commercially available hardware devices, the Emotiv EPOC and the Neurosky MindWave. Based on these results, we suggest some basic considerations for selecting a commercial BCI for research and experimentation. STATEMENT OF RELEVANCE: Despite increased usage, few studies have examined the usability of commercial BCI hardware. This study assesses usability and experimentation factors of two commercial BCI models, for the purpose of creating basic guidelines for increased usability. Finding that more sensors can be less comfortable and accurate than devices with fewer sensors.
Many governmental space activities need to be planned with a time horizon that extends beyond the comfort zone of reliable technology development assessments and predictions. In an environment of accelerating technological change, a methodological approach to addressing non-core technology trends and potentially disruptive, game-changing developments not yet linked to the space sector is increasingly important to complement efforts in core technology R&D planning. Various models and organisational setups aimed at fulfilling this purpose are in existence. These include, with varying levels of relevance to space, the National Aeronautics and Space Administration (NASA) Institute for Advanced Concepts (NIAC, operational form 1998 to 2007 and recently re-established), the Defence Advanced Research Projects Agency of the US Department of Defence, the Massachusetts Institute of Technology (MIT) Medialab, the early versions of Starlab, the Lockheed Skunk Works and the European Space Agency's Advanced Concepts Team. Some of these organisations have been reviewed and assessed individually, though systematic comparison of their methods, approaches and results have not been published. This may be due in part to the relatively sparse scientific literature on organisational parameters for enabling disruptive innovation as well as to the lack of commonly agreed indicators for the evaluation of their performance. Furthermore, innovation support systems in the space sector are organised differently than in traditional, open competitive markets, which serve as the basis for most scholarly literature on the organisation of innovation. The present paper is intended to advance and stimulate discussion on the organisation of disruptive innovation mechanisms specifically for the space sector. It uses the examples of the NASA Institute for Advanced Concepts and the ESA Advanced Concepts Team, analyses their respective approaches and compares their results, leading to the proposal of
Livesey, Heather; Challender, Shelia
For well over a decade, the organizational context of nursing in the United Kingdom has been one of change and reform with a policy shift towards primary and community led health care. Such a major shift in policy provides nurses with an opportunity to re-think their approaches towards the individuals and communities they serve in order to promote self-care, recognize achievable health goals and provide family and community support. Although there is a growing appreciation of action research as an useful approach to this kind of development, it can be difficult to evaluate published studies because of the diverse nature of the literature. This paper will present and evaluate two case studies using a particular conceptual device (The Normative Information Model-based Systems Analysis and Design) in order to explore a possible alternative to the interpretative narrative or positivistic hypothesis-testing models used to report other kinds of nursing research and enlarge the debate about process evaluation.
Corwin, Lisa A.; Graham, Mark J.; Dolan, Erin L.
Course-based undergraduate research experiences (CUREs) are being championed as scalable ways of involving undergraduates in science research. Studies of CUREs have shown that participating students achieve many of the same outcomes as students who complete research internships. However, CUREs vary widely in their design and implementation, and aspects of CUREs that are necessary and sufficient to achieve desired student outcomes have not been elucidated. To guide future research aimed at understanding the causal mechanisms underlying CURE efficacy, we used a systems approach to generate pathway models representing hypotheses of how CURE outcomes are achieved. We started by reviewing studies of CUREs and research internships to generate a comprehensive set of outcomes of research experiences, determining the level of evidence supporting each outcome. We then used this body of research and drew from learning theory to hypothesize connections between what students do during CUREs and the outcomes that have the best empirical support. We offer these models as hypotheses for the CURE community to test, revise, elaborate, or refute. We also cite instruments that are ready to use in CURE assessment and note gaps for which instruments need to be developed. PMID:25687826
Corwin, Lisa A; Graham, Mark J; Dolan, Erin L
Course-based undergraduate research experiences (CUREs) are being championed as scalable ways of involving undergraduates in science research. Studies of CUREs have shown that participating students achieve many of the same outcomes as students who complete research internships. However, CUREs vary widely in their design and implementation, and aspects of CUREs that are necessary and sufficient to achieve desired student outcomes have not been elucidated. To guide future research aimed at understanding the causal mechanisms underlying CURE efficacy, we used a systems approach to generate pathway models representing hypotheses of how CURE outcomes are achieved. We started by reviewing studies of CUREs and research internships to generate a comprehensive set of outcomes of research experiences, determining the level of evidence supporting each outcome. We then used this body of research and drew from learning theory to hypothesize connections between what students do during CUREs and the outcomes that have the best empirical support. We offer these models as hypotheses for the CURE community to test, revise, elaborate, or refute. We also cite instruments that are ready to use in CURE assessment and note gaps for which instruments need to be developed.
Levri, Julie A.; Hogan, J. A.; Alazraki, M. P.
A preliminary list of criteria is proposed for evaluation of solid waste processing technologies for research and technology development (R&TD) in the Advanced Life Support (ALS) Program. Completion of the proposed list by current and prospective ALS technology developers, with regard to specific missions of interest, may enable identification of appropriate technologies (or lack thereof) and guide future development efforts for the ALS Program solid waste processing area. An attempt is made to include criteria that capture information about the technology of interest as well as its system-wide impacts. Some of the criteria in the list are mission-independent, while the majority are mission-specific. In order for technology developers to respond to mission-specific criteria, critical information must be available on the quantity, composition and state of the waste stream, the wast processing requirements, as well as top-level mission scenario information (e.g. safety, resource recovery, planetary protection issues, and ESM equivalencies). The technology readiness level (TRL) determines the degree to which a technology developer is able to accurately report on the list of criteria. Thus, a criteria-specific minimum TRL for mandatory reporting has been identified for each criterion in the list. Although this list has been developed to define criteria that are needed to direct funding of solid waste processing technologies, this list processes significant overlap in criteria required for technology selection for inclusion in specific tests or missions. Additionally, this approach to technology evaluation may be adapted to other ALS subsystems.
Wilson, Matthew B.
The Propulsion Research Center at the University of Alabama in Huntsville has designed and built a hydro-mechanical pulsator to simulate the pressure fluctuations created by high frequency combustion instability. The pressure response characteristics were evaluated in an atmospheric test rig using filtered de-ionized water as the working fluid. The outlet of the pulsator was connected to a swirl injector post to provide downstream flow resistance. Previous low pressure and mass flow experimental data revealed a complex relationship between the control parameters and the pulsation response. For each test, the average mass flow rates of the waste water, water lost through the seals, and injector mass flow rates are measured. A dynamic pressure transducer at the pulsator exit measures and records the pressure waveform. Pulsation magnitude, reliability, repeatability, pulsation effects, and detailed variable control are examined. The data shows the pulsator is capable of generating 30% pulsation at 1575 Hz input. The repeatability of the pulsator is questionable because the standard deviations exceeded 40% of the average. The detailed data obtained during this research provides is sufficient to develop a pulsator tuning procedure for future applications.
The purpose of the compendium is to provide information about research activities in decentralized energy systems to researchers, government officials, and interested citizens. The compendium lists and briefly describes a number of studies in other industrialized nations that involve decentralized energy systems. A contact person is given for each of the activities listed so that interested readers can obtain more information.
The report provides guidance and a readily available reference to groups involved with the Florida Radon Research Program's (FRRP's) research house studies. t includes: 1): Lists of Parameters for continuous and periodic high and low resolution measurements; (2) Protocols for cha...
Quansah, Emmanuel; Karikari, Thomas K
Neurological and neuropsychiatric diseases account for considerable healthcare, economic and social burdens in Ghana. In order to effectively address these burdens, appropriately-trained scientists who conduct high-impact neuroscience research will be needed. Additionally, research directions should be aligned with national research priorities. However, to provide information about current neuroscience research productivity and direction, the existing capacity and focus need to be identified. This would allow opportunities for collaborative research and training to be properly explored and developmental interventions to be better targeted. In this study, we sought to evaluate the existing capacity and direction of neuroscience-related research in Ghana. To do this, we examined publications reporting research investigations authored by scientists affiliated with Ghanaian institutions in specific areas of neuroscience over the last two decades (1995-2015). 127 articles that met our inclusion criteria were systematically evaluated in terms of research foci, annual publication trends and author affiliations. The most actively-researched areas identified include neurocognitive impairments in non-nervous system disorders, depression and suicide, epilepsy and seizures, neurological impact of substance misuse, and neurological disorders. These studies were mostly hospital and community-based surveys. About 60% of these articles were published in the last seven years, suggesting a recent increase in research productivity. However, data on experimental and clinical research outcomes were particularly lacking. We suggest that future investigations should focus on the following specific areas where information was lacking: large-scale disease epidemiology, effectiveness of diagnostic platforms and therapeutic treatments, and the genetic, genomic and molecular bases of diseases.
Air quality was monitored in beef mono-slope barns. The objectives of the study were 1) to gather baseline data for the levels of gas emissions and particulate matter from beef mono-slope facilities, 2) evaluate the effect of two different manure handling systems on air quality, and 3) provide infor...
Dr. Alex MacKerell and Deva The XD 1 has proven to be a popular resource among Priyakumar use CHARMM to study the interaction of the researchers that...solver. Dr. Seikat Dey is using the ARMS 1,350,000 code to study wideband acoustic radiation and scattering NOZZLE 800,000 from submerged elastic...authentication in a Lustre® environment. 6. Dey , S. and Dibyendu K. Datta, "A parallel hp-FEM infrastructure for three-dimensional structural acoustics
Gunn, Andrew; Mintrom, Michael
Evaluation of academic research plays a significant role in government efforts to steer public universities. The scope of such evaluation is now being extended to include the "relevance" or "impact" of academic research outside the academy. We address how evaluation of non-academic research impact can promote more such impact…
... research and evaluation. 112.9 Section 112.9 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION... PACKAGING AND LABELING § 112.9 Biological products imported for research and evaluation. A biological product imported for research and evaluation under a permit issued in accordance with § 104.4, with...
... research and evaluation. 112.9 Section 112.9 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION... PACKAGING AND LABELING § 112.9 Biological products imported for research and evaluation. A biological product imported for research and evaluation under a permit issued in accordance with § 104.4, with...
King, Jean A.
Discusses why evaluation has a field has not studied its own theory systematically and examines the tensions between the often-cited claim of K. Lewin that there is noting as practical as a good theory and the response of M. Fullan that there is nothing as theoretical as good practice. (Author/SLD)
Glass, Thomas E.
This article reports the findings of a snapshot study of the superintendency conducted by the American Association of School Administrators (AASA). The findings revealed that superintendents were evaluated highly by their boards, but the number of leaders who received the highest ratings have declined during the past six years. The report, which…
Lopez, Thomas P.; And Others
Clinical and pathological studies of Reye's syndrome indicate that symptoms range from influenza-related encephalitis-type disease to cranial pressure, cerebral edema, hemorrhage, and coma. Biochemical research on the blood, ammonia, and the liver is increasing in sophistication, and hopes for future insight into the etiology of Reye's syndrome…
This presentation has three parts; a review of bench-scale endotoxin research, a review of observations from a field scale endotoxin release study, and discussion of biosolids stabilization and characterization by PLFA/FAME microbial community analysis. Endotoxins are part of th...
As education budgets shrink, art teachers need to find ways to position the study of art closer to mainstream academics by exploring concepts that cut across disciplinary boundaries. Art teachers can challenge students to do serious and thorough research about subject matter partnering with teachers in other areas to select subject matter that is…
RESEARCH STUDIES ON PHOTONS AND BIPHOTONS STEPHEN HARRIS LELAND STANFORD JUNIOR UNIVERSITY 10/01/2013 Final Report DISTRIBUTION A: Distribution...biphotons, Physics colloquium, Physics Department, National Chung Cheng University, Chiayi, Tai- wan, March 21, 2012. (12) S. Shwartz and S. E. Harris
Describes the development and workings of the Jupiter Environmental Research and Field Studies Academy that focuses on enabling both teachers and students to participate in real-life learning experiences. Discusses qualifications for admittance, curriculum, location, ongoing projects, students, academics, preparation for life, problem solving, and…
Emery, Beth C.; Lloyd, Sally A.
This review of methodological, theoretical, and topical trends in family studies research covers changes in definitions of family and in marriage, parent-child relationships, and family social ecology. Issues discussed include marital satisfaction, violence, social construction of gender, family-work relationship, parenting roles, socialization,…
Guerena, Salvador; Gonzalez, Raquel Quiroz
Designed to acquaint persons conducting library research in Chicano Studies with the reference materials found in the University Library at the University of California-Santa Barbara, the manual provides information on the Coleccion Tloque Nahuaque, relevant subject headings, and a useful search strategy. Resources, staff, assigned reading…
Guerena, Salvador; Gonzales, Raquel Quiroz
Designed to acquaint persons conducting library research in Chicano Studies with the numerous reference materials found in the University Library at the University of California-Santa Barbara, the manual provides information on the Coleccion Tloque Nahuaque, relevant subject headings, and a useful search strategy. The Coleccion Tloque Nahuaque,…
Resnik, David B.; Rasmussen, Lisa M.; Kissling, Grace E.
Research misconduct is an international concern. Misconduct policies can play a crucial role in preventing and policing research misconduct, and many institutions have developed their own policies. While institutional policies play a key role in preventing and policing misconduct, national policies are also important to ensure consistent promulgation and enforcement of ethical standards. The purpose of this study was to obtain more information about research misconduct policies across the globe. We found that twenty-two of the top forty research and development funding countries (55%) had a national misconduct policy. Four countries (18.2%) are in the process of developing a policy, and four (18.2%) have a national research ethics code but no misconduct policy. All twenty-two countries (100%) with national policies included fabrication, falsification, and plagiarism in the definition of misconduct, but beyond that there was considerable diversity. Unethical authorship was mentioned in 54.6% of the misconduct definitions, followed by unethical publication practices (36.4%), conflict of interest mismanagement (36.4%), unethical peer review (31.8%), misconduct related to misconduct investigations (27.3%), poor record keeping (27.3%), other deception (27.3%), serious deviations (22.7%), violating confidentiality (22.7%), and human or animal research violations (22.7%). Having a national policy was positively associated with research and development funding ranking and intensiveness. To promote integrity in international research collaborations, countries should seek to harmonize and clarify misconduct definitions and develop procedures for adjudicating conflicts when harmonization does not occur. PMID:25928177
Resnik, David B; Rasmussen, Lisa M; Kissling, Grace E
Research misconduct is an international concern. Misconduct policies can play a crucial role in preventing and policing research misconduct, and many institutions have developed their own policies. While institutional policies play a key role in preventing and policing misconduct, national policies are also important to ensure consistent promulgation and enforcement of ethical standards. The purpose of this study was to obtain more information about research misconduct policies across the globe. We found that twenty-two of the top forty research and development funding countries (55%) had a national misconduct policy. Four countries (18.2%) are in the process of developing a policy, and four (18.2%) have a national research ethics code but no misconduct policy. All twenty-two countries (100%) with national policies included fabrication, falsification, and plagiarism in the definition of misconduct, but beyond that there was considerable diversity. Unethical authorship was mentioned in 54.6% of the misconduct definitions, followed by unethical publication practices (36.4%), conflict of interest mismanagement (36.4%), unethical peer review (31.8%), misconduct related to misconduct investigations (27.3%), poor record keeping (27.3%), other deception (27.3%), serious deviations (22.7%), violating confidentiality (22.7%), and human or animal research violations (22.7%). Having a national policy was positively associated with research and development funding ranking and intensiveness. To promote integrity in international research collaborations, countries should seek to harmonize and clarify misconduct definitions and develop procedures for adjudicating conflicts when harmonization does not occur.
Buchanan, Alec; Norko, Michael
The written report is a central component of forensic psychiatric practice. In the report, an evaluator assembles and organizes data, interprets results of an evaluation, and offers an opinion in response to legal questions. The past 30 years have seen substantial development in principles and practice of forensic report writing. Drawing on recent advances in the psychiatric report, the authors explore topics including narrative, forensic ethics, coercion within the justice system, and implications of limitations on data in forming forensic opinions. They offer an analysis of unanswered questions in these areas, suggesting opportunities for further empirical study and theoretical development. This proposed agenda is important in training, in the development of policy, and in establishing professional guidelines.
Shaw, Jessica; Campbell, Rebecca; Hagstrom, Julie; O'Reilly, Leslie; Kreiger, Gail; Cain, Debi; Nye, Jeff
The importance of research-informed practice for the field of sexual assault has been stressed by academics and practitioners alike. However, there are few examples of researcher-practitioner partnerships in the literature, therefore providing minimal guidance for this process. This article describes a researcher-practitioner partnership that was successful in using evaluation data to guide practice and policy decisions regarding the development and implementation of a new sexual assault kit for the state of Michigan. Cousins's practical participatory evaluation theory was used as the guiding framework for the evaluation. Data collection methods included focus groups with practitioners from five, regionally dispersed health care settings in Michigan, and surveys with forensic scientists throughout the state's regional laboratory system. This case study highlights how researchers and practitioners worked together for data collection, analysis, and dissemination to support research-informed practice in this state. Lessons learned and future recommendations for forming researcher-practitioner partnerships to improve the response to sexual assault are discussed.
Terekhov, A. I.
The article analyzes the development of nano research in Russia during the years 1990-2010. To identify the contribution of Russia in nanoscience and to compare it with the contribution of other countries, we used the international multidisciplinary database Science Citation Index Expanded. Scientific performance is measured based on the growth rate of nano publications by countries and in the world, authorship patterns, indexes of international collaboration, etc. The indicators used are the national publication output, the total citations and the average citation per nano publication, the number and subject profile of highly cited nano publications; contribution and impact of Russian institutions. The article describes the current state and trends of nano research in Russia, their key players and the existing "centers of excellence." It also discusses some inconsistencies of Russia's science policy in the field of nanotechnology in light of the performed bibliometric study.
Many complex and fascinating flow features occur when a shock wave impinges on or around a surface. Understanding of these is important in view of the increasing application in a variety of fields, such as medicine and material modification, besides the more conventional fields of blast loading of structures and supersonic aerodynamics. This paper deals with some of the developments of research in the field of shock wave studies at the Flow Research Unit of the University of the Witwatersrand. It covers both successful and unsuccessful investigations and suggests those that still need further work.
Manning, Heidi L. K.
Recently, the Martian atmosphere and surface constituents have become of great interest. The Viking in situ gas chromatograph mass spectrometer experiment contributed greatly to our knowledge of the composition of the Martian atmosphere. However, important questions remain such as the abundance of water on Mars. The Viking experiment employed solid reagents to enhance their carbon measurements. Techniques of chemical conversion using simple solid reagents have advanced considerably in the past 20 years. In this investigation we researched the advancements in techniques to reversibly adsorb and desorb water and focused on the techniques potentially useful for the temperatures and pressures on the Martian surface. During the granting period from June 15, 1998 to August 14, 1998, a literature study of the material appropriate for use in a chemical conversion device and the availability of these materials were undertaken. The focus of this investigation was searching for methods and materials potentially useful in enhancing the measurements of water. Three different methods were considered for the means to extract water from a given gas sample. These methods included adsorption in a desiccant, adsorption on a clean metal surface, and adsorption in a carbon molecular sieve or zeolite. Each method was evaluated with feasibility and reversibility in mind. By far the simplest and perhaps cheapest way to remove water from a gaseous sample is by means of a bulk desiccant. Desiccants are commercially available from many companies including those that supply chemicals. The main feature of a desiccant is its ability to rapidly bind or absorb water from the atmosphere. Calcium chloride, for example, is frequently incorporated into drying tubes by organic chemists when reactions require the absence of water. Other desiccants include sodium hydroxide, calcium hydride, and commercial products such as Drierite, available from Aldrich Chemical. The disadvantage to most desiccants is
Sancar Tokmak, Hatice; Meltem Baturay, H.; Fadde, Peter
This study aimed to evaluate and redesign an online master's degree program consisting of 12 courses from the informatics field using a context, input, process, product (CIPP) evaluation model. Research conducted during the redesign of the online program followed a mixed methodology in which data was collected through a CIPP survey,…
Friedman, Robert; Kudesia, Valmeek; Sebastiani, Paola; Monti, Stefano; Misquitta, Donald; Peterson, Kirsten; Whinfield, James; Stoeckle, Rebecca
Translational research generates and/or uses very large amounts of diverse data. Informatics principles and methods address datasets that are large and complex, whereas few translational researchers know these principles and methods and many cannot design, carry out, or analyze the results of these studies optimally. With few exceptions, informatics education has not been directed to researchers, especially established researchers. To fill this gap, we carried out a formal needs assessment of research informatics education of translational researchers, focusing on established researchers. Using the results, we developed a model curriculum for educating researchers in research informatics and a first generation model online course in research informatics for researchers. We are completing a formal evaluation of this online course with a diverse group of translational researchers. From the results of this evaluation, we will create a second version of the online course, a dissemination plan to make it available to researchers nationally, and a plan to enhance the course over time. We will discuss the implications for the future of translational research and research informatics.
Manville, Catriona; Jones, Molly Morgan; Frearson, Michael; Castle-Clarke, Sophie; Henham, Marie-Louise; Gunashekar, Salil; Grant, Jonathan
The Research Excellence Framework (REF) 2014 is a nationwide initiative designed to assess the quality of research in UK higher education institutions (HEIs). For the first time, REF 2014 introduced the wider impact of research, alongside the quality of research and the vitality of the research environment, into the assessment of research…
Eismann, Donald; And Others
This report documents the findings related to Objective 2 of the Schools and Neighborhoods Research Study. The task was to identify community services provided by the neighborhood school. The study staff reviewed the existing facilities use information from the Seattle Public Schools. Results from the Facilities Utilization Study Survey and the…
Kuriansky, J B; Sharpe, L
This paper reviews some important clinical and research implications of studies which have evaluated the effectiveness of short-term behavioral group therapy for anorgasmia. Though formal research data on curative factors is very sparse, the experience of sharing within a group, and the focus on arousal seem consistent with treatment outcome; however, the emphasis on assertiveness and the woman-only approach may have countertherapeutic as well as therapeutic effects. A potentially important intervening variable is the woman's level of ego development. The use of certain assessment scales and criteria for success of treatment are critiqued, and recommendations made for further study.
Vaade, Elizabeth; McCready, Bo
Traditionally, researchers, policymakers, and practitioners have perceived a tension between rigor and accessibility in quantitative research and evaluation in postsecondary education. However, this study indicates that both producers and consumers of these studies value high-quality work and clear findings that can reach multiple audiences. The…
Ham, Amanda D.; Huggins-Hoyt, Kimberly Y.; Pettus, Joelle
Objectives: This study examined how evaluation and intervention research (IR) studies assessed statistical change to ascertain effectiveness. Methods: Studies from six core social work journals (2009-2013) were reviewed (N = 1,380). Fifty-two evaluation (n= 27) and intervention (n = 25) studies met the inclusion criteria. These studies were…
Balagtas, J V; Hutchinson, F M; Krochta, J M; Sumner, D A
As U.S. dairy farms continue to become more productive, increasing demand is a key to improved economic prospects for the dairy industry. One way to expand demand for dairy products is to find new, economically viable uses for milk. Ex ante economic analysis of new uses for agricultural products anticipates the potential market effects of innovations, and provides a basis for evaluating investment in research and development and setting research priorities. This study evaluated potential economic effects of new applications of films and coatings made from whey protein. An economic simulation model was used to predict the likely effects of the innovations on dairy markets. Cost comparisons with existing technologies and interviews with industry officials were the basis for evaluating potential for commercial adoption of the innovations. The economic simulation model traces the projected increased demand for whey through the markets for dairy products and milk. The associated increased demand for milk could result in benefits to U.S. milk producers of $123.0 million in present value terms, compared to a research cost of $ 4.9 million, with the dairy industry, consumers, and taxpayers all contributing. Interpreting the cost of the research program as an investment on behalf of milk producers, the benefits to producers from development of new whey uses represent an annual rate of return between 28 and 33%. These results are useful for evaluating further investment in the whey research program. The methods illustrated here are applicable to the evaluation of a wide range of research and promotion efforts.
Hardré, Patricia L; Ling, Chen; Shehab, Randa L; Herron, Jason; Nanny, Mark A; Nollert, Matthias U; Refai, Hazem; Ramseyer, Christopher; Wollega, Ebisa D
This study examines the design and evaluation strategies for a year-long teacher learning and development experience, including their effectiveness, efficiency and recommendations for strategic redesign. Design characteristics include programmatic features and outcomes: cognitive, affective and motivational processes; interpersonal and social development; and performance activities. Program participants were secondary math and science teachers, partnered with engineering faculty mentors, in a research university-based education and support program. Data from multiple sources demonstrated strengths and weaknesses in design of the program's learning environment, including: face-to-face and via digital tools; on-site and distance community interactions; and strategic evaluation tools and systems. Implications are considered for the strategic design and evaluation of similar grant-funded research experiences intended to support teacher learning, development and transfer.
Bachani, Abdulgafoor M; Rattani, Abbas; Hyder, Adnan A
Currently, health systems research (HSR) is reviewed by the same ethical standards as clinical research, which has recently been argued in the literature to be an inappropriate standard of evaluation. The issues unique to HSR warrant a different review by research ethics committees (RECs), as it does not impose the same risks to study participants as other types of clinical or public health research. However, there are limited tools and supporting documents that clarify the ethical considerations. Therefore, there is a need for additional reflection around ethical review of HSR and their consideration by RECs. The purpose of this paper is to review, understand, and synthesize the current state of literature and practice to inform these deliberations and the larger discourse on ethics review guidelines for HSR. This paper presents a review of the literature on ethics of HSR in the biomedical, public health, and implementation research to identify ethical considerations specific to HSR; and to identify examples of commonly available guidance and/or tools for the ethical review of HSR studies. Fifteen articles were identified on HSR ethics issues, and forty-two international academic institutions were contacted (of the responses (n=29), no institution had special ethical guidelines for reviewing HSR) about their HSR ethics review guidelines. There appears to be a clear gap in the current health research ethics discourse around health systems research ethics. This review serves as a first step (to better understand the current status) towards a larger dialogue on the topic.
Niculae, Iulian M.; Cucu, Adina L.; Hartel, Tibor
The Natura 2000 network is regarded as one of the conservation success stories in the global effort to protect biodiversity. However, significant challenges remain in Natura 2000 implementation, owing to its rapid expansion, and lack of a coherent vision for its future. Scientific research is critical for identifying conservation priorities, setting management goals, and reconciling biodiversity protection and society in the complex political European landscape. Thus, there is an urgent need for a comprehensive evaluation of published Natura 2000 research to highlight prevalent research themes, disciplinary approaches, and spatial entities. We conducted a systematic review of 572 scientific articles and conference proceedings focused on Natura 2000 research, published between 1996 and 2014. We grouped these articles into ‘ecological’ and ‘social and policy’ categories. Using a novel application of network analysis of article keywords, we found that Natura 2000 research forms a cohesive small-world network, owing to the emphasis on ecological research (79% of studies, with a strong focus on spatial conservation planning), and the underrepresentation of studies addressing ‘social and policy’ issues (typically focused on environmental impact assessment, multi-level governance, agri-environment policy, and ecosystem services valuation). ‘Ecological’ and ‘social and policy’ research shared only general concepts (e.g., Natura 2000, Habitats Directive) suggesting a disconnection between these disciplines. The UK and the Mediterranean basin countries dominated Natura 2000 research, and there was a weak correlation between number of studies and proportion of national territory protected. Approximately 40% of ‘social and policy’ research and 26% of ‘ecological’ studies highlighted negative implications of Natura 2000, while 21% of studies found positive social and biodiversity effects. We emphasize the need for designing inter- and
Arias-Gómez, Jesús; Villasís-Keever, Miguel Ángel; Miranda-Novales, María Guadalupe
The study population is defined as a set of cases, determined, limited, and accessible, that will constitute the subjects for the selection of the sample, and must fulfill several characteristics and distinct criteria. The objectives of this manuscript are focused on specifying each one of the elements required to make the selection of the participants of a research project, during the elaboration of the protocol, including the concepts of study population, sample, selection criteria and sampling methods. After delineating the study population, the researcher must specify the criteria that each participant has to comply. The criteria that include the specific characteristics are denominated selection or eligibility criteria. These criteria are inclusion, exclusion and elimination, and will delineate the eligible population. The sampling methods are divided in two large groups: 1) probabilistic or random sampling and 2) non-probabilistic sampling. The difference lies in the employment of statistical methods to select the subjects. In every research, it is necessary to establish at the beginning the specific number of participants to be included to achieve the objectives of the study. This number is the sample size, and can be calculated or estimated with mathematical formulas and statistic software.
Morfeld, M; Wirtz, M
According to the established definition of Pfaff, health services research analyses patients' path through the institutions of the health care system. The focus is on development, evaluation and implementation of innovative measures of health care. By increasing its quality health services research strives for an improvement of efficacy and efficiency of the health care system. In order to allow for an appropriate evaluation it is essential to differentiate between structure, process and outcome quality referring to (1) the health care system in its entirety, (2) specific health care units as well as (3) processes of communication in different settings. Health services research comprises a large array of scientific disciplines like public health, medicine, social sciences and social care. For the purpose of managing its tasks adequately a special combination of instruments and methodological procedures is needed. Thus, diverse techniques of evaluation research as well as special requirements for study designs and assessment procedures are of vital importance. The example of the German disease management programmes illustrates the methodical requirements for a scientific evaluation.
Dillman, Lisa M.; Christie, Christina A.
This study explores the relationship between evaluation policies and evaluation practice. Through document analysis, interviews, and a multiple case study, the research examined the explicit and implicit policies overarching the evaluation work commissioned by the Robert Wood Johnson Foundation (RWJF) and explored how these policies are…
Hussain, Irshad; Durrani, Muhammad Ismail
The purpose of this study was to evaluate the role of web technologies in promoting research pursuance among university teachers, examine the use of web technologies by university teachers in conducting research and identify the problems of university academia in using web technologies for research. The study was delimited to academia of social…
Background The steady increase of mobile phone usage has led to a rising concern about possible adverse health effects of radio frequency electromagnetic field (RF EMF) exposure at intensities even below the existing safety limits. Accumulating evidence suggests that pulse-modulated RF EMF may alter brain physiology. Yet, whereas effects on the human electroencephalogram in waking and sleep have repeatedly been shown in recent years, results on cognitive performance are inconsistent. Methods This review compares 41 provocation studies regarding the effects of RF EMF exposure similar to mobile telephones on cognitive performance measures in humans. The studies were identified via systematic searches of the databases Pub Med and ISI Web of Science and were published in peer-reviewed journals between 1998 and the end of 2009. Results Based on a critical discussion within the scope of methodological standards it is concluded that state-of-the-art-methods in bio-electromagnetic research on RF EMF effects and cognition have neither been specified nor fully implemented over the last 10-11 years. The lack of a validated tool, which reliably assesses changes in cognitive performance caused by RF EMF exposure, may contribute to the current inconsistencies in outcomes. The high variety of findings may also be due to methodological issues such as differences in sample size and the composition of study groups, experimental design, exposure setup as well as the exposure conditions, and emphasizes the need for a standardized protocol in bioelectromagnetic research. Conclusions At present, no underlying biological mechanism has been identified which mediates the effects on brain functioning as observed in electroencephalographic (EEG) studies. A future aim must be to identify this mechanism as well as a reliable exposure protocol in order to gain more insights into possible behavioral and related health consequences of high-frequency EMF exposure. PMID:21266038
Villasís-Keever, Miguel Ángel; Miranda-Novales, María Guadalupe
The variables in a research study are all that is measured, the information collected, or the data that is collected in order to answer the research questions, which are specified in the objectives. Their selection is essential to the research protocol. This article aims to point out the elements to be considered in the section of the variables. To avoid ambiguity, it is necessary to select only those that will help achieve the study objectives. It should subsequently be defined how they will be measured to ensure that the findings can be replicated; it is therefore desirable to include conceptual and operational definitions. From the methodological point of view, the classification of variables helps us understand how the relationship between them is conceptualized. Depending on the study design, the independent, dependent, universal, and confounding variables should be noted. Another indispensable element for planning statistical analyses is the scale of variable measurement. Therefore, one must specify whether the variables correspond to one of the following four: qualitative nominal, qualitative ordinal, quantitative range, or quantitative ratio. Finally, we should detail the measurement units of each variable.
Deloria, Dennis; And Others
This report presents data collected in six of the 16 Home Start sites in operation in the spring of 1973. The major task of the pilot summative evaluation was to try out the measurement battery so necessary modifications could be completed before beginning the actual evaluation in fall 1973. Another purpose was to train a capable field staff and…
Ling, Tom; Bardsley, Martin; Adams, John; Lewis, Richard; Roland, Martin
Background In response to concerns that the needs of the aging population for well-integrated care were increasing, the English National Health Service (NHS) appointed 16 Integrated Care Pilots following a national competition. The pilots have a range of aims including development of new organisational structures to support integration, changes in staff roles, reducing unscheduled emergency hospital admissions, reduced length of hospital stay, increasing patient satisfaction, and reducing cost. This paper describes the evaluation of the initiative which has been commissioned. Study design and data collection methods A mixed methods approach has been adopted including interviews with staff and patients, non-participant observation of meetings, structured written feedback from sites, questionnaires to patients and staff, and analysis of routinely collected hospital utilisation data for patients/service users. The qualitative analysis aims to identify the approaches taken to integration by the sites, the benefits which result, the context in which benefits have resulted, and the mechanisms by which they occur. Methods of analysis The quantitative analysis adopts a ‘difference in differences’ approach comparing health care utilisation before and after the intervention with risk-matched controls. The qualitative data analysis adopts a ‘theory of change’ approach in which we triangulate data from the quantitative analysis with qualitative data in order to describe causal effects (what happens when an independent variable changes) and causal mechanisms (what connects causes to their effects). An economic analysis will identify what incremental resources are required to make integration succeed and how they can be combined efficiently to produce better outcomes for patients. Conclusion This evaluation will produce a portfolio of evidence aimed at strengthening the evidence base for integrated care, and in particular identifying the context in which interventions
Ma, Feicheng; Zhan, Nan
Since "cloud computing" was put forward by Google , it quickly became the most popular concept in IT industry and widely permeated into various areas promoted by IBM, Microsoft and other IT industry giants. In this paper the methods of bibliometric analysis were used to investigate the global cloud computing research trend based on Web of Science (WoS) database and the Engineering Index (EI) Compendex database. In this study, the publication, countries, institutes, keywords of the papers was deeply studied in methods of quantitative analysis, figures and tables are used to describe the production and the development trends of cloud computing.
Stakeholder participation and evaluation use have attracted a lot of attention from practitioners, theorists and researchers. A common hypothesis is that participation is positively associated with evaluation use. Whereas the number of empirical studies conducted on this topic is impressive, quantitative research has held a minority position within this scientific production. This study mobilizes systematic review methods to 'map' the empirical literature that has quantitatively studied participation and use. The goal is to take stock and assess the strength of evidence of this literature (but not to synthesize the findings) and, based on this assessment, to provide directions for future research.
If the subjective experience and evaluation of environmental noise shall be considered and integrated into the current soundscape research, the use of qualitative research methods used in sociology and psychology will become necessary. A triangulation of research methods for measuring objective noise and for the subjective evaluation of noises and sounds on the background of subjective meanings of health and healthy living will be a fruitful way to a more comprehensive understanding of the phenomenon of soundscapes in the context of health and quality of life. In this contribution, a selection of qualitative research methods will be presented that allows for analyzing subjective experiences with environmental noise. Interviews focusing on narratives of episodes and situations (e.g., the episodic interview, Flick, 2002) will be outlined. Issues of how to assess the quality of qualitative research and its results will be addressed and finally the benefits and limits of the triangulation of different methods (e.g., interviews and focus groups or interviews and physical measures) will be discussed. Research experiences from the author's recent studies on health concepts of health professionals will be used for illustration.
Kagan, Jonathan M; Rosas, Scott; Trochim, William M K
New discoveries in basic science are creating extraordinary opportunities to design novel biomedical preventions and therapeutics for human disease. But the clinical evaluation of these new interventions is, in many instances, being hindered by a variety of legal, regulatory, policy and operational factors, few of which enhance research quality, the safety of study participants or research ethics. With the goal of helping increase the efficiency and effectiveness of clinical research, we have examined how the integration of utilization-focused evaluation with elements of business process modeling can reveal opportunities for systematic improvements in clinical research. Using data from the NIH global HIV/AIDS clinical trials networks, we analyzed the absolute and relative times required to traverse defined phases associated with specific activities within the clinical protocol lifecycle. Using simple median duration and Kaplan-Meyer survival analysis, we show how such time-based analyses can provide a rationale for the prioritization of research process analysis and re-engineering, as well as a means for statistically assessing the impact of policy modifications, resource utilization, re-engineered processes and best practices. Successfully applied, this approach can help researchers be more efficient in capitalizing on new science to speed the development of improved interventions for human disease.
Kagan, Jonathan M; Rosas, Scott; Trochim, William M K
New discoveries in basic science are creating extraordinary opportunities to design novel biomedical preventions and therapeutics for human disease. But the clinical evaluation of these new interventions is, in many instances, being hindered by a variety of legal, regulatory, policy and operational factors, few of which enhance research quality, the safety of study participants or research ethics. With the goal of helping increase the efficiency and effectiveness of clinical research, we have examined how the integration of utilization-focused evaluation with elements of business process modeling can reveal opportunities for systematic improvements in clinical research. Using data from the NIH global HIV/AIDS clinical trials networks, we analyzed the absolute and relative times required to traverse defined phases associated with specific activities within the clinical protocol lifecycle. Using simple median duration and Kaplan-Meyer survival analysis, we show how such time-based analyses can provide a rationale for the prioritization of research process analysis and re-engineering, as well as a means for statistically assessing the impact of policy modifications, resource utilization, re-engineered processes and best practices. Successfully applied, this approach can help researchers be more efficient in capitalizing on new science to speed the development of improved interventions for human disease. PMID:21552512
Smallwood, J; Irvine, E; Coulter, F; Connery, H
Dementia is a degenerating illness and the lack of a reliable measure of self-report in particular presents particular difficulties for research. Often in the later stages of dementia behavioural measurement is the only tool available for the evaluation of treatment techniques. This paper describes and evaluates a short observational tool suitable for clinical assessment purposes. The scale has been shown to have the potential for adequate inter-rater reliability, test retest reliability, and convergent and divergent validity, if the study limitations reflecting statistical rather than ecological validity, and limitations of sample size are borne in mind.
Loubeau, Alexandra; Rathsam, Jonathan; Klos, Jacob
A sonic boom simulator at NASA Langley Research Center has been constructed for research on human response to low-amplitude sonic booms heard indoors. Research in this facility will ultimately lead to development of a psychoacoustic model for single indoor booms. The first subjective test was designed to explore indoor human response to variations in sonic boom rise time and amplitude. Another goal was to identify loudness level variability across listener locations within the facility. Finally, the test also served to evaluate the facility as a laboratory research tool for studying indoor human response to sonic booms. Subjects listened to test sounds and were asked to rate their annoyance relative to a reference boom. Measurements of test signals were conducted for objective analysis and correlation with subjective responses. Results confirm the functionality of the facility and effectiveness of the test methods and indicate that loudness level does not fully describe indoor annoyance to the selected sonic boom signals.
In order to more fully understand data gaps in human exposure and toxicity to tire crumb materials, ATSDR, CPSC and EPA undertook a collaborative effort in the form of a scientific literature review and subsequent gaps analysis. The first objective of the Literature Review and Gap Analysis (LRGA) collaboration was to identify the existing body of literature related specifically to human exposure to tire crumb materials through the use of synthetic turf athletic fields and playgrounds. The second objective was to characterize and summarize the relevant data from the scientific literature. The final objective was to review the summary information and identify data gaps to build on the current understanding of the state-of-the-science and inform the development of specific research efforts that would be most impactful in the near-term. Because of the need for additional information, the U.S. Environmental Protection Agency (EPA), the Centers for Disease Control and Prevention/Agency for Toxic Substances and Disease Registry (ATSDR), and the U.S. Consumer Product Safety Commission (CPSC) launched a multi-agency action plan to study key environmental human health questions. The Federal Research Action Plan includes numerous activities, including research studies (U.S. EPA, 2016). A key objective of the Action Plan is to identify key knowledge gaps.
Intervention research in rural health disparities communities presents challenges for study design, implementation, and evaluation, thus threatening scientific rigor, reducing response rates, and confounding study results. A multisite nutrition intervention was conducted in the rural Lower Mississip...
Dent, Amy L.; Hoyle, Rick H.
We discuss the articles of this special issue with reference to an important yet previously only implicit dimension of study quality: alignment across the theoretical and methodological decisions that collectively define an approach to self-regulated learning. Integrating and extending work by leaders in the field, we propose a framework for evaluating alignment in the way self-regulated learning research is both conducted and reported. Within this framework, the special issue articles provide a springboard for discussing methodological promises and pitfalls of increasingly sophisticated research on the dynamic, contingent, and contextualized features of self-regulated learning. PMID:25825589
Rusnak, J. J.; Freeman, J. E.; Hartley, J. M.; Kottenstette, J. P.; Staskin, E. R.
Research activities conducted under the Program for Transfer Research and Impact Studies (TRIS) during 1972 included: (1) preparation of 10,196 TSP requests for TRIS application analysis; (2) interviews with over 500 individuals concerning the technical, economic, and social impacts of NASA-generated technology; (3) preparation of 38 new technology transfer example files and 101 new transfer cases; and (4) maintenance of a technology transfer library containing more than 2,900 titles. Six different modes of technology utilization are used to illustrate the pervasiveness of the transfer and diffusion of aerospace innovations. These modes also provide a basis for distinguishing the unique characteristics of the NASA Technology Utilization Program. An examination is reported of the ways in which NASA-generated technology is contributing to beneficial social change in five major areas of human concern: health, environment, safety, transportation, and communication.
Seibyl, J; Jennings, D; Tabamo, R; Marek, K
The increasing availability of PET imaging in nuclear medicine expands the armamentarium of clinical and research tools for improving diagnosis and treatment of neuropsychiatric disorders. Nonetheless, the role of SPECT imaging remains critical to both research and clinical practice. The development of rational strategies for guiding the selection of imaging modalities flows from primarily the nature of the clinical or research question and the availability of appropriate radiopharmaceuticals. There has been extensive SPECT and PET work in Parkinson's disease (PD) which highlights the value of both these scintigraphic modalities. Three main areas of interest in PD include imaging for improving diagnostic accuracy, for monitoring the progression of disease, and for assessing the therapeutic efficacy of drugs with neuroprotective potential. The demands of the clinical or research question posed to imaging dictates the selection of radiotracer and imaging modality. Diagnosis of PD represents the easiest challenge with many imaging biomarkers showing high sensitivity for detecting abnormal reduction of dopaminergic function based on qualitative review of images. On the other hand, using imaging to evaluate treatments which purportedly slow the rate of disease progression, indicated by the reduction in the rate of loss in a quantitative imaging signal in patients studied over time, represents the most rigorous requirement of the imaging measure. In each of these applications presynaptic markers of dopaminergic function using SPECT and PET have been extremely valuable. Review of neuroimaging studies of PD provides a useful example of optimized approaches to clinical and research studies in neuropsychiatric disorders.
Coetzee, Tanya; Hoffmann, Willem A; de Roubaix, Malcolm
The amended research ethics policy at a South African University required the ethics review of undergraduate research projects, prompting the need to explore the content and teaching approach of research ethics education in health science undergraduate programs. Two qualitative data collection strategies were used: document analysis (syllabi and study guides) and semi-structured interviews with research methodology coordinators. Five main themes emerged: (a) timing of research ethics courses, (b) research ethics course content, (c) sub-optimal use of creative classroom activities to facilitate research ethics lectures, (d) understanding the need for undergraduate project research ethics review, and (e) research ethics capacity training for research methodology lecturers and undergraduate project supervisors.
Parsons, N.; Achten, J.; Griffin, X. L.; Costa, M. L.; Reed, M. R.
Background Approximately half of all hip fractures are displaced intracapsular fractures. The standard treatment for these fractures is either hemiarthroplasty or total hip arthroplasty. The recent National Institute for Health and Care Excellence (NICE) guidance on hip fracture management recommends the use of ‘proven’ cemented stem arthroplasty with an Orthopaedic Device Evaluation Panel (ODEP) rating of at least 3B (97% survival at three years). The Thompsons prosthesis is currently lacking an ODEP rating despite over 50 years of clinical use, likely due to the paucity of implant survival data. Nationally, adherence to these guidelines is varied as there is debate as to which prosthesis optimises patient outcomes. Design This study design is a multi-centre, multi-surgeon, parallel, two arm, standard-of-care pragmatic randomised controlled trial. It will be embedded within the WHiTE Comprehensive Cohort Study (ISRCTN63982700). The main analysis is a two-way equivalence comparison between Hemi-Thompson and Hemi-Exeter polished taper with Unitrax head. Secondary outcomes will include radiological leg length discrepancy measured as per Bidwai and Willett, mortality, re-operation rate and indication for re-operation, length of index hospital stay and revision at four months. This study will be supplemented by the NHFD (National Hip Fracture Database) dataset. Discussion Evidence on the optimum choice of prosthesis for hemiarthroplasty of the hip is lacking. National guidance is currently based on expert opinion rather than empirical evidence. The incidence of hip fracture is likely to continue to increase and providing high quality evidence on the optimum Cite this article: A. L. Sims. The World Hip Trauma Evaluation Study 3: Hemiarthroplasty Evaluation by Multicentre Investigation – WHITE 3: HEMI – An Abridged Protocol. Bone Joint Res 2016;5:18–25. DOI: 10.1302/2046-3758.51.2000473 PMID:26825319
Sample McMeeking, Laura B; Basile, Carole; Brian Cobb, R
Theory-based evaluation (TBE) is an evaluation method that shows how a program will work under certain conditions and has been supported as a viable, evidence-based option in cases where randomized trials or high-quality quasi-experiments are not feasible. Despite the model's widely accepted theoretical appeal there are few examples of its well-implemented use, probably due to time and money limitations necessary for planning and a confusion over the definitions between research and evaluation functions and roles. In this paper, we describe the development of a theory-based evaluation design in a Math and Science Partnership (MSP) research project funded by the U.S. National Science Foundation (NSF). Through this work we developed an organizational model distinguishing between and integrating evaluation and research functions, explicating personnel roles and responsibilities, and highlighting connections between research and evaluation work. Although the research and evaluation components operated on independent budgeting, staffing, and implementation activities, we were able to combine datasets across activities to allow us to assess the integrity of the program theory, not just the hypothesized connections within it. This model has since been used for proposal development and has been invaluable as it creates a research and evaluation plan that is seamless from the beginning.
Wong, Stephen E.; Vakharia, Sheila P.
Objective: The authors examined outcomes of a graduate course on evaluating social work practice that required students to use published research, quantitative measures, and single-system designs in a simulated practice evaluation project. Method: Practice evaluation projects from a typical class were analyzed for the number of research references…
AlSumih, A. M.
This study presents a research map for the key research priorities of higher education (HE) in the Kingdom of Saudi Arabia. The study diagnoses and analyzes the research reality in HE studies in KSA in terms of strength points and improvement opportunities. It also explores the research map fields of current and prospective research priorities in…
Feather, Martin S.
The premise of this paper is taht there is a useful analogy between evaluation of proposed problem solutions and evaluation of requirements engineering research itself. Both of these application areas face the challenges of evaluation early in the lifecycle, of the need to consider a wide variety of factors, and of the need to combine inputs from multiple stakeholders in making thse evaluation and subsequent decisions.
Cusick, Anne; Camer, Danielle; Stamenkovic, Alexander; Zaccagnini, Melissa
Research training should facilitate effective researcher role development. While researcher roles require the performance of specialised knowledge and skill, they also require development of personal research identities within social contexts. Interaction with research peers can provide opportunities for reflective role development. Ad-hoc…
Teasley, Stephanie D; Bhatnagar, Rishi
Background Working together efficiently and effectively presents a significant challenge in large-scale, complex, interdisciplinary research projects. Collaboratories are a nascent method to help meet this challenge. However, formal collaboratories in biomedical research centers are the exception rather than the rule. Objective The main purpose of this paper is to compare and describe two collaboratories that used off-the-shelf tools and relatively modest resources to support the scientific activity of two biomedical research centers. The two centers were the Great Lakes Regional Center for AIDS Research (HIV/AIDS Center) and the New York University Oral Cancer Research for Adolescent and Adult Health Promotion Center (Oral Cancer Center). Methods In each collaboratory, we used semistructured interviews, surveys, and contextual inquiry to assess user needs and define the technology requirements. We evaluated and selected commercial software applications by comparing their feature sets with requirements and then pilot-testing the applications. Local and remote support staff cooperated in the implementation and end user training for the collaborative tools. Collaboratory staff evaluated each implementation by analyzing utilization data, administering user surveys, and functioning as participant observers. Results The HIV/AIDS Center primarily required real-time interaction for developing projects and attracting new participants to the center; the Oral Cancer Center, on the other hand, mainly needed tools to support distributed and asynchronous work in small research groups. The HIV/AIDS Center’s collaboratory included a center-wide website that also served as the launch point for collaboratory applications, such as NetMeeting, Timbuktu Conference, PlaceWare Auditorium, and iVisit. The collaboratory of the Oral Cancer Center used Groove and Genesys Web conferencing. The HIV/AIDS Center was successful in attracting new scientists to HIV/AIDS research, and members
... 45 Public Welfare 1 2010-10-01 2010-10-01 false Early termination of research support: Evaluation... SERVICES GENERAL ADMINISTRATION PROTECTION OF HUMAN SUBJECTS Basic HHS Policy for Protection of Human Research Subjects § 46.123 Early termination of research support: Evaluation of applications and...
White, David J.; Shoffner, Anna; Johnson, Kendal; Knowles, Netti; Mills, Madison
This article describes the journey taken by a group of adolescents into the field and practice of youth-led research. The article gives voice to the growing number of youth participating in research and evaluation. The authors give authentic youth accounts of: (1) the process of becoming researchers and evaluators, (2) the benefits and challenges…
Phillips, Rob; Kennedy, Gregor; McNaught, Carmel
This paper attempts a fundamental analysis of the nature of research into e-learning and the role that theory plays in this. We examine "research" in broad terms, and the nature of phenomena in general. We identify that e-learning is an artificial phenomenon, and that research approaches need to be cognisant of the design elements in e-learning,…
University scientific research ability is an important indicator to express the strength of universities. In this paper, the evaluation of university scientific research ability is investigated based on the output of sci-tech papers. Four university alliances from North America, UK, Australia, and China, are selected as the case study of the university scientific research evaluation. Data coming from Thomson Reuters InCites are collected to support the evaluation. The work has contributed new framework to the issue of university scientific research ability evaluation. At first, we have established a hierarchical structure to show the factors that impact the evaluation of university scientific research ability. Then, a new MCDM method called D-AHP model is used to implement the evaluation and ranking of different university alliances, in which a data-driven approach is proposed to automatically generate the D numbers preference relations. Next, a sensitivity analysis has been given to show the impact of weights of factors and sub-factors on the evaluation result. At last, the results obtained by using different methods are compared and discussed to verify the effectiveness and reasonability of this study, and some suggestions are given to promote China’s scientific research ability. PMID:28212446
Zong, Fan; Wang, Lifang
University scientific research ability is an important indicator to express the strength of universities. In this paper, the evaluation of university scientific research ability is investigated based on the output of sci-tech papers. Four university alliances from North America, UK, Australia, and China, are selected as the case study of the university scientific research evaluation. Data coming from Thomson Reuters InCites are collected to support the evaluation. The work has contributed new framework to the issue of university scientific research ability evaluation. At first, we have established a hierarchical structure to show the factors that impact the evaluation of university scientific research ability. Then, a new MCDM method called D-AHP model is used to implement the evaluation and ranking of different university alliances, in which a data-driven approach is proposed to automatically generate the D numbers preference relations. Next, a sensitivity analysis has been given to show the impact of weights of factors and sub-factors on the evaluation result. At last, the results obtained by using different methods are compared and discussed to verify the effectiveness and reasonability of this study, and some suggestions are given to promote China's scientific research ability.
Stricker, Kerry Bohl; Hagan, Donald; Flory, S. Luke
Methods used to evaluate the ecological impacts of biological invasions vary widely from broad-scale observational studies to removal experiments in invaded communities and experimental additions in common gardens and greenhouses. Different methods provide information at diverse spatial and temporal scales with varying levels of reliability. Thus, here we provide a synthetic and critical review of the methods used to evaluate the impacts of plant invasions and provide recommendations for future research. We review the types of methods available and report patterns in methods used, including the duration and spatial scale of studies and plant functional groups examined, from 410 peer-reviewed papers published between 1971 and 2011. We found that there has been a marked increase in papers published on plant invasion impacts since 2003 and that more than half of all studies employed observational methods while <5 % included predictive modelling. Most of the studies were temporally and spatially restricted with 51 % of studies lasting <1 year and almost half of all studies conducted in plots or mesocosms <1 m2. There was also a bias in life form studied: more than 60 % of all studies evaluated impacts of invasive forbs and graminoids while <16 % focused on invasive trees. To more effectively quantify invasion impacts, we argue that longer-term experimental research and more studies that use predictive modelling and evaluate impacts of invasions on ecosystem processes and fauna are needed. Combining broad-scale observational studies with experiments and predictive modelling may provide the most insight into invasion impacts for policy makers and land managers seeking to reduce the effects of plant invasions. PMID:25829379
Stricker, Kerry Bohl; Hagan, Donald; Flory, S Luke
Methods used to evaluate the ecological impacts of biological invasions vary widely from broad-scale observational studies to removal experiments in invaded communities and experimental additions in common gardens and greenhouses. Different methods provide information at diverse spatial and temporal scales with varying levels of reliability. Thus, here we provide a synthetic and critical review of the methods used to evaluate the impacts of plant invasions and provide recommendations for future research. We review the types of methods available and report patterns in methods used, including the duration and spatial scale of studies and plant functional groups examined, from 410 peer-reviewed papers published between 1971 and 2011. We found that there has been a marked increase in papers published on plant invasion impacts since 2003 and that more than half of all studies employed observational methods while <5 % included predictive modelling. Most of the studies were temporally and spatially restricted with 51 % of studies lasting <1 year and almost half of all studies conducted in plots or mesocosms <1 m(2). There was also a bias in life form studied: more than 60 % of all studies evaluated impacts of invasive forbs and graminoids while <16 % focused on invasive trees. To more effectively quantify invasion impacts, we argue that longer-term experimental research and more studies that use predictive modelling and evaluate impacts of invasions on ecosystem processes and fauna are needed. Combining broad-scale observational studies with experiments and predictive modelling may provide the most insight into invasion impacts for policy makers and land managers seeking to reduce the effects of plant invasions.
This study implemented and evaluated gaming instruction as a professional development for science teachers at a Georgia high school. It was guided by four research questions that (a) assessed the impact of training in gaming instruction and evaluation of that training on science teachers' ability to use games; (b) examined evidence showing that…
Coles, Gary J.
The research design and analytic approaches used in the national evaluation of the Elementary Secondary Education Act (ESEA) Title VII Spanish/English Bilingual Education Program are described. This study evaluated the entire program, as opposed to individual projects, and had four goals: to (1) determine the cognitive and affective impact of…
Guest, M Aaron; Miller, Margaret C; Smith, Macie P; Hyleman, Brenda
The Office for the Study of Aging (OSA) at the University of South Carolina was established in 1988 in conjunction with the founding of the South Carolina Alzheimer's Disease Registry. Over the last 25 years, the Office for the Study of Aging has furthered its purpose through the development of research and programs for all of South Carolina's aging population. Examples include the Placemat Strength Training Program, the Dementia Dialogues education program, and the South Carolina Vulnerable Adult Guardian ad Litem program. The work of the office is sustained through a unique government-university-community partnership that supports innovative work and provides direct lines for dissemination, translation, and implementation of programs. The office's efforts have resulted in two state laws involving aging and older adults as well as recognition through awards and publications. The Office provides a partnership model that offers a dissemination and translation pipeline for programs to be developed, piloted, revised, and enacted into policy.
Wu, S. T.
Extensive work was performed in data analysis and modeling of solar active phenomena. The work consisted in the study of UV data from the Ultraviolet Spectrometer and Polarimeter (UVSP) instrument on board the Solar Maximum Mission satellite. These data were studied in conjunction with X-rays from the Hard X-ray Imaging Spectrometer (HXIS) instrument, and with H-alpha and magnetographic data from ground-based observatories. The processes we studied are the active phenomena which result from the interaction of the solar magnetic fields with the plasma in the outer regions of the solar atmosphere. These processes include some very dynamic processes such as the prominence eruptions and the 'microflares'. Our research aimed at characterizing the following: the observed phenomena, the possible physical models, and the relevance to the chromospheric and coronal heating.
Burns, Erin A.
Non-destructive testing is essential in many fields of manufacturing and research in order to perform reliable examination of potentially damaged materials and parts without destroying the inherent structure of the materials. Thus, the Non-Destructive Evaluation (NDE) Team at NASA Glenn Research Center partakes in various projects to improve materials testing equipment as well as analyze materials, material defects, and material deficiencies. Due to the array of projects within the NDE Team at this time, five research aims were supplemental to some current projects. A literature survey of "DE and testing methodologies as related to rocks was performed. Also, Mars Expedition Rover technology was assessed to understand the requirements for instrumentation in harsh space environments (e.g. temperature). Potential instrumentation and technologies were also considered and documented. The literature survey provided background and potential sources for a proposal to acquire funding for ultrasonic instrumentation on board a future Mars expedition. The laboratory uses a Santec Systems AcousticScope AS200 acoustography system. Labview code was written within the current program in order to improve the current performance of the acoustography system. A sample of Reinforced Carbon/Carbon (RCC) material from the leading edge of the space shuttle underwent various non-destructive tests (guided wave scanning, thermography, computed tomography, real time x-ray, etc.) in order to characterize its structure and examine possible defects. Guided wave scan data of a ceramic matrix composite (CMC) panel was reanalyzed utilizing image correlations and signal processing variables. Additional guided wave scans and thermography were also performed on the CMC panel. These reevaluated data and images will be used in future presentations and publications. An additional axis for the guided wave scanner was designed, constructed, and implemented. This additional axis allowed incremental spacing
Sullivan, Joanne H.; Glisson, Scott R.
Although the scientific peer review process is crucial to distributing research investments, little has been reported about the decision-making processes used by reviewers. One key attribute likely to be important for decision-making is reviewer expertise. Recent data from an experimental blinded review utilizing a direct measure of expertise has found that closer intellectual distances between applicant and reviewer lead to harsher evaluations, possibly suggesting that information is differentially sampled across subject-matter expertise levels and across information type (e.g. strengths or weaknesses). However, social and professional networks have been suggested to play a role in reviewer scoring. In an effort to test whether this result can be replicated in a real-world unblinded study utilizing self-assessed reviewer expertise, we conducted a retrospective multi-level regression analysis of 1,450 individual unblinded evaluations of 725 biomedical research funding applications by 1,044 reviewers. Despite the large variability in the scoring data, the results are largely confirmatory of work from blinded reviews, by which a linear relationship between reviewer expertise and their evaluations was observed—reviewers with higher levels of self-assessed expertise tended to be harsher in their evaluations. However, we also found that reviewer and applicant seniority could influence this relationship, suggesting social networks could have subtle influences on reviewer scoring. Overall, these results highlight the need to explore how reviewers utilize their expertise to gather and weight information from the application in making their evaluations. PMID:27768760
Gallo, Stephen A; Sullivan, Joanne H; Glisson, Scott R
Although the scientific peer review process is crucial to distributing research investments, little has been reported about the decision-making processes used by reviewers. One key attribute likely to be important for decision-making is reviewer expertise. Recent data from an experimental blinded review utilizing a direct measure of expertise has found that closer intellectual distances between applicant and reviewer lead to harsher evaluations, possibly suggesting that information is differentially sampled across subject-matter expertise levels and across information type (e.g. strengths or weaknesses). However, social and professional networks have been suggested to play a role in reviewer scoring. In an effort to test whether this result can be replicated in a real-world unblinded study utilizing self-assessed reviewer expertise, we conducted a retrospective multi-level regression analysis of 1,450 individual unblinded evaluations of 725 biomedical research funding applications by 1,044 reviewers. Despite the large variability in the scoring data, the results are largely confirmatory of work from blinded reviews, by which a linear relationship between reviewer expertise and their evaluations was observed-reviewers with higher levels of self-assessed expertise tended to be harsher in their evaluations. However, we also found that reviewer and applicant seniority could influence this relationship, suggesting social networks could have subtle influences on reviewer scoring. Overall, these results highlight the need to explore how reviewers utilize their expertise to gather and weight information from the application in making their evaluations.
Utah State Univ., Logan. Dept. of Psychology.
In June 1989, the Utah State Office of Education contracted with the Research and Evaluation Methodology Program at Utah State University to conduct a statewide evaluation of Utah's Productivity Projects Studies Program. This executive summary of the results of the evaluation contains: (1) a description of the program; (2) an overview of the…
Alcorn, Ted E.; Opryszko, Melissa C.; Schwab, Kellogg J.
The accessibility of potable water is fundamental to public health. A private for-profit company is installing kiosk-based drinking-water systems in rural and peri-urban villages in Ghana, and we evaluated their performance. Preceding an observational study to measure the effect of these kiosks on the incidence of water-related disease in recipient communities, we conducted ethnographic research to assess local water-related practices and the ways these practices would affect adoption of the new technology. We conducted fieldwork in two communities in Ghana and interviewed stakeholders throughout the water sector. Our findings illustrate the complexity of water-related behaviors and indicate several factors that may sustain disease transmission despite the presence of the new technology. This formative ethnographic research also improved the precision of our subsequent evaluation of the intervention by providing a site-specific, culturally-appropriate knowledge base. This study demonstrates the value of incorporating qualitative research techniques into evaluations of water-related projects. PMID:21540392
Sung, Lillian; Rego, Eduardo; Riva, Eloisa; Elwood, Jessica; Basso, Joe; Clayton, Charles P; Mikhael, Joseph
The objectives of the study were to describe the development of a patient-oriented clinical research training program in a low- or middle-income country (LMIC) setting, to describe perceived benefits of the program and barriers to application, and to make recommendations for future training programs. The program was developed by the American Society of Hematology in collaboration with Latin American stakeholders and clinical researchers. Session types were didactic, small group, and one-on-one faculty/participant dyad formats. Outcomes were assessed by quantitative surveys of trainees and qualitative feedback from both trainees and faculty members. The program is an annual 2-day course specifically for Latin American hematologists. Through course evaluations, all trainees described that the didactic sessions were relevant. All session types were useful for gaining knowledge and skills, particularly one-on-one meetings. The potential for networking was highly valued. Barriers to trainee applications were the concerns that skill level, proposed research program, and knowledge of English were not sufficiently strong to warrant acceptance into the course, and financial costs of attendance. We have described the development and initial evaluation of a clinical research training program in a LMIC setting. We learned several valuable lessons that are applicable to other research training programs.
Amaral, A.; Percy, J. R.
We describe and evaluate a summer undergraduate research project and experience by one of us (AA), under the supervision of the other (JP). The aim of the project was to sample current approaches to analyzing variable star data, and topics related to the study of Mira variable stars and their astrophysical importance. This project was done through the Summer Undergraduate Research Program (SURP) in astronomy at the University of Toronto. SURP allowed undergraduate students to explore and learn about many topics within astronomy and astrophysics, from instrumentation to cosmology. SURP introduced students to key skills which are essential for students hoping to pursue graduate studies in any scientific field. Variable stars proved to be an excellent topic for a research project. For beginners to independent research, it introduces key concepts in research such as critical thinking and problem solving, while illuminating previously learned topics in stellar physics. The focus of this summer project was to compare observations with structural and evolutionary models, including modelling the random walk behavior exhibited in the (O-C) diagrams of most Mira stars. We found that the random walk could be modelled by using random fluctuations of the period. This explanation agreed well with observations.
Knight, Norman F., Jr.
Computational mechanics is that discipline of applied science and engineering devoted to the study of physical phenomena by means of computational methods based on mathematical modeling and simulation, utilizing digital computers. The discipline combines theoretical and applied mechanics, approximation theory, numerical analysis, and computer science. Computational mechanics has had a major impact on engineering analysis and design. When applied to structural mechanics, the discipline is referred to herein as computational structural mechanics. Complex structures being considered by NASA for the 1990's include composite primary aircraft structures and the space station. These structures will be much more difficult to analyze than today's structures and necessitate a major upgrade in computerized structural analysis technology. NASA has initiated a research activity in structural analysis called Computational Structural Mechanics (CSM). The broad objective of the CSM activity is to develop advanced structural analysis technology that will exploit modern and emerging computers, such as those with vector and/or parallel processing capabilities. Here, the current research directions for the Methods and Application Studies Team of the Langley CSM activity are described.
McAnany, Emile G.; And Others
The evaluation of instructional television (ITV) is a new field with evaluation methods largely borrowed from other disciplines. The evaluator is not apt to be trained specifically in this area but will learn "on the job" while defining his role for those with whom he works. The evaluator should consider the following recommendations: (1)…
Webb, Norman L.
This paper describes the Study of Systemic Reform in Milwaukee Public Schools (MPS), an embedded research project that crossed the lines between objectivity and subjectivity, technical assistance and evaluation, and qualitative and quantitative research. The project created a collaboration between researchers at the Wisconsin Center for Education…
Mehta, Pranjal H; Gosling, Samuel D
This article evaluates a comparative approach to personality and health research. We (1) review evidence showing that personality exists and can be measured in animals, (2) illustrate the benefits of animal studies for human personality research, (3) illustrate the benefits of human studies for animal personality research, and (4) provide guidelines for making cross-species comparisons. We conclude that a comparative approach can provide unique insights into personality psychology, especially into research on personality, immunity, and health.
..., subpart E and part 923, subpart L. Evaluation of a National Estuarine Research Reserve requires findings...:30 p.m. at the Rookery Bay National Estuarine Research Reserve Environmental Learning Center,...
... DEVELOPMENT PROTECTION OF HUMAN SUBJECTS § 225.123 Early termination of research support: Evaluation of... the protection of the rights and welfare of human subjects (whether or not the research was subject...
Background Bottom-up, clinician-conceived and directed clinical intervention research, coupled with collaboration from researcher experts, is conceptually endorsed by the participatory research movement. This report presents the findings of an evaluation of a program in the Veterans Health Administration meant to encourage clinician-driven research by providing resources believed to be critical. The evaluation focused on the extent to which funded projects: maintained integrity to their original proposals; were methodologically rigorous; were characterized by collaboration between partners; and resulted in sustained clinical impact. Methods Researchers used quantitative (survey and archival) and qualitative (focus group) data to evaluate the implementation, evaluation, and sustainability of four clinical demonstration projects at four sites. Fourteen research center mentors and seventeen clinician researchers evaluated the level of collaboration using a six-dimensional model of participatory research. Results Results yielded mixed findings. Qualitative and quantitative data suggested that although the process was collaborative, clinicians' prior research experience was critical to the quality of the projects. Several challenges were common across sites, including subject recruitment, administrative support and logistics, and subsequent dissemination. Only one intervention achieved lasting clinical effect beyond the active project period. Qualitative analyses identified barriers and facilitators and suggested areas to improve sustainability. Conclusions Evaluation results suggest that this participatory research venture was successful in achieving clinician-directed collaboration, but did not produce sustainable interventions due to such implementation problems as lack of resources and administrative support. PMID:20946658
Duffy, Barbara Poitras
The use of focus groups by the Federal Bureau of Investigation as a tool of internal evaluation is described. Focus groups are used in an environment where credibility is key to achieving meaningful cooperation. Issues for consideration by other evaluators interested in the approach are summarized. (SLD)
National Institute for Excellence in Teaching, 2010
Teachers are the most important school-related factor for student achievement gains, but evaluation of teacher performance is seldom conducted in any rigorous way. As policymakers call for a better approach to teacher evaluation, the 10-year history of TAP[TM]: The System for Teacher and Student Advancement provides an example of an integrated…
Deguo, Zhao; Yanhou, Cai; Yongjun, Feng; Lingfeng, Wang
Since 2002, the University Evaluation Task Force of China University Alumni Association Network (CUAA), "University Weekly" and "21st Century Talent Report" have made joint efforts in the evaluation of higher education institutions in China. Compared with the ranking in 2007, China's University Ranking in the 2008 report is…
Miller, Happy Lee
Research has shown that few educational reform efforts have achieved significant, long-lasting improvement in student achievement. In order to accelerate growth in student achievement, many researchers have advocated the development of cultures of evaluative inquiry. In a culture of evaluative inquiry, teachers use data to identify instructional…
Holosko, Michael J.
This article addresses a void in the literature about social work research and evaluation (R&E) designs, in particular related to the quality of its published work. Data were collected by reviewing three empirically oriented journals, "Research on Social Work Practice", "Journal of Social Service Research", and "Social Work Research" over three…
Background This study examines research knowledge infrastructures (RKIs) found in health systems. An RKI is defined as any instrument (i.e., programs, interventions, tools) implemented in order to facilitate access, dissemination, exchange, and/or use of evidence in healthcare organisations. Based on an environmental scan (17 key informant interviews) and scoping review (26 studies), we found support for a framework that we developed that outlines components that a health system can have in its RKI. The broad domains are climate for research use, research production, activities used to link research to action, and evaluation. The objective of the current study is to profile the RKI of three types of health system organisations--regional health authorities, primary care practices, and hospitals--in two Canadian provinces to determine the current mix of components these organisations have in their RKI, their experience with these components, and their views about future RKI initiatives. Methods This study will include semistructured telephone interviews with a purposive sample region of a senior management team member, library/resource centre manager, and a 'knowledge broker' in three regional health authorities, five or six purposively sampled hospitals, and five or six primary care practices in Ontario and Quebec, for a maximum of 71 interviewees. The interviews will explore (a) which RKI components have proven helpful, (b) barriers and facilitators in implementing RKI components, and (c) views about next steps in further development of RKIs. Discussion This is the first qualitative examination of potential RKI efforts that can increase the use of research evidence in health system decision making. We anticipate being able to identify broadly applicable insights about important next steps in building effective RKIs. Some of the identified RKI components may increase the use of research evidence by decision makers, which may then lead to more informed decisions
The proceedings of the 1995 Symposium on Bioremediation of Hazardous Wastes, hosted by the Office of Research and Development (ORD) of the EPA in Rye Brook, New York. he symposium was the eighth annual meeting for the presentation of research conducted by EPA's Biosystems Technol...
Pollard, William E.; And Others
The role of documentation in the planning and control functions of project management is reviewed. The importance of documentation in the assessment of research quality with respect to objectivity, validity, and replicability is discussed. An outline of documentation required in different phases of research projects is provided. (Author/DWH)
Shaner, A. J.; Shupla, C.; Shipp, S.; Allen, J.; Kring, D. A.
The Center for Lunar Science and Exploration (CLSE), a collaboration between the Lunar and Planetary Institute and NASA s Johnson Space Center, is one of seven member teams of the NASA Lunar Science Institute (NLSI). In addition to research and exploration activities, the CLSE team is deeply invested in education and outreach. In support of NASA s and NLSI s objective to train the next generation of scientists, CLSE s High School Lunar Research Projects program is a conduit through which high school students can actively participate in lunar science and learn about pathways into scientific careers. The objectives of the program are to enhance 1) student views of the nature of science; 2) student attitudes toward science and science careers; and 3) student knowledge of lunar science. In its first three years, approximately 168 students and 28 teachers from across the United States have participated in the program. Before beginning their research, students undertake Moon 101, a guided-inquiry activity designed to familiarize them with lunar science and exploration. Following Moon 101, and guided by a lunar scientist mentor, teams choose a research topic, ask their own research question, and design their own research approach to direct their investigation. At the conclusion of their research, teams present their results to a panel of lunar scientists. This panel selects four posters to be presented at the annual Lunar Science Forum held at NASA Ames. The top scoring team travels to the forum to present their research in person.
Trainor, Audrey A.; Graue, Elizabeth
Despite previous and successful attempts to outline general criteria for rigor, researchers in special education have debated the application of rigor criteria, the significance or importance of small n research, the purpose of interpretivist approaches, and the generalizability of qualitative empirical results. Adding to these complications, the…
Allen, Judy; Flack, Felicity
Health promotion research, quality improvement and evaluation are all activities that raise ethical issues. In this paper, the Chair and a member of human resear ch ethics committees provide an insiders' point of view on how to demonstrate ethical conduct in health promotion research and quality improvement. Several common issues raised by health promotion research and evaluation are discussed including researcher integrity, conflicts of interest, use of information, consent and privacy.
Seshadrinathan, Kalpana; Soundararajan, Rajiv; Bovik, Alan C.; Cormack, Lawrence K.
Automatic methods to evaluate the perceptual quality of a digital video sequence have widespread applications wherever the end-user is a human. Several objective video quality assessment (VQA) algorithms exist, whose performance is typically evaluated using the results of a subjective study performed by the video quality experts group (VQEG) in 2000. There is a great need for a free, publicly available subjective study of video quality that embodies state-of-the-art in video processing technology and that is effective in challenging and benchmarking objective VQA algorithms. In this paper, we present a study and a resulting database, known as the LIVE Video Quality Database, where 150 distorted video sequences obtained from 10 different source video content were subjectively evaluated by 38 human observers. Our study includes videos that have been compressed by MPEG-2 and H.264, as well as videos obtained by simulated transmission of H.264 compressed streams through error prone IP and wireless networks. The subjective evaluation was performed using a single stimulus paradigm with hidden reference removal, where the observers were asked to provide their opinion of video quality on a continuous scale. We also present the performance of several freely available objective, full reference (FR) VQA algorithms on the LIVE Video Quality Database. The recent MOtion-based Video Integrity Evaluation (MOVIE) index emerges as the leading objective VQA algorithm in our study, while the performance of the Video Quality Metric (VQM) and the Multi-Scale Structural SIMilarity (MS-SSIM) index is noteworthy. The LIVE Video Quality Database is freely available for download1 and we hope that our study provides researchers with a valuable tool to benchmark and improve the performance of objective VQA algorithms.
Marjanovic, Sonja; Cochrane, Gavin; Manville, Catriona; Harte, Emma; Chataway, Joanna; Jones, Molly Morgan
In early 2012, the National Institute for Health Research (NIHR) leadership programme was re-commissioned for a further three years following an evaluation by RAND Europe. During this new phase of the programme, we conducted a real-time evaluation, the aim of which was to allow for reflection on and adjustment of the programme on an on-going basis as events unfold. This approach also allowed for participants on the programme to contribute to and positively engage in the evaluation. The study aimed to understand the outputs and impacts from the programme, and to test the underlying assumptions behind the NIHR Leadership Programme as a science policy intervention. Evidence on outputs and impacts of the programme were collected around the motivations and expectations of participants, programme design and individual-, institutional- and system-level impacts.
Garrigan, Charles; Han, Jennifer; Tolomeo, Pam; Johnson, Katherine J; Master, Stephen R; Lautenbach, Ebbing; Nachamkin, Irving
Research use only (RUO) assays do not undergo a validation process similar to test kits used for clinical purposes. Several studies have suggested that RUO assays need to be validated prior to use in any research studies. We evaluated a research use only Luminex platform based assay for measuring serum procalcitonin levels (Bio-Plex ProTM Human Acute Phase Multiplex Assay, Bio-Rad Laboratories, Hercules, CA) for comparability with an FDA cleared assay for procalcitonin (VIDAS B.R.A.H.M.S. PCT Assay, bioMérieux, Durham, NC). We tested 1,072 serum samples collected from patients with suspected sepsis in an intensive care unit setting for the comparison. There was poor correlation of the luminex based assay (r=0.081) with the VIDAS PCT Assay in the clinically relevant measurement range (<10 ng/mL). Additionally the Bio-Plex assay showed poor precision. Mass-spectrometry analysis of material eluted from PCT beads did not reveal any identifiable procalcitonin. The results show that research use only assays need to be validated to determine their suitability for research studies. PMID:27830020
Romig, Barbara; Kosmo, Joseph; Gernhardt, Michael; Abercromby, Andrew
During the last two weeks of October 2008, the National Aeronautics and Space Administration (NASA) Johnson Space Center (JSC) Advanced Extravehicular Activity (AEVA) team led the field test portion of the 2008 Desert Research and Technology Studies (D-RATS) near Flagstaff, AZ. The Desert RATS field test activity is the year-long culmination of various individual science and advanced engineering discipline areas technology and operations development efforts into a coordinated field test demonstration under representative (analog) planetary surface terrain conditions. The 2008 Desert RATS was the eleventh RATS field test and was the most focused and successful test to date with participants from six NASA field centers, three research organizations, one university, and one other government agency. The main test objective was to collect Unpressurized Rover (UPR) and Lunar Electric Rover (LER) engineering performance and human factors metrics while under extended periods of representative mission-based scenario test operations involving long drive distances, night-time driving, Extravehicular Activity (EVA) operations, and overnight campover periods. The test was extremely successful with all teams meeting the primary test objective. This paper summarizes Desert RATS 2008 test hardware, detailed test objectives, test operations, and test results.
Sarathi, P.S.; Olsen, D.K.; Mahmood, S.M.; Ramzel, E.B.
The Thermal Oil Production Research Group at NIPER has conducted research on behalf of the US Department of Energy on thermal methods of oil production (steam and for 1 year, in situ combustion) since 1983. Research projects performed by this group have attempted to adapt to the needs and direction of the DOE`s oil research program and that of industry. This report summarizes the research that has been conducted, analyses the contributions of the research, describes how the technology was transferred to potential users, analyzes current trends in thermal research and thermal oil production, and makes suggestions for future research where NIPER could contribute to advances in thermal oil production.
Background The English National Health Service has made a major investment in nine partnerships between higher education institutions and local health services called Collaborations for Leadership in Applied Health Research and Care (CLAHRC). They have been funded to increase capacity and capability to produce and implement research through sustained interactions between academics and health services. CLAHRCs provide a natural 'test bed' for exploring questions about research implementation within a partnership model of delivery. This protocol describes an externally funded evaluation that focuses on implementation mechanisms and processes within three CLAHRCs. It seeks to uncover what works, for whom, how, and in what circumstances. Design and methods This study is a longitudinal three-phase, multi-method realistic evaluation, which deliberately aims to explore the boundaries around knowledge use in context. The evaluation funder wishes to see it conducted for the process of learning, not for judging performance. The study is underpinned by a conceptual framework that combines the Promoting Action on Research Implementation in Health Services and Knowledge to Action frameworks to reflect the complexities of implementation. Three participating CLARHCS will provide in-depth comparative case studies of research implementation using multiple data collection methods including interviews, observation, documents, and publicly available data to test and refine hypotheses over four rounds of data collection. We will test the wider applicability of emerging findings with a wider community using an interpretative forum. Discussion The idea that collaboration between academics and services might lead to more applicable health research that is actually used in practice is theoretically and intuitively appealing; however the evidence for it is limited. Our evaluation is designed to capture the processes and impacts of collaborative approaches for implementing research, and
Campbell, Anne; McNamara, Olwen; Furlong, John; Lewis, Sarah F.; Howson, John
This article reviews the processes, issues and dilemmas involved in evaluation research undertaken in the context of changing and evolving government policy in education. The article is grounded in an evaluation of the National Partnership Project (NPP), the team conducted on behalf of England's Teacher Training Agency (TTA) in 2004-2005. It will…
Deverka, Patricia A; Lavallee, Danielle C; Desai, Priyanka J; Armstrong, Joanne; Gorman, Mark; Hole-Curry, Leah; O’Leary, James; Ruffner, BW; Watkins, John; Veenstra, David L; Baker, Laurence H; Unger, Joseph M; Ramsey, Scott D
Aims The Center for Comparative Effectiveness Research in Cancer Genomics completed a 2-year stakeholder-guided process for the prioritization of genomic tests for comparative effectiveness research studies. We sought to evaluate the effectiveness of engagement procedures in achieving project goals and to identify opportunities for future improvements. Materials & methods The evaluation included an online questionnaire, one-on-one telephone interviews and facilitated discussion. Responses to the online questionnaire were tabulated for descriptive purposes, while transcripts from key informant interviews were analyzed using a directed content analysis approach. Results A total of 11 out of 13 stakeholders completed both the online questionnaire and interview process, while nine participated in the facilitated discussion. Eighty-nine percent of questionnaire items received overall ratings of agree or strongly agree; 11% of responses were rated as neutral with the exception of a single rating of disagreement with an item regarding the clarity of how stakeholder input was incorporated into project decisions. Recommendations for future improvement included developing standard recruitment practices, role descriptions and processes for improved communication with clinical and comparative effectiveness research investigators. Conclusions Evaluation of the stakeholder engagement process provided constructive feedback for future improvements and should be routinely conducted to ensure maximal effectiveness of stakeholder involvement. PMID:23459832