Performance-Based Assessment Resource Guide.

ERIC Educational Resources Information Center

Gilbert, Judith C.; Burger, Patricia

This resource guide reviews a variety of performance-based student assessment strategies, and provides examples of, and references for, the strategies. Strategies include anecdotal records, interviews, peer report and group evaluations, and portfolios. Materials in the guide include: (1) a resource guide update form for teachers; (2) department…

Calibrated peer review assignments for the earth sciences

USGS Publications Warehouse

Rudd, J.A.; Wang, V.Z.; Cervato, C.; Ridky, R.W.

2009-01-01

Calibrated Peer Review ??? (CPR), a web-based instructional tool developed as part of the National Science Foundation reform initiatives in undergraduate science education, allows instructors to incorporate multiple writing assignments in large courses without overwhelming the instructor. This study reports successful implementation of CPR in a large, introductory geology course and student learning of geoscience content. For each CPR assignment in this study, students studied web-based and paper resources, wrote an essay, and reviewed seven essays (three from the instructor, three from peers, and their own) on the topic. Although many students expressed negative attitudes and concerns, particularly about the peer review process of this innovative instructional approach, they also recognized the learning potential of completing CPR assignments. Comparing instruction on earthquakes and plate boundaries using a CPR assignment vs. an instructional video lecture and homework essay with extensive instructor feedback, students mastered more content via CPR instruction.

Project MERLOT: Bringing Peer Review to Web-Based Educational Resources

ERIC Educational Resources Information Center

Cafolla, Ralph

2006-01-01

The unprecedented growth of the World Wide Web has resulted in a profusion of educational resources. The challenge for faculty is finding these resources and integrating them into their instruction. Even after the resource is found, the instructor must assess the effectiveness of the resource. As the number of educational web sites mount into the…

The peer review gap: A longitudinal case study of gendered publishing and occupational patterns in a female-rich discipline, Western North America (1974-2016).

PubMed

Tushingham, Shannon; Fulkerson, Tiffany; Hill, Katheryn

2017-01-01

Researchers have repeatedly demonstrated that women continue to be underrepresented in publication output in the sciences. This is true even in female-rich fields such as archaeology. Since most gender-related publication studies rely on data from peer-reviewed journals, it would be instructive, though challenging, to also track publication output in non-refereed and professional or industry venues, which tend to be more accessible to those working in extra-academic settings. This comparison is important in fields such as archaeology in which the vast majority (approximately 90%) of practitioners in the USA work for private sector cultural resource management firms and federal and state agencies. To understand the dynamics of who publishes where, we compiled a new dataset tracking over 40 years of peer-reviewed versus non-peer-reviewed publications that publish articles on the archaeology of California (an American Indian cultural area including southwest Oregon, most of the state of California, and Baja Mexico) and the Great Basin culture area (spanning eight western USA states). Historic gender differences in the publishing output of authors identified as men versus those identified as women were revealed by articles published between 1974 and 2016 in two refereed journals, the Journal of California Anthropology/ Journal of California and Great Basin Anthropology and California Archaeology, and in one un-refereed venue, the Society for California Archaeology Proceedings. Although multiple independent measures indicate that women are contributing and active members of the discipline, publishing records yield more variable results. Specifically, while women have historic and increasingly robust levels of participation in the non-peer-reviewed Proceedings, they remain vastly underrepresented in the two peer-reviewed journals, which are widely regarded as more prestigious and influential. We argue that this "peer review gap" is influenced by variation in the costs (largely time investment) and benefits of publication for people working in different professional roles (e.g., agency professionals, private/cultural resource management firm personnel, tenure-track faculty, adjunct faculty, etc.). We also argue that these cost and benefit variations may ultimately influence the decisions of people of all genders and backgrounds, but, because of the current structure of our discipline-including the fact that women and minorities lag in positions where costly peer-reviewed publication is a rewarded and supported activity-overwhelmingly affect these groups. We recognize that non-refereed publications such as Proceedings provide an important means of bridging the peer review gap and give voice to individuals from diverse backgrounds and perspectives.

The peer review gap: A longitudinal case study of gendered publishing and occupational patterns in a female-rich discipline, Western North America (1974–2016)

PubMed Central

Fulkerson, Tiffany; Hill, Katheryn

2017-01-01

Researchers have repeatedly demonstrated that women continue to be underrepresented in publication output in the sciences. This is true even in female-rich fields such as archaeology. Since most gender-related publication studies rely on data from peer-reviewed journals, it would be instructive, though challenging, to also track publication output in non-refereed and professional or industry venues, which tend to be more accessible to those working in extra-academic settings. This comparison is important in fields such as archaeology in which the vast majority (approximately 90%) of practitioners in the USA work for private sector cultural resource management firms and federal and state agencies. To understand the dynamics of who publishes where, we compiled a new dataset tracking over 40 years of peer-reviewed versus non-peer-reviewed publications that publish articles on the archaeology of California (an American Indian cultural area including southwest Oregon, most of the state of California, and Baja Mexico) and the Great Basin culture area (spanning eight western USA states). Historic gender differences in the publishing output of authors identified as men versus those identified as women were revealed by articles published between 1974 and 2016 in two refereed journals, the Journal of California Anthropology/ Journal of California and Great Basin Anthropology and California Archaeology, and in one un-refereed venue, the Society for California Archaeology Proceedings. Although multiple independent measures indicate that women are contributing and active members of the discipline, publishing records yield more variable results. Specifically, while women have historic and increasingly robust levels of participation in the non-peer-reviewed Proceedings, they remain vastly underrepresented in the two peer-reviewed journals, which are widely regarded as more prestigious and influential. We argue that this “peer review gap” is influenced by variation in the costs (largely time investment) and benefits of publication for people working in different professional roles (e.g., agency professionals, private/cultural resource management firm personnel, tenure-track faculty, adjunct faculty, etc.). We also argue that these cost and benefit variations may ultimately influence the decisions of people of all genders and backgrounds, but, because of the current structure of our discipline—including the fact that women and minorities lag in positions where costly peer-reviewed publication is a rewarded and supported activity—overwhelmingly affect these groups. We recognize that non-refereed publications such as Proceedings provide an important means of bridging the peer review gap and give voice to individuals from diverse backgrounds and perspectives. PMID:29186153

A Study of Technical Engineering Peer Reviews at NASA

NASA Technical Reports Server (NTRS)

Chao, Lawrence P.; Tumer, Irem Y.; Bell, David G.

2003-01-01

This report describes the state of practices of design reviews at NASA and research into what can be done to improve peer review practices. There are many types of reviews at NASA: required and not, formalized and informal, programmatic and technical. Standing project formal reviews such as the Preliminary Design Review and Critical Design Review are a required part of every project and mission development. However, the technical, engineering peer reviews that support teams' work on such projects are informal, some times ad hoc, and inconsistent across the organization. The goal of this work is to identify best practices and lessons learned from NASA's experience, supported by academic research and methodologies to ultimately improve the process. This research has determined that the organization, composition, scope, and approach of the reviews impact their success. Failure Modes and Effects Analysis (FMEA) can identify key areas of concern before or in the reviews. Product definition tools like the Project Priority Matrix, engineering-focused Customer Value Chain Analysis (CVCA), and project or system-based Quality Function Deployment (QFD) help prioritize resources in reviews. The use of information technology and structured design methodologies can strengthen the engineering peer review process to help NASA work towards error-proofing the design process.

The Effectiveness of Peer-Delivered Services in the Management of Mental Health Conditions: A Meta-Analysis of Studies from Low- and Middle-Income Countries

ERIC Educational Resources Information Center

Vally, Zahir; Abrahams, Lameze

2016-01-01

It has been suggested that peers, or lay persons, should be more readily utilized in the provision of some mental health services, particularly in poor contexts where limited resources invariably result in many clients not receiving suitable and timely services. A systematic review and meta-analysis was conducted of all studies where peers were…

The Use of MERLOT in Biochemistry and Molecular Biology Education

ERIC Educational Resources Information Center

Cooper, Scott

2005-01-01

The referatory, Multimedia Educational Resources for Learning and Online Teaching (MERLOT), contains links to 1300 electronic teaching resources in biology and chemistry. Approximately 20% have been peer reviewed, and most have user comments or assignments attached. In addition to being a source of educational resources, the MERLOT project seeks…

Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature

DOE Office of Scientific and Technical Information (OSTI.GOV)

Brunskill, Kelsey; Nguyen, Timothy K.; Boldt, R. Gabriel

Purpose: Peer review is a recommended component of quality assurance in radiation oncology; however, it is resource-intensive and its effect on patient care is not well understood. We conducted a systematic review of the published data to assess the reported clinical impact of peer review on radiation treatment plans. Methods and Materials: A systematic review of published English studies was performed in accordance with the PRISMA guidelines using the MEDLINE and EMBASE databases and abstracts published from major radiation oncology scientific meeting proceedings. For inclusion, the studies were required to report the effect of peer review on ≥1 element ofmore » treatment planning (eg, target volume or organ-at-risk delineation, dose prescription or dosimetry). Results: The initial search strategy identified 882 potentially eligible studies, with 11 meeting the inclusion criteria for full-text review and final analysis. Across a total of 11,491 patient cases, peer review programs led to modifications in a weighted mean of 10.8% of radiation treatment plans. Five studies differentiated between major and minor changes and reported weighted mean rates of change of 1.8% and 7.3%, respectively. The most common changes were related to target volume delineation (45.2% of changed plans), dose prescription or written directives (24.4%), and non-target volume delineation or normal tissue sparing (7.5%). Conclusions: Our findings suggest that peer review leads to changes in clinical care in approximately 1 of every 9 cases overall. This is similar to the reported rates of change in peer review studies from other oncology-related specialties, such as radiology and pathology.« less

Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature.

PubMed

Brunskill, Kelsey; Nguyen, Timothy K; Boldt, R Gabriel; Louie, Alexander V; Warner, Andrew; Marks, Lawrence B; Palma, David A

2017-01-01

Peer review is a recommended component of quality assurance in radiation oncology; however, it is resource-intensive and its effect on patient care is not well understood. We conducted a systematic review of the published data to assess the reported clinical impact of peer review on radiation treatment plans. A systematic review of published English studies was performed in accordance with the PRISMA guidelines using the MEDLINE and EMBASE databases and abstracts published from major radiation oncology scientific meeting proceedings. For inclusion, the studies were required to report the effect of peer review on ≥1 element of treatment planning (eg, target volume or organ-at-risk delineation, dose prescription or dosimetry). The initial search strategy identified 882 potentially eligible studies, with 11 meeting the inclusion criteria for full-text review and final analysis. Across a total of 11,491 patient cases, peer review programs led to modifications in a weighted mean of 10.8% of radiation treatment plans. Five studies differentiated between major and minor changes and reported weighted mean rates of change of 1.8% and 7.3%, respectively. The most common changes were related to target volume delineation (45.2% of changed plans), dose prescription or written directives (24.4%), and non-target volume delineation or normal tissue sparing (7.5%). Our findings suggest that peer review leads to changes in clinical care in approximately 1 of every 9 cases overall. This is similar to the reported rates of change in peer review studies from other oncology-related specialties, such as radiology and pathology. Copyright © 2016 Elsevier Inc. All rights reserved.

A randomized trial of peer review: the UK National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project: three-year evaluation.

PubMed

Roberts, Christopher M; Stone, Robert A; Buckingham, Rhona J; Pursey, Nancy A; Lowe, Derek; Potter, Jonathan M

2012-06-01

Peer review has been widely used within the National Health Service to facilitate health quality improvement but evaluation has been limited particularly over the longer-term. Change within the National Health Service (NHS) can take a prolonged period--1-2 years--to occur. We report here a 3-year evaluation of the largest randomized trial of peer review ever conducted in the UK. To evaluate whether targeted mutual peer review of respiratory units brings about improvements in services for chronic obstructive pulmonary disease (COPD) over 3 years. The peer review intervention was a reciprocal supportive exercise that included clinicians, hospital management, commissioners and patients, which focused on the quality of the provision of four specific evidence-based aspects of COPD care. Follow-up at 36 months demonstrated limited significant quantitative differences in the quality of services offered in the two groups but a strong trend in favour of intervention sites. Qualitative data suggested many benefits of peer review in most but not all intervention units and some control teams. The data identify factors that promote and obstruct change. The findings demonstrate significant change in service provision over 3 years in both control and intervention sites with great variability in both groups. The combined quantitative and qualitative findings indicate that targeted mutual peer review is associated with improved quality of care, improvements in service delivery and with changes within departments that promote and are precursors to quality improvement. The generic findings of this study have potential implications for the application of peer review throughout the NHS. © 2011 Blackwell Publishing Ltd.

Variability of Reviewers' Comments in the Peer Review Process for Orthopaedic Research.

PubMed

Iantorno, Stephanie E; Andras, Lindsay M; Skaggs, David L

2016-07-01

Retrospective analysis of peer review comments. To assess the likelihood that comments provided by peer reviewers of one orthopaedic journal would be similar to comments of reviewers from the same journal and a second journal. The consistency of the peer review process in orthopedic research has not been objectively examined. Nine separate clinical papers related to spinal deformity were submitted for publication in major peer-reviewed journals and initially rejected. The exact same manuscripts were then submitted to different journals. All papers were returned with comments from two to three reviewers from each journal. Reviews were divided into distinct conceptual criticisms that were regarded as separate comments. Comments were compared between reviewers of the same journal and to comments from reviewers of the second journal. When comparing comments from reviewers of the same journal, an average of 11% of comments were repeated (range 0% [0/12] to 23% [3/13]). On average, 20% of comments from the first journal were repeated by a reviewer at the second journal (range 10% [1/10] to 33% [6/18]). If a comment was made by two or more reviewers from the first journal, it had a higher likelihood (43% [6/14]) of being repeated by a reviewer from the second journal. When an identical manuscript is submitted to a second journal after being rejected, 80% of peer review comments from the first journal are not repeated by reviewers from the second journal. One may question if addressing every peer review comment in a rejected manuscript prior to resubmission is an efficient use of resources. Comments that appear twice or more in the first journal review are more likely to reappear and may warrant special attention from the researcher. Level IV. Copyright © 2016 Scoliosis Research Society. Published by Elsevier Inc. All rights reserved.

The use of free online educational resources by Canadian emergency medicine residents and program directors.

PubMed

Purdy, Eve; Thoma, Brent; Bednarczyk, Joseph; Migneault, David; Sherbino, Jonathan

2015-03-01

Introduction Online educational resources (OERs) are increasingly available for emergency medicine (EM) education. This study describes and compares the use of free OERs by the Royal College of Physicians and Surgeons of Canada (RCPSC) EM residents and program directors (PDs) and investigates the relationship between the use of OERs and peer-reviewed literature. A bilingual, online survey was distributed to RCPSC-EM residents and PDs using a modified Dillman method. The chi-square test and Fisher's exact test were used to compare the responses of residents and PDs. The survey was completed by 214/350 (61%) residents and 11/14 (79%) PDs. Free OERs were used by residents most frequently for general EM education (99.5%), procedural skills training (96%), and learning to interpret diagnostic tests (92%). OER modalities used most frequently included wikis (95%), file-sharing websites (95%), e-textbooks (94%), and podcasts (91%). Residents used wikis, podcasts, vodcasts, and file-sharing websites significantly more frequently than PDs. Relative to PDs, residents found entertainment value to be more important for choosing OERs (p<0.01). Some residents (23%) did not feel that literature references were important, whereas all PDs did. Both groups reported that OERs increased the amount of peer-reviewed literature (75% and 60%, respectively) that they read. EM residents make extensive use of OERs and differ from their PDs in the importance that they place on their entertainment value and incorporation of peer-reviewed references. OERs may increase the use of peer-reviewed literature in both groups. Given the prevalence of OER use for core educational goals among RCPSC-EM trainees, future efforts to facilitate critical appraisal and appropriate resource selection are warranted.

Characterization of the peer review network at the Center for Scientific Review, National Institutes of Health.

PubMed

Boyack, Kevin W; Chen, Mei-Ching; Chacko, George

2014-01-01

The National Institutes of Health (NIH) is the largest source of funding for biomedical research in the world. This funding is largely effected through a competitive grants process. Each year the Center for Scientific Review (CSR) at NIH manages the evaluation, by peer review, of more than 55,000 grant applications. A relevant management question is how this scientific evaluation system, supported by finite resources, could be continuously evaluated and improved for maximal benefit to the scientific community and the taxpaying public. Towards this purpose, we have created the first system-level description of peer review at CSR by applying text analysis, bibliometric, and graph visualization techniques to administrative records. We identify otherwise latent relationships across scientific clusters, which in turn suggest opportunities for structural reorganization of the system based on expert evaluation. Such studies support the creation of monitoring tools and provide transparency and knowledge to stakeholders.

In-Suit Light Exercise (ISLE) Prebreathe Protocol Peer Review Assessment. Volume 1

NASA Technical Reports Server (NTRS)

Brady, Timothy K.; Polk, James D.

2011-01-01

The performance of extravehicular activity (EVA) by National Aeronautics and Space Administration astronauts involves the risk of decompression sickness. This risk has been mitigated by the use of oxygen "prebreathe" to effectively wash out tissue nitrogen prior to each EVA. Now that the Space Shuttle Program (SSP) is being retired, high-pressure oxygen will become a limited resource. The In-Suit Light Exercise (ISLE) Prebreathe Protocol offers several potential benefits including its potential to save 6 pounds of oxygen per EVA. At the request of the NASA Engineering and Safety Center, the peer review convened on October 14, 2010. The major recommendation of the Review Committee was that the ISLE protocol was acceptable for operational use as a prebreathe option prior to EVA. The results from the peer review are contained in this document.

National Park Service Vegetation Mapping Inventory Program: Jean Lafitte National Historical Park and Preserve Vegetation Mapping Project

USGS Publications Warehouse

Hop, Kevin D.; Strassman, Andrew C.; Sattler, Stephanie; Pyne, Milo; Teague, Judy; White, Rickie; Ruhser, Janis; Hlavacek, Enrika; Dieck, Jennifer

2017-01-01

The National Park Service, Natural Resource Stewardship and Science office in Fort Collins, Colorado, publishes a range of reports that address natural resource topics. These reports are of interest and applicability to a broad audience in the National Park Service and others in natural resource management, including scientists, conservation and environmental constituencies, and the public. The Natural Resource Report Series is used to disseminate comprehensive information and analysis about natural resources and related topics concerning lands managed by the National Park Service. The series supports the advancement of science, informed decision-making, and the achievement of the National Park Service mission. The series also provides a forum for presenting lengthier results that may not be accepted by publications with page limitations. All manuscripts in the series receive the appropriate level of peer review to ensure that the information is scientifically credible, technically accurate, appropriately written for the intended audience, and designed and published in a professional manner. This report received formal peer review by subject-matter experts whose background and expertise put them on par technically and scientifically with the authors of the information. The peer review was led according to the Fundamental Science Practices of the U.S. Geological Survey. Views, statements, findings, conclusions, recommendations, and data in this report do not necessarily reflect views and policies of the National Park Service, U.S. Department of the Interior. Mention of trade names or commercial products does not constitute endorsement or recommendation for use by the U.S. Government. This report is available in digital format from the Gulf Coast Network website and the Natural Resource Publications Management website.

Status and trends of the nation's biological resources

USGS Publications Warehouse

Mac, Michael J.; Opler, Paul A.; Puckett Haecker, Catherine E.; Doran, Peter D.

1998-01-01

This report is a comprehensive summary of the status and trends of our nation’s biological resources. The report describes the major processes and factors affecting biological resources, and it treats regional status and trends. Authors of the chapters and boxes in this two-volume report were drawn from federal and state agencies, universities, and private organizations, reflecting the U.S. Geological Survey’s national partnership approach to providing comprehensive, reliable information about our biological resources. Following scientific tradition, each chapter and box was peer-reviewed by anonymous scientific reviewers.

There is no ``I'' in referee: Why referees should be anonymous

NASA Astrophysics Data System (ADS)

Ucko, Daniel

2015-03-01

From the early days of modern science, it has been recognized that scientific claims must be verified by someone who is not the maker of those claims, and who furthermore has no stake in the matter. In other words, claims need to be evaluated objectively, by the community. The way in which this tends to be done is by peer review conducted by journals. Peer review as currently practiced touches on the themes of trust, where the trust is in institutions and procedures that emerge from expert communities. The practice of peer review is viewed as a citizenly duty of scientists in the scientific community, because all scientists take turns serving either as authors, referees, and editors in the peer review process We lack the resources to have a work evaluated by the entire community, so we substitute with a representative. Yet, in most examples of scientific review, the referee or referees are anonymous. This question is particularly important when the peer review process is brought to bear in order to evaluate matters beyond scientific validity, more ``subjective'' criteria such as relative importance, broadness of interest - criteria that do not appear to have an objective standard of comparison and validation. I will show that the anonymity of referees, far from endangering this trust, actually strengthens it. I will show that this anonymity is crucial in order to maintain any objectivity in scientific peer review, and why authors should not try to unmask the referee. Also at American Physical Society (APS).

The gender gap in peer-reviewed publications by physical therapy faculty members: a productivity puzzle.

PubMed

Kaufman, Regina R; Chevan, Julia

2011-01-01

Studies of peer-reviewed article publication by faculty in higher education show men publish more than women. Part of the difference in publishing appears to be attributable directly to gender. Gender differences in publishing productivity have not been explored in physical therapy. The purpose of this study was to explore effects of gender on peer-reviewed publication productivity in physical therapy. This was a cross-sectional study using survey methods. A survey was administered to a random sample of 881 physical therapy faculty members; 459 responses were used for analysis. Men were more likely than women to be married, have children, hold a PhD degree, be tenured or on a tenure track, and hold the position of department chair. There was a significant difference in peer-reviewed publication rates between male and female respondents. Negative binomial regression models revealed that female gender was a negative predictor of peer-reviewed publication, accounting for between 0.51 and 0.58 fewer articles per year for women than for men over the course of a career. Reasons for the gender differences are not clear. Factors such as grant funding, laboratory resources, nature of collaborative relationships, values for different elements of the teaching/research/service triad, and ability to negotiate the academic culture were not captured by our model. The gender gap in peer-reviewed publishing productivity may have implications for individuals and the profession of physical therapy and should be subject to further exploration.

NCI Dictionary of Genetics Terms

Cancer.gov

A dictionary of more than 150 genetics-related terms written for healthcare professionals. This resource was developed to support the comprehensive, evidence-based, peer-reviewed PDQ cancer genetics information summaries.

An Integrative Review of In-Class Activities That Enable Active Learning in College Science Classroom Settings

ERIC Educational Resources Information Center

Arthurs, Leilani A.; Kreager, Bailey Zo

2017-01-01

Engaging students in active learning is linked to positive learning outcomes. This study aims to synthesise the peer-reviewed literature about "active learning" in college science classroom settings. Using the methodology of an integrative literature review, 337 articles archived in the Educational Resources Information Center (ERIC) are…

Open Access Scholarly Publications as OER

ERIC Educational Resources Information Center

Anderson, Terry

2013-01-01

This paper presents the rationale, common practices, challenges, and some personal anecdotes from a journal editor on the production, use, and re-use of peer-reviewed scholarly articles as open educational resources (OER). The scholarly and professional discourse related to open educational resources has largely focused on open learning objects,…

Integrated water resources management and infrastructure planning for water security in Southern Africa

NASA Astrophysics Data System (ADS)

Mapani, Benjamin; Magole, Lapologang; Makurira, Hodson; Meck, Maideyi; Mkandawire, Theresa; Mul, Marloes; Ngongondo, Cosmo

2017-08-01

This volume has brought together papers that are peer reviewed emanating from the WaterNet/WARFSA/GWP-SA 16th Symposium. The papers cover the following themes: Hydrology, Water and Environment, Water and Land, Water and Society, Water Supply and Sanitation and Water Resources Management.

Review of online educational resources for medical physicists.

PubMed

Prisciandaro, Joann I

2013-11-04

Medical physicists are often involved in the didactic training of graduate students, residents (both physics and physicians), and technologists. As part of continuing medical education, we are also involved in maintenance of certification projects to assist in the education of our peers. As such, it is imperative that we remain current concerning available educational resources. Medical physics journals offer book reviews, allowing us an opportunity to learn about newly published books in the field. A similar means of communication is not currently available for online educational resources. This information is conveyed through informal means. This review presents a summary of online resources available to the medical physics community that may be useful for educational purposes.

The DLESE Evaluation Toolkit Project

NASA Astrophysics Data System (ADS)

Buhr, S. M.; Barker, L. J.; Marlino, M.

2002-12-01

The Evaluation Toolkit and Community project is a new Digital Library for Earth System Education (DLESE) collection designed to raise awareness of project evaluation within the geoscience education community, and to enable principal investigators, teachers, and evaluators to implement project evaluation more readily. This new resource is grounded in the needs of geoscience educators, and will provide a virtual home for a geoscience education evaluation community. The goals of the project are to 1) provide a robust collection of evaluation resources useful for Earth systems educators, 2) establish a forum and community for evaluation dialogue within DLESE, and 3) disseminate the resources through the DLESE infrastructure and through professional society workshops and proceedings. Collaboration and expertise in education, geoscience and evaluation are necessary if we are to conduct the best possible geoscience education. The Toolkit allows users to engage in evaluation at whichever level best suits their needs, get more evaluation professional development if desired, and access the expertise of other segments of the community. To date, a test web site has been built and populated, initial community feedback from the DLESE and broader community is being garnered, and we have begun to heighten awareness of geoscience education evaluation within our community. The web site contains features that allow users to access professional development about evaluation, search and find evaluation resources, submit resources, find or offer evaluation services, sign up for upcoming workshops, take the user survey, and submit calendar items. The evaluation resource matrix currently contains resources that have met our initial review. The resources are currently organized by type; they will become searchable on multiple dimensions of project type, audience, objectives and evaluation resource type as efforts to develop a collection-specific search engine mature. The peer review criteria and process for ensuring that the site contains robust and useful resources has been drafted and received initial feedback from the project advisory board, which consists of members of every segment of the target audience. The review criteria are based upon DLESE peer review criteria, the MERLOT digital library peer review criteria, digital resource evaluation criteria, and evaluation best practices. In geoscience education, as in most endeavors, improvements are made by asking questions and acting upon information about successes and failures; project evaluation can be thought of as the systematic process of asking these questions and gathering the right information. The Evaluation Toolkit seeks to help principal investigators, teachers, and evaluators use the evaluation process to improve our projects and our field.

45 CFR 96.136 - Independent peer review.

Code of Federal Regulations, 2010 CFR

2010-10-01

... technology, resources, and patient/client circumstances, will meet accepted standards and practices which... approach to addictions treatment, and must be sensitive to the cultural and environmental issues that may...

Wikipedia vs peer-reviewed medical literature for information about the 10 most costly medical conditions.

PubMed

Hasty, Robert T; Garbalosa, Ryan C; Barbato, Vincenzo A; Valdes, Pedro J; Powers, David W; Hernandez, Emmanuel; John, Jones S; Suciu, Gabriel; Qureshi, Farheen; Popa-Radu, Matei; San Jose, Sergio; Drexler, Nathaniel; Patankar, Rohan; Paz, Jose R; King, Christopher W; Gerber, Hilary N; Valladares, Michael G; Somji, Alyaz A

2014-05-01

Since its launch in 2001, Wikipedia has become the most popular general reference site on the Internet and a popular source of health care information. To evaluate the accuracy of this resource, the authors compared Wikipedia articles on the most costly medical conditions with standard, evidence-based, peer-reviewed sources. The top 10 most costly conditions in terms of public and private expenditure in the United States were identified, and a Wikipedia article corresponding to each topic was chosen. In a blinded process, 2 randomly assigned investigators independently reviewed each article and identified all assertions (ie, implication or statement of fact) made in it. The reviewer then conducted a literature search to determine whether each assertion was supported by evidence. The assertions found by each reviewer were compared and analyzed to determine whether assertions made by Wikipedia for these conditions were supported by peer-reviewed sources. For commonly identified assertions, there was statistically significant discordance between 9 of the 10 selected Wikipedia articles (coronary artery disease, lung cancer, major depressive disorder, osteoarthritis, chronic obstructive pulmonary disease, hypertension, diabetes mellitus, back pain, and hyperlipidemia) and their corresponding peer-reviewed sources (P<.05) and for all assertions made by Wikipedia for these medical conditions (P<.05 for all 9). Most Wikipedia articles representing the 10 most costly medical conditions in the United States contain many errors when checked against standard peer-reviewed sources. Caution should be used when using Wikipedia to answer questions regarding patient care.

Peer tutoring programs in health professions schools.

PubMed

Santee, Jennifer; Garavalia, Linda

2006-06-15

Peer tutoring programs may be one method of maintaining quality of pharmacy education in the face of growing student enrollment and a small faculty body. A critical review of the literature was performed to ascertain whether peer tutoring programs improve or maintain the academic performance of health care professional students. Various electronic databases and abstracts from past American Association of Colleges of Pharmacy's annual meetings were searched to identify pertinent research. Only those articles with quantitative data, an experimental design, and comparative statistical analysis were included for review. Most studies found that peer tutoring had a positive impact on academic performance. These results may not be readily generalizable as there were numerous methodological flaws and limited descriptions of the programs and participants. Studies with better designs and more detail are needed to answer definitively whether peer tutoring is of benefit. Details of what resources were required should be included in the study to allow the reader to determine the feasibility of the intervention.

Peer Tutoring Programs in Health Professions Schools

PubMed Central

Garavalia, Linda

2006-01-01

Objective Peer tutoring programs may be one method of maintaining quality of pharmacy education in the face of growing student enrollment and a small faculty body. A critical review of the literature was performed to ascertain whether peer tutoring programs improve or maintain the academic performance of health care professional students. Methods Various electronic databases and abstracts from past American Association of Colleges of Pharmacy's annual meetings were searched to identify pertinent research. Only those articles with quantitative data, an experimental design, and comparative statistical analysis were included for review. Results Most studies found that peer tutoring had a positive impact on academic performance. These results may not be readily generalizable as there were numerous methodological flaws and limited descriptions of the programs and participants. Implications Studies with better designs and more detail are needed to answer definitively whether peer tutoring is of benefit. Details of what resources were required should be included in the study to allow the reader to determine the feasibility of the intervention. PMID:17136190

Tale of Two Databases: The History of Federally Funded Information Systems for Education and Medicine

ERIC Educational Resources Information Center

Weiner, Sharon A.

2009-01-01

Access to scholarly information in the disciplines of education and medicine occurred primarily through the simultaneous development of two bibliographic databases. The Education Resource Information Center (ERIC) originated as a resource designed to be comprehensive in its inclusion of peer-reviewed and unpublished literature for the entire…

Students as Teaching Resources; A Survey of Teaching Models Using Non-Professionals (Peer Tutoring).

ERIC Educational Resources Information Center

Klaus, David J.

This preliminary survey was designed to explore the possible use of students as teaching resources in the developing countries. In carrying out the survey, available literature was reviewed, visits made to selected ongoing projects in the United States, and interviews conducted overseas with indigenous educational researchers in Ghana, Sierra…

Children's Cooperative and Competitive Interactions in Limited Resource Situations: A Literature Review

ERIC Educational Resources Information Center

Green, Vanessa A.; Rechis, Ruth

2006-01-01

The ability to balance cooperative and competitive behaviors has important implications for a child's overall development. While socially competent children appear to learn highly successful strategies for entering peer groups and negotiating access to limited resources, the development of this level of social competence can be challenging for…

Perceptions of changes in practice following peer review in the National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project.

PubMed

Rivas, Carol; Taylor, Stephanie; Abbott, Stephen; Clarke, Aileen; Griffiths, Chris; Roberts, C Michael; Stone, Robert

2012-01-01

The purpose of this paper is to examine perceptions of local service change and concepts of change amongst participants in a UK nationwide randomised controlled trial of informal, structured, reciprocated, multidisciplinary peer review with feedback to promote quality improvement: the National Chronic Obstructive Pulmonary Disease Resources and Outcomes Project (NCROP). The paper takes the form of a qualitative study, involving semi-structured interviews with 43 hospital respiratory consultants, nurses and general managers at 24 intervention and 11 control NCROP sites. Thematic analysis resulted in adoption of Joss and Kogan's quality indicators as an analytic framework. The paper finds that peer review was associated with positive changes, which may lead to sustained service improvement. Differences existed in perceptions of change among clinicians and between clinicians and managers. "Generic changes" (e.g. changes in interpersonal relations or cultural changes), were often not perceived as change. The study highlights the significance of generic change in evaluations of change processes. Most participants were clinicians limiting inter-professional comparisons. Some clinical staff failed to recognise changes they accomplished or their significance, perceiving change differently to others within their professional group. These findings have implications for policy and research. They should be considered when developing frameworks for assessing quality improvements and staff engagement with change. This is the first qualitative study exploring participants' experience of peer review for quality improvement in healthcare. The study adds to previous research into UK health service improvement, which has had a more restricted focus on inter-professional differences.

The Scholarship of Teaching and Learning in Canadian Post-Secondary Mathematics: 2000-2010

ERIC Educational Resources Information Center

Chan, Bernard S.; Wahl, Lindi M.

2013-01-01

Published accounts of pedagogical experience and pedagogical research are critical resources to post-secondary mathematics instructors, and yet the quantity and scope of this literature is rarely summarized or reviewed. In this contribution, we analyze recent peer-reviewed journal publications regarding post-secondary mathematics, published by…

Review of online educational resources for medical physicists

PubMed Central

2013-01-01

Medical physicists are often involved in the didactic training of graduate students, residents (both physics and physicians), and technologists. As part of continuing medical education, we are also involved in maintenance of certification projects to assist in the education of our peers. As such, it is imperative that we remain current concerning available educational resources. Medical physics journals offer book reviews, allowing us an opportunity to learn about newly published books in the field. A similar means of communication is not currently available for online educational resources. This information is conveyed through informal means. This review presents a summary of online resources available to the medical physics community that may be useful for educational purposes. PACS number: 87.10.‐e PMID:24257289

Evaluating the care of general medicine inpatients: how good is implicit review?

PubMed

Hayward, R A; McMahon, L F; Bernard, A M

1993-04-01

Peer review often consists of implicit evaluations by physician reviewers of the quality and appropriateness of care. This study evaluated the ability of implicit review to measure reliably various aspects of care on a general medicine inpatient service. Retrospective review of patients' charts, using structured implicit review, of a stratified random sample of consecutive admissions to a general medicine ward. A university teaching hospital. Twelve internists were trained in structured implicit review and reviewed 675 patient admissions (with 20% duplicate reviews for a total of 846 reviews). Although inter-rater reliabilities for assessments of overall quality of care and preventable deaths (kappa = 0.5) were adequate for aggregate comparisons (for example, comparing mean ratings on two hospital wards), they were inadequate for reliable evaluations of single patients using one or two reviewers. Reviewers' agreement about most focused quality problems (for example, timeliness of diagnostic evaluation and clinical readiness at time of discharge) and about the appropriateness of hospital ancillary resource use was poor (kappa < or = 0.2). For most focused implicit measures, bias due to specific reviewers who were systematically more harsh or lenient (particularly for evaluation of resource-use appropriateness) accounted for much of the variation in reviewers' assessments, but this was not a substantial problem for the measure of overall quality. Reviewers rarely reported being unable to evaluate the quality of care because of deficiencies in documentation in the patient's chart. For assessment of overall quality and preventable deaths of general medicine inpatients, implicit review by peers had moderate degrees of reliability, but for most other specific aspects of care, physician reviewers could not agree. Implicit review was particularly unreliable at evaluating the appropriateness of hospital resource use and the patient's readiness for discharge, two areas where this type of review is often used.

Complex systems approach to scientific publication and peer-review system: development of an agent-based model calibrated with empirical journal data.

PubMed

Kovanis, Michail; Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic

Scientific peer-review and publication systems incur a huge burden in terms of costs and time. Innovative alternatives have been proposed to improve the systems, but assessing their impact in experimental studies is not feasible at a systemic level. We developed an agent-based model by adopting a unified view of peer review and publication systems and calibrating it with empirical journal data in the biomedical and life sciences. We modeled researchers, research manuscripts and scientific journals as agents. Researchers were characterized by their scientific level and resources, manuscripts by their scientific value, and journals by their reputation and acceptance or rejection thresholds. These state variables were used in submodels for various processes such as production of articles, submissions to target journals, in-house and external peer review, and resubmissions. We collected data for a sample of biomedical and life sciences journals regarding acceptance rates, resubmission patterns and total number of published articles. We adjusted submodel parameters so that the agent-based model outputs fit these empirical data. We simulated 105 journals, 25,000 researchers and 410,000 manuscripts over 10 years. A mean of 33,600 articles were published per year; 19 % of submitted manuscripts remained unpublished. The mean acceptance rate was 21 % after external peer review and rejection rate 32 % after in-house review; 15 % publications resulted from the first submission, 47 % the second submission and 20 % the third submission. All decisions in the model were mainly driven by the scientific value, whereas journal targeting and persistence in resubmission defined whether a manuscript would be published or abandoned after one or many rejections. This agent-based model may help in better understanding the determinants of the scientific publication and peer-review systems. It may also help in assessing and identifying the most promising alternative systems of peer review.

Web-based education in anesthesiology: a critical overview.

PubMed

Doyle, D John

2008-12-01

The purpose of this review is to discuss the rise of web-based educational resources available to the anesthesiology community. Recent developments of particular importance include the growth of 'Web 2.0' resources, the development of the concepts of 'open access' and 'information philanthropy', and the expansion of web-based medical simulation software products.In addition, peer review of online educational resources has now come of age. The worldwide web has made available a large variety of valuable medical information and education resources only dreamed of two decades ago. To a large extent,these developments represent a shift in the focus of medical education resources to emphasize free access to materials and to encourage collaborative development efforts.

Pedagogical Merit Review of Animal Use for Education in Canada

PubMed Central

Griffin, Gilly

2016-01-01

There are two components to the review of animal based protocols in Canada: review for the merit of the study itself, and review of the ethical acceptability of the work. Despite the perceived importance for the quality assurance these reviews provide; there are few studies of the peer-based merit review system for animal-based protocols for research and education. Institutional animal care committees (ACC)s generally rely on the external peer review of scientific merit for animal-based research. In contrast, peer review for animal based teaching/training is dependent on the review of pedagogical merit carried out by the ACC itself or another committee within the institution. The objective of this study was to evaluate the views of ACC members about current practices and policies as well as alternate policies for the review of animal based teaching/training. We conducted a national web-based survey of ACC members with both quantitative and qualitative response options. Responses from 167 ACC members indicated broad concerns about administrative burden despite strong support for both the current and alternate policies. Participants’ comments focused mostly on the merit review process (54%) relative to the efficiency (21%), impact (13%), and other (12%) aspects of evaluation. Approximately half (49%) of the comments were classified into emergent themes that focused on some type of burden: burden from additional pedagogical merit review (16%), a limited need for the review (12%), and a lack of resources (expertise 11%; people/money 10%). Participants indicated that the current system for pedagogical merit review is effective (60%); but most also indicated that there was at least some challenge (86%) with the current peer review process. There was broad support for additional guidance on the justification, criteria, types of animal use, and objectives of pedagogical merit review. Participants also supported the ethical review and application of the Three Rs in the review process. A clear priority from participants in the survey was updating guidance to better facilitate the merit review process of animal-based protocols for education. Balancing the need for improved guidance with the reality of limited resources at local institutions will be essential to do this successfully; a familiar dilemma to both scientists and policy makers alike. PMID:27352243

Pedagogical Merit Review of Animal Use for Education in Canada.

PubMed

Avey, Marc T; Griffin, Gilly

2016-01-01

There are two components to the review of animal based protocols in Canada: review for the merit of the study itself, and review of the ethical acceptability of the work. Despite the perceived importance for the quality assurance these reviews provide; there are few studies of the peer-based merit review system for animal-based protocols for research and education. Institutional animal care committees (ACC)s generally rely on the external peer review of scientific merit for animal-based research. In contrast, peer review for animal based teaching/training is dependent on the review of pedagogical merit carried out by the ACC itself or another committee within the institution. The objective of this study was to evaluate the views of ACC members about current practices and policies as well as alternate policies for the review of animal based teaching/training. We conducted a national web-based survey of ACC members with both quantitative and qualitative response options. Responses from 167 ACC members indicated broad concerns about administrative burden despite strong support for both the current and alternate policies. Participants' comments focused mostly on the merit review process (54%) relative to the efficiency (21%), impact (13%), and other (12%) aspects of evaluation. Approximately half (49%) of the comments were classified into emergent themes that focused on some type of burden: burden from additional pedagogical merit review (16%), a limited need for the review (12%), and a lack of resources (expertise 11%; people/money 10%). Participants indicated that the current system for pedagogical merit review is effective (60%); but most also indicated that there was at least some challenge (86%) with the current peer review process. There was broad support for additional guidance on the justification, criteria, types of animal use, and objectives of pedagogical merit review. Participants also supported the ethical review and application of the Three Rs in the review process. A clear priority from participants in the survey was updating guidance to better facilitate the merit review process of animal-based protocols for education. Balancing the need for improved guidance with the reality of limited resources at local institutions will be essential to do this successfully; a familiar dilemma to both scientists and policy makers alike.

Peer review in design: Understanding the impact of collaboration on the review process and student perception

NASA Astrophysics Data System (ADS)

Mandala, Mahender Arjun

A cornerstone of design and design education is frequent situated feedback. With increasing class sizes, and shrinking financial and human resources, providing rich feedback to students becomes increasingly difficult. In the field of writing, web-based peer review--the process of utilizing equal status learners within a class to provide feedback to each other on their work using networked computing systems--has been shown to be a reliable and valid source of feedback in addition to improving student learning. Designers communicate in myriad ways, using the many languages of design and combining visual and descriptive information. This complex discourse of design intent makes peer reviews by design students ambiguous and often not helpful to the receivers of this feedback. Furthermore, engaging students in the review process itself is often difficult. Teams can complement individual diversity and may assist novice designers collectively resolve complex task. However, teams often incur production losses and may be impacted by individual biases. In the current work, we look at utilizing a collaborative team of reviewers, working collectively and synchronously, in generating web based peer reviews in a sophomore engineering design class. Students participated in a cross-over design, conducting peer reviews as individuals and collaborative teams in parallel sequences. Raters coded the feedback generated on the basis of their appropriateness and accuracy. Self-report surveys and passive observation of teams conducting reviews captured student opinion on the process, its value, and the contrasting experience they had conducting team and individual reviews. We found team reviews generated better quality feedback in comparison to individual reviews. Furthermore, students preferred conducting reviews in teams, finding the process 'fun' and engaging. We observed several learning benefits of using collaboration in reviewing including improved understanding of the assessment criteria, roles, expectations, and increased team reflection. These results provide insight into how to improve the review process for instructors and researchers, and forms a basis for future research work in this area. With respect to facilitating peer review process in design based classrooms, we also present recommendations for creating effective review system design and implementation in classroom supported by research and practical experience.

ROAST: Peer Review as a Learning and Assessment Tool in Graduate Education

NASA Astrophysics Data System (ADS)

Somerville, R. C.

2003-12-01

Constructivist learning theory and inquiry-based educational practice stress the parallels between learning and research. Although peer review has long been a central feature of the working lives of research scientists, it has rarely found its way into the classroom. Motivated by this thought, an imaginary journal, Reviews of Atmospheric Science Topics (ROAST), has been integrated into a graduate-level course in atmospheric thermodynamics. The instructor acts as editor of ROAST. Students in the class are divided into teams and assigned topics on which to write survey papers and give in-class presentations, using the text, the Internet, the library, and other resources. The assigned topics range over the subject matter of the course. The submitted survey papers are sent by the ROAST editor to other members of the class, acting as anonymous reviewers. Just as in the case of real research journals, the editor asks the authors to respond to criticisms of reviewers and then sends the revised papers back to the reviewers. Each student is thus a researcher and co-author of one paper as well as an anonymous reviewer of several others. ROAST has proven to be not only a useful means of fostering learning, but also a natural and effective assessment tool. The peer review mechanism allows the student authors to address the defects in their papers, and hence in their learning, as pointed out not by an authority figure or an examination but by their own peers. As an important side benefit, the students gain experience with the peer review process itself and come to appreciate its strengths and weaknesses in evaluating scientific papers.

Low-value clinical practices in injury care: a scoping review protocol.

PubMed

Moore, Lynne; Boukar, Khadidja Malloum; Tardif, Pier-Alexandre; Stelfox, Henry T; Champion, Howard; Cameron, Peter; Gabbe, Belinda; Yanchar, Natalie; Kortbeek, John; Lauzier, François; Légaré, France; Archambault, Patrick; Turgeon, Alexis F

2017-07-12

Preventable injuries lead to 200 000 hospital stays, 60 000 disabilities, and 13 000 deaths per year in Canada with direct costs of $20 billion. Overall, potentially unnecessary medical interventions are estimated to consume up to 30% of healthcare resources and may expose patients to avoidable harm. However, little is known about overuse for acute injury care. We aim to identify low-value clinical practices in injury care. We will perform a scoping review of peer-reviewed and non-peer-reviewed literature to identify research articles, reviews, recommendations and guidelines that identify at least one low-value clinical practice specific to injury populations. We will search Medline, EMBASE, COCHRANE central, and BIOSIS/Web of Knowledge databases, websites of government agencies, professional societies and patient advocacy organisations, thesis holdings and conference proceedings. Pairs of independent reviewers will evaluate studies for eligibility and extract data from included articles using a prepiloted and standardised electronic data abstraction form. Low-value clinical practices will be categorised using an extension of the Agency for Healthcare Research and Quality conceptual framework and data will be presented using narrative synthesis. Ethics approval is not required as original data will not be collected. This study will be disseminated in a peer-reviewed journal, international scientific meetings, and to knowledge users through clinical and healthcare quality associations. This review will contribute new knowledge on low-value clinical practices in acute injury care. Our results will support the development indicators to measure resource overuse and inform policy makers on potential targets for deadoption in injury care. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Low-value clinical practices in injury care: a scoping review protocol

PubMed Central

Moore, Lynne; Boukar, Khadidja Malloum; Tardif, Pier-Alexandre; Stelfox, Henry T; Champion, Howard; Cameron, Peter; Gabbe, Belinda; Yanchar, Natalie; kortbeek, John; Lauzier, François; Légaré, France; Archambault, Patrick; Turgeon, Alexis F

2017-01-01

Introduction Preventable injuries lead to 200 000 hospital stays, 60 000 disabilities, and 13 000 deaths per year in Canada with direct costs of $20 billion. Overall, potentially unnecessary medical interventions are estimated to consume up to 30% of healthcare resources and may expose patients to avoidable harm. However, little is known about overuse for acute injury care. We aim to identify low-value clinical practices in injury care. Methods and analysis We will perform a scoping review of peer-reviewed and non-peer-reviewed literature to identify research articles, reviews, recommendations and guidelines that identify at least one low-value clinical practice specific to injury populations. We will search Medline, EMBASE, COCHRANE central, and BIOSIS/Web of Knowledge databases, websites of government agencies, professional societies and patient advocacy organisations, thesis holdings and conference proceedings. Pairs of independent reviewers will evaluate studies for eligibility and extract data from included articles using a prepiloted and standardised electronic data abstraction form. Low-value clinical practices will be categorised using an extension of the Agency for Healthcare Research and Quality conceptual framework and data will be presented using narrative synthesis. Ethics and dissemination Ethics approval is not required as original data will not be collected. This study will be disseminated in a peer-reviewed journal, international scientific meetings, and to knowledge users through clinical and healthcare quality associations. This review will contribute new knowledge on low-value clinical practices in acute injury care. Our results will support the development indicators to measure resource overuse and inform policy makers on potential targets for deadoption in injury care. PMID:28706101

Strategies to Prevent or Reduce Gender Bias in Peer Review of Research Grants: A Rapid Scoping Review.

PubMed

Tricco, Andrea C; Thomas, Sonia M; Antony, Jesmin; Rios, Patricia; Robson, Reid; Pattani, Reena; Ghassemi, Marco; Sullivan, Shannon; Selvaratnam, Inthuja; Tannenbaum, Cara; Straus, Sharon E

2017-01-01

To review the literature on strategies implemented or identified to prevent or reduce gender bias in peer review of research grants. Studies of any type of qualitative or quantitative design examining interventions to reduce or prevent gender bias during the peer review of health-related research grants were included. Electronic databases including MEDLINE, EMBASE, Education Resources Information Center (ERIC), PsycINFO, Joanna Briggs, the Cochrane Library, Evidence Based Medicine (EBM) Reviews, and the Campbell Library were searched from 2005 to April 2016. A search for grey (i.e., difficult to locate or unpublished) literature was conducted and experts in the field were consulted to identify additional potentially relevant articles. Two individuals screened titles and abstracts, full-text articles, and abstracted data with discrepancies resolved by a third person consistently. After screening 5524 citations and 170 full-text articles, one article evaluating gender-blinding of grant applications using an uncontrolled before-after study design was included. In this study, 891 applications for long-term fellowships in 2006 were included and 47% of the applicants were women. These were scored by 13 peer reviewers (38% were women). The intervention included eliminating references to gender from the applications, letters of recommendations, and interview reports that were sent to the committee members for evaluation. The proportion of successful applications led by women did not change with gender-blinding, although the number of successful applications that were led by men increased slightly. There is limited research on interventions to mitigate gender bias in the peer review of grants. Only one study was identified and no difference in the proportion of women who were successful in receiving grant funding was observed. Our results suggest that interventions to prevent gender bias should be adapted and tested in the context of grant peer review to determine if they will have an impact.

Strategies to Prevent or Reduce Gender Bias in Peer Review of Research Grants: A Rapid Scoping Review

PubMed Central

Tricco, Andrea C.; Thomas, Sonia M.; Antony, Jesmin; Rios, Patricia; Robson, Reid; Pattani, Reena; Ghassemi, Marco; Sullivan, Shannon; Selvaratnam, Inthuja; Tannenbaum, Cara; Straus, Sharon E.

2017-01-01

Objective To review the literature on strategies implemented or identified to prevent or reduce gender bias in peer review of research grants. Methods Studies of any type of qualitative or quantitative design examining interventions to reduce or prevent gender bias during the peer review of health-related research grants were included. Electronic databases including MEDLINE, EMBASE, Education Resources Information Center (ERIC), PsycINFO, Joanna Briggs, the Cochrane Library, Evidence Based Medicine (EBM) Reviews, and the Campbell Library were searched from 2005 to April 2016. A search for grey (i.e., difficult to locate or unpublished) literature was conducted and experts in the field were consulted to identify additional potentially relevant articles. Two individuals screened titles and abstracts, full-text articles, and abstracted data with discrepancies resolved by a third person consistently. Results After screening 5524 citations and 170 full-text articles, one article evaluating gender-blinding of grant applications using an uncontrolled before-after study design was included. In this study, 891 applications for long-term fellowships in 2006 were included and 47% of the applicants were women. These were scored by 13 peer reviewers (38% were women). The intervention included eliminating references to gender from the applications, letters of recommendations, and interview reports that were sent to the committee members for evaluation. The proportion of successful applications led by women did not change with gender-blinding, although the number of successful applications that were led by men increased slightly. Conclusions There is limited research on interventions to mitigate gender bias in the peer review of grants. Only one study was identified and no difference in the proportion of women who were successful in receiving grant funding was observed. Our results suggest that interventions to prevent gender bias should be adapted and tested in the context of grant peer review to determine if they will have an impact. PMID:28061509

Peer-Review of Digital Educational Resources--A Rigorous Review Process Developed by the Climate Literacy and Energy Awareness Network (CLEAN)

ERIC Educational Resources Information Center

Gold, Anne U.; Ledley, Tamara Shapiro; Buhr, Susan M.; Fox, Sean; McCaffrey, Mark; Niepold, Frank; Manduca, Cathy; Lynds, Susan E.

2012-01-01

Educators seek to develop 21st century skills in the classroom by incorporating educational materials other than textbooks into their lessons, such as digitally available activities, videos, and visualizations. A problem that educators face is that no review process similar to the formal adoption processes used for K-12 textbooks or the…

Peer-review Platform for Astronomy Education Activities

NASA Astrophysics Data System (ADS)

Heenatigala, Thilina; Russo, Pedro; Gomez, Edward; Strubbe, Linda

2015-08-01

Astronomy educators and teachers worldwide commonly request and search for high-quality astronomy activities to do with their students. Hundreds of astronomy education activities exist, as well as many resource repositories to find them. However, the quality of such resources is highly variable as they are not updated regularly or limited with content review. Since its launch in 2013, astroEDU has been addressing these issues and more by following a peer-review process. Each activity submitted is reviewed by an educator and a professional astronomer, balancing both the scientific and educational value of the content. Moreover, the majority of the reviewers are invited from IAU commissions related to the field of the activity, as an effort to get IAU members actively involved in the project. The website code, activities and layout design are open-access in order to make them accessible and adoptable for educators around the world. Furthermore the platform harnesses the OAD volunteer database to develop existing astronomy education activities into the astroEDU activity format. Published activities are also pushed to partner repositories and each activity is registered for DOI, allowing authors to cite their work. To further test the activities and improve the platform, astroEDU editorial team organises workshops.

Focus issue: teaching tools and learning opportunities.

PubMed

Gough, Nancy R

2010-04-27

Science Signaling provides authoring experience for students and resources for educators. Students experience the writing and revision process involved in authoring short commentary articles that are published in the Journal Club section. By publishing peer-reviewed teaching materials, Science Signaling provides instructors with feedback that improves their materials and an outlet to share their tips and techniques and digital resources with other teachers.

Bristol Bay Assessment - Final Report (2014)

EPA Pesticide Factsheets

This is the final Bristol Bay assessment developed and peer reviewed by the Office of Research and Development in EPA. The purpose of this assessment is to provide a characterization of the biological and mineral resources of the Bristol Bay watershed.

EPA Published Research Related to the Hydraulic Fracturing Study

EPA Pesticide Factsheets

A list of publications that will support the draft assessment report on the potential impacts of hydraulic fracturing on drinking water resources. These publications have undergone peer review through the journal where the paper has been published.

EPA Study of Hydraulic Fracturing and Drinking Water Resources

EPA Science Inventory

In its FY2010 Appropriations Committee Conference Report, Congress directed EPA to study the relationship between hydraulic fracturing and drinking water, using: • Best available science • Independent sources of information • Transparent, peer-reviewed process • Consultatio...

New Careers in Nursing Scholar Alumni Toolkit: Development of an Innovative Resource for Transition to Practice.

PubMed

Mauro, Ann Marie P; Escallier, Lori A; Rosario-Sim, Maria G

2016-01-01

The transition from student to professional nurse is challenging and may be more difficult for underrepresented minority nurses. The Robert Wood Johnson Foundation New Careers in Nursing (NCIN) program supported development of a toolkit that would serve as a transition-to-practice resource to promote retention of NCIN alumni and other new nurses. Thirteen recent NCIN alumni (54% male, 23% Hispanic/Latino, 23% African Americans) from 3 schools gave preliminary content feedback. An e-mail survey was sent to a convenience sample of 29 recent NCIN alumni who evaluated the draft toolkit using a Likert scale (poor = 1; excellent = 5). Twenty NCIN alumni draft toolkit reviewers (response rate 69%) were primarily female (80%) and Hispanic/Latino (40%). Individual chapters' mean overall rating of 4.67 demonstrated strong validation. Mean scores for overall toolkit content (4.57), usability (4.5), relevance (4.79), and quality (4.71) were also excellent. Qualitative comments were analyzed using thematic content analysis and supported the toolkit's relevance and utility. A multilevel peer review process was also conducted. Peer reviewer feedback resulted in a 6-chapter document that offers resources for successful transition to practice and lays the groundwork for continued professional growth. Future research is needed to determine the ideal time to introduce this resource. Copyright © 2016 Elsevier Inc. All rights reserved.

Perspective from the Department of Defense Breast Cancer Research Program.

PubMed

Rich, I M; Andejeski, Y; Alciati, M H; Crawford Bisceglio, I; Breslau, E S; McCall, L; Valadez, A

1998-12-01

The Department of Defense (DOD), Breast Cancer Research Program (BCRP) was established in 1993. Since its inception, Congress has appropriated more than 878 million dollars for the BCRP, a unique public-private partnership between the DOD, consumer advocacy, and scientific communities which has funded approximately 1,800 breast cancer research grants. Through this partnership, the BCRP designed a model program for consumer involvement in scientific peer review. This paper describes the BCRP's approach to the processes of recruitment, selection, and preparation of consumers for this expanded role. Further, factors critical to program implementation, such as effective program management, ongoing process improvement, strong program leadership, and allocation of resources, that led to the BCRP's success in developing the previously undefined role of breast cancer survivors as members of scientific peer review panels are discussed. The BCRP demonstrates the feasibility and unique contributions of consumers in scientific peer review and provides a critical foundation for future efforts to ensure consumer involvement in scientific research programs.

Using multimedia and peer assessment to promote collaborative e-learning

NASA Astrophysics Data System (ADS)

Barra, Enrique; Aguirre Herrera, Sandra; Ygnacio Pastor Caño, Jose; Quemada Vives, Juan

2014-04-01

Collaborative e-learning is increasingly appealing as a pedagogical approach that can positively affect student learning. We propose a didactical model that integrates multimedia with collaborative tools and peer assessment to foster collaborative e-learning. In this paper, we explain it and present the results of its application to the "International Seminars on Materials Science" online course. The proposed didactical model consists of five educational activities. In the first three, students review the multimedia resources proposed by the teacher in collaboration with their classmates. Then, in the last two activities, they create their own multimedia resources and assess those created by their classmates. These activities foster communication and collaboration among students and their ability to use and create multimedia resources. Our purpose is to encourage the creativity, motivation, and dynamism of the learning process for both teachers and students.

Proposed standards for peer-reviewed publication of computer code

USDA-ARS?s Scientific Manuscript database

Computer simulation models are mathematical abstractions of physical systems. In the area of natural resources and agriculture, these physical systems encompass selected interacting processes in plants, soils, animals, or watersheds. These models are scientific products and have become important i...

A systematic review of near real-time and point-of-care clinical decision support in anesthesia information management systems.

PubMed

Simpao, Allan F; Tan, Jonathan M; Lingappan, Arul M; Gálvez, Jorge A; Morgan, Sherry E; Krall, Michael A

2017-10-01

Anesthesia information management systems (AIMS) are sophisticated hardware and software technology solutions that can provide electronic feedback to anesthesia providers. This feedback can be tailored to provide clinical decision support (CDS) to aid clinicians with patient care processes, documentation compliance, and resource utilization. We conducted a systematic review of peer-reviewed articles on near real-time and point-of-care CDS within AIMS using the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols. Studies were identified by searches of the electronic databases Medline and EMBASE. Two reviewers screened studies based on title, abstract, and full text. Studies that were similar in intervention and desired outcome were grouped into CDS categories. Three reviewers graded the evidence within each category. The final analysis included 25 articles on CDS as implemented within AIMS. CDS categories included perioperative antibiotic prophylaxis, post-operative nausea and vomiting prophylaxis, vital sign monitors and alarms, glucose management, blood pressure management, ventilator management, clinical documentation, and resource utilization. Of these categories, the reviewers graded perioperative antibiotic prophylaxis and clinical documentation as having strong evidence per the peer reviewed literature. There is strong evidence for the inclusion of near real-time and point-of-care CDS in AIMS to enhance compliance with perioperative antibiotic prophylaxis and clinical documentation. Additional research is needed in many other areas of AIMS-based CDS.

Enhancing Collaborative Peer-to-Peer Systems Using Resource Aggregation and Caching: A Multi-Attribute Resource and Query Aware Approach

ERIC Educational Resources Information Center

Bandara, H. M. N. Dilum

2012-01-01

Resource-rich computing devices, decreasing communication costs, and Web 2.0 technologies are fundamentally changing the way distributed applications communicate and collaborate. With these changes, we envision Peer-to-Peer (P2P) systems that will allow for the integration and collaboration of peers with diverse capabilities to a virtual community…

Cooperative Resource Pricing in Service Overlay Networks for Mobile Agents

NASA Astrophysics Data System (ADS)

Nakano, Tadashi; Okaie, Yutaka

The success of peer-to-peer overlay networks depends on cooperation among participating peers. In this paper, we investigate the degree of cooperation among individual peers required to induce globally favorable properties in an overlay network. Specifically, we consider a resource pricing problem in a market-oriented overlay network where participating peers sell own resources (e.g., CPU cycles) to earn energy which represents some money or rewards in the network. In the resource pricing model presented in this paper, each peer sets the price for own resource based on the degree of cooperation; non-cooperative peers attempt to maximize their own energy gains, while cooperative peers maximize the sum of own and neighbors' energy gains. Simulation results are presented to demonstrate that the network topology is an important factor influencing the minimum degree of cooperation required to increase the network-wide global energy gain.

Population-based initiatives in college mental health: students helping students to overcome obstacles.

PubMed

Kirsch, Daniel J; Pinder-Amaker, Stephanie L; Morse, Charles; Ellison, Marsha L; Doerfler, Leonard A; Riba, Michelle B

2014-12-01

College students' need for mental health care has increased dramatically, leaving campus counseling and mental health centers struggling to meet the demand. This has led to the investigation and development of extra-center, population-based interventions. Student-to-student support programs are but one example. Students themselves are a plentiful, often-untapped resource that extends the reach of mental health services on campus. Student-to-student programs capitalize on students' natural inclination to assist their peers. A brief review of the prevalence and effects of mental disorders in the college population is provided, followed by a broad overview of the range of peer-to-peer programs that can be available on college campuses. Two innovative programs are highlighted: (1) a hospital- and community-based program, the College Mental Health Program (CMHP) at McLean Hospital, and 2) the Student Support Network (SSN) at Worcester Polytechnic Institute. The subsequent section reviews the literature on peer-to-peer programs for students with serious and persistent mental illness for which there is a small but generally positive body of research. This lack of an empirical basis in college mental health leads the authors to argue for development of broad practice-research networks.

The Influence of Community Health Resources on Effectiveness and Sustainability of Community and Lay Health Worker Programs in Lower-Income Countries: A Systematic Review.

PubMed

de Vries, Daniel H; Pool, Robert

2017-01-01

Despite the availability of practical knowledge and effective interventions required to reduce priority health problems in low-income countries, poor and vulnerable populations are often not reached. One possible solution to this problem is the use of Community or Lay Health Workers (CLHWs). So far, however, the development of sustainability in CLHW programs has failed and high attrition rates continue to pose a challenge. We propose that the roles and interests which support community health work should emerge directly from the way in which health is organized at community level. This review explores the evidence available to assess if increased levels of integration of community health resources in CLHW programs indeed lead to higher program effectiveness and sustainability. This review includes peer-reviewed articles which meet three eligibility criteria: 1) specific focus on CLHWs or equivalent; 2) randomized, quasi-randomized, before/after methodology or substantial descriptive assessment; and 3) description of a community or peer intervention health program located in a low- or middle-income country. Literature searches using various article databases led to 2930 hits, of which 359 articles were classified. Of these, 32 articles were chosen for extensive review, complemented by analysis of the results of 15 other review studies. Analysis was conducted using an excel based data extraction form. Because results showed that no quantitative data was published, a descriptive synthesis was conducted. The review protocol was not proactively registered. Findings show minimal inclusion of even basic community level indicators, such as the degree to which the program is a community initiative, community input in the program or training, the background and history of CLHW recruits, and the role of the community in motivation and retention. Results show that of the 32 studies, only one includes one statistical measure of community integration. As a result of this lack of data we are unable to derive an evidence-based conclusion to our propositions. Instead, our results indicate a larger problem, namely the complete absence of indicators measuring community relationships with the programs studied. Studies pay attention only to gender and peer roles, along with limited demographic information about the recruits. The historicity of the health worker and the community s/he belongs to is absent in most studies reviewed. None of the studies discuss or test for the possibility that motivation emanates from the community. Only a few studies situate attrition and retention as an issue enabled by the community. The results were limited by a focus on low-income countries and English, peer-reviewed published articles only. Published, peer-reviewed studies evaluating the effectiveness and sustainability of CLHW interventions in health programs have not yet adequately tested for the potential of utilizing existing community health roles or social networks for the development of effective and sustainable (retentive) CLHW programs. Community relationships are generally seen as a "black box" represented by an interchangeable CLHW labor unit. This disconnect from community relationships and resources may have led to a systematic and chronic undervaluing of community agency in explanations of programmatic effectiveness and sustainability.

NASA Product Peer Review Process

NASA Technical Reports Server (NTRS)

Jenks, Ken

2009-01-01

This viewgraph presentation describes NASA's product peer review process. The contents include: 1) Inspection/Peer Review at NASA; 2) Reasons for product peer reviews; 3) Different types of peer reviews; and 4) NASA requirements for peer reviews. This presentation also includes a demonstration of an actual product peer review.

A comprehensive physiologically based pharmacokinetic knowledgebase and web-based interface for rapid model ranking and querying

EPA Science Inventory

Published physiologically based pharmacokinetic (PBPK) models from peer-reviewed articles are often well-parameterized, thoroughly-vetted, and can be utilized as excellent resources for the construction of models pertaining to related chemicals. Specifically, chemical-specific pa...

Conflicts of interest in medical science: peer usage, peer review and 'CoI consultancy'.

PubMed

Charlton, Bruce G

2004-01-01

In recent years, the perception has grown that conflicts of interest are having a detrimental effect on medical science as it influences health policy and clinical practice, leading medical journals to enforce self-declaration of potential biases in the attempt to counteract or compensate for the problem. Conflict of interest (CoI) declarations have traditionally been considered inappropriate in pure science since its evaluation systems themselves constitute a mechanism for eliminating the effect of individual biases. Pure science is primarily evaluated by 'peer usage', in which scientific information is 'replicated' by being incorporated in the work of other scientists, and tested by further observation of the natural world. Over the long-term, the process works because significant biases impair the quality of science, and bad science tends to be neglected or refuted. However, scientific evaluation operates slowly over years and decades, and only a small proportion of published work is ever actually evaluated. But most of modern medical science no longer conforms to the model of pure science, and may instead be conceptualized as a system of 'applied' science having different aims and evaluation processes. The aim of applied medical science is to solve pre-specified problems, and to provide scientific information ready for implementation immediately following publication. The primary evaluation process of applied science is peer review, not peer usage. Peer review is much more rapid (with a timescale of weeks or months) and cheaper than peer usage and (consequently) has a much wider application: peer review is a prospective validation while peer usage is retrospective. Since applied science consists of incremental advances on existing knowledge achieved using established techniques, its results can usually be reliably evaluated by peer review. However, despite its considerable convenience, peer review has significant limitations related to its reliance on opinion. One major limitation of peer review has proved to be its inability to deal with conflicts of interest, especially in a 'big science' context when prestigious scientists may have similar biases, and conflicts of interest are widely shared among peer reviewers. When applied medical science has been later checked against the slower but more valid processes of peer usage, it seems that reliance on peer review may allow damaging distortions to become 'locked-in' to clinical practice and health policy for considerable periods. Scientific progress is generally underpinned by increasing specialization. Medical journals should specialize in the communication of scientific information, and they have neither the resources nor the motivation to investigate and measure conflicts of interest. Effectively dealing with the problem of conflicts of interest in applied medical science firstly requires a more explicit demarcation between the communications media of pure medical science and applied medical science. Greater specialization of these activities would then allow distinctive aims and evaluation systems to evolve with the expectation of improved performance in both pure and applied systems. In future, applied medical science should operate with an assumption of bias, with the onus of proof on applied medical scientists to facilitate the 'data transparency' necessary to validate their research. Journals of applied medical science will probably require more rigorous processes of peer review than at present, since their publications are intended to be ready for implementation. But since peer review does not adequately filter-out conflicts of interest in applied medical science, there is a need for the evolution of specialist post-publication institutional mechanisms. The suggested solution is to encourage the establishment of independent 'CoI consultancy' services, whose role would be to evaluate conflicts of interest and other biases in published applied medical science prior to their implementation. Such services would be paid-for by the groups who intend to implement applied medical research.

Technology and Health Information Technology in Colorectal Surgery: Electronic Literature Support

PubMed Central

Magruder, J. Trent; Efron, Jonathan E.

2013-01-01

The advent of the Internet has revolutionized the management of reporting and accessing research and data. The authors review the current resources available to surgeons through websites, accumulated published data repositories, and libraries. The change in how we publish and present peer-reviewed data over the last 20 years is also discussed as well as the future of health information technology. PMID:24436645

Weather and environmental hazards at mass gatherings.

PubMed

Soomaroo, Lee; Murray, Virginia

2012-07-31

Introduction Reviews of mass gathering events have traditionally concentrated on crowd variables that affect the level and type of medical care needed. Weather and environmental hazards at mass gathering events have not been fully researched. This review examines these events and aims to provide future suggestions for event organisers, medical resource planners, and emergency services, including local hospital emergency departments. Methods A review was conducted using computerised data bases: MEDLINE, The Cochrane Library, HMIC and EMBASE, with Google used to widen the search beyond peer-reviewed publications, to identify grey literature. All peer-review literature articles found containing information pertaining to lessons identified from mass gathering disasters due to weather or environmental hazards leading to participant death, injury or illness were analysed and reviewed. Disasters occurring due to crowd variables were not included. These articles were read, analysed, abstracted and summarised. Results 20 articles from literature search were found detailing mass gathering disasters relating directly to weather or environmental hazards from 1988 - 2011, with only 17 cases found within peer-review literature. Two events grey literature from 2011 are due to undergo further inquiry while one article reviews an event originally occurring in 1922. Analysis of cases were categorised in to heat and cold-related events, lightning and storms and disease outbreak. Conclusions Mass gathering events have an enormous potential to place a severe strain on the local health care system, Prior health resource and environmental planning for heat & cold-related illness, lightning & storms, and disease outbreak can advance emergency preparedness and response to potential disasters. Soomaroo L, Murray V. Weather and Environmental Hazards at Mass Gatherings. PLoS Currents Disasters. 2012 Jul 31 KEYWORDS: Mass Gatherings, Disasters, Sporting Events, Festivals, Concerts, Storm, Lightning, Cyclone, Hot-weather illness, Cold-weather illness, Disease, Public Health, Syndromic Surveillance Abbreviations: ALS - Advance Life support; BLS - Basic Life support; ED - Emergency Department; EMS - Emergency Medical Services; PPR - Patient Presentation Rate.

Weather and Environmental Hazards at Mass Gatherings

PubMed Central

Soomaroo, Lee; Murray, Virginia

2012-01-01

Introduction Reviews of mass gathering events have traditionally concentrated on crowd variables that affect the level and type of medical care needed. Weather and environmental hazards at mass gathering events have not been fully researched. This review examines these events and aims to provide future suggestions for event organisers, medical resource planners, and emergency services, including local hospital emergency departments. Methods A review was conducted using computerised data bases: MEDLINE, The Cochrane Library, HMIC and EMBASE, with Google used to widen the search beyond peer-reviewed publications, to identify grey literature. All peer-review literature articles found containing information pertaining to lessons identified from mass gathering disasters due to weather or environmental hazards leading to participant death, injury or illness were analysed and reviewed. Disasters occurring due to crowd variables were not included. These articles were read, analysed, abstracted and summarised. Results 20 articles from literature search were found detailing mass gathering disasters relating directly to weather or environmental hazards from 1988 – 2011, with only 17 cases found within peer-review literature. Two events grey literature from 2011 are due to undergo further inquiry while one article reviews an event originally occurring in 1922. Analysis of cases were categorised in to heat and cold-related events, lightning and storms and disease outbreak. Conclusions Mass gathering events have an enormous potential to place a severe strain on the local health care system, Prior health resource and environmental planning for heat & cold-related illness, lightning & storms, and disease outbreak can advance emergency preparedness and response to potential disasters. Citation: Soomaroo L, Murray V. Weather and Environmental Hazards at Mass Gatherings. PLoS Currents Disasters. 2012 Jul 31 Keywords: Mass Gatherings, Disasters, Sporting Events, Festivals, Concerts, Storm, Lightning, Cyclone, Hot-weather illness, Cold-weather illness, Disease, Public Health, Syndromic Surveillance Abbreviations: ALS – Advance Life support; BLS – Basic Life support; ED – Emergency Department; EMS – Emergency Medical Services; PPR – Patient Presentation Rate PMID:22953242

Report and recommendations on multimedia materials for teaching and learning electricity and magnetism

NASA Astrophysics Data System (ADS)

Dȩbowska, E.; Girwidz, R.; Greczyło, T.; Kohnle, A.; Mason, B.; Mathelitsch, L.; Melder, T.; Michelini, M.; Ruddock, I.; Silva, J.

2013-05-01

This paper presents the results of a peer review of multimedia materials for teaching and learning electricity and magnetism prepared as a part of the annual activities undertaken by an international group of scientists associated with Multimedia Physics in Teaching and Learning. The work promotes the use of valuable and freely accessible information technology materials for different levels of teaching, mostly higher education. The authors discuss the process of selecting resources and the rubrics used in the rating process. The reviews of high-quality learning resources are presented along with descriptions of valuable didactical features.

Impact of interventions to improve the quality of peer review of biomedical journals: a systematic review and meta-analysis.

PubMed

Bruce, Rachel; Chauvin, Anthony; Trinquart, Ludovic; Ravaud, Philippe; Boutron, Isabelle

2016-06-10

The peer review process is a cornerstone of biomedical research. We aimed to evaluate the impact of interventions to improve the quality of peer review for biomedical publications. We performed a systematic review and meta-analysis. We searched CENTRAL, MEDLINE (PubMed), Embase, Cochrane Database of Systematic Reviews, and WHO ICTRP databases, for all randomized controlled trials (RCTs) evaluating the impact of interventions to improve the quality of peer review for biomedical publications. We selected 22 reports of randomized controlled trials, for 25 comparisons evaluating training interventions (n = 5), the addition of a statistical peer reviewer (n = 2), use of a checklist (n = 2), open peer review (i.e., peer reviewers informed that their identity would be revealed; n = 7), blinded peer review (i.e., peer reviewers blinded to author names and affiliation; n = 6) and other interventions to increase the speed of the peer review process (n = 3). Results from only seven RCTs were published since 2004. As compared with the standard peer review process, training did not improve the quality of the peer review report and use of a checklist did not improve the quality of the final manuscript. Adding a statistical peer review improved the quality of the final manuscript (standardized mean difference (SMD), 0.58; 95 % CI, 0.19 to 0.98). Open peer review improved the quality of the peer review report (SMD, 0.14; 95 % CI, 0.05 to 0.24), did not affect the time peer reviewers spent on the peer review (mean difference, 0.18; 95 % CI, -0.06 to 0.43), and decreased the rate of rejection (odds ratio, 0.56; 95 % CI, 0.33 to 0.94). Blinded peer review did not affect the quality of the peer review report or rejection rate. Interventions to increase the speed of the peer review process were too heterogeneous to allow for pooling the results. Despite the essential role of peer review, only a few interventions have been assessed in randomized controlled trials. Evidence-based peer review needs to be developed in biomedical journals.

Demystifying Assessment: The Road to Accreditation

ERIC Educational Resources Information Center

Garfolo, Blaine T.; L'Huillier, Barbara

2015-01-01

Accreditation serves as both a quality assurance and accountability mechanism for our learning institutions. It is a voluntary process of self-regulation and non-governmental peer review supported, in general, by providers of tertiary education and examines the philosophy, goals, programs, facilities, resources, and financial viability of the…

Building Educational Scholarship: A Roadmap for Success

ERIC Educational Resources Information Center

Goldman, Ellen F.; Hamburger, Ellen K.; Ottolini, Mary C.

2014-01-01

In this paper, we describe the faculty development resources, structures, and processes utilized to promote educational scholarship in a department of pediatrics. We discuss a 5-year effort based on the strategy of forming an "academy" of educational scholars and resulting in significant increases in peer-reviewed conference…

CiteAb: a searchable antibody database that ranks antibodies by the number of times they have been cited

PubMed Central

2014-01-01

Background Research antibodies are used by thousands of scientists working in diverse disciplines, but it is common to hear concerns about antibody quality. This means that researchers need to carefully choose the antibodies they use to avoid wasting time and money. A well accepted way of selecting a research antibody is to identify one which has been used previously, where the associated data has been peer-reviewed and the results published. Description CiteAb is a searchable database which ranks antibodies by the number of times they have been cited. This allows researchers to easily find antibodies that have been used in peer-reviewed publications and the accompanying citations are listed, so users can check the data contained within the publications. This makes CiteAb a useful resource for identifying antibodies for experiments and also for finding information to demonstrate antibody validation. The database currently contains 1,400,000 antibodies which are from 90 suppliers, including 87 commercial companies and 3 academic resources. Associated with these antibodies are 140,000 publications which provide 306,000 antibody citations. In addition to searching, users can also browse through the antibodies and add their own publications to the CiteAb database. Conclusions CiteAb provides a new way for researchers to find research antibodies that have been used successfully in peer-reviewed publications. It aims to assist these researchers and will hopefully help promote progress in many areas of life science research. PMID:24528853

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.109 Qualifications of peer reviewers. The general reviewer qualification criteria to...). Additional details concerning peer reviewer qualifications are provided in the OJJDP “Peer Review Guideline”. ...

The cancer of bureaucracy: how it will destroy science, medicine, education; and eventually everything else.

PubMed

Charlton, Bruce G

2010-06-01

Everyone living in modernizing 'Western' societies will have noticed the long-term, progressive growth and spread of bureaucracy infiltrating all forms of social organization: nobody loves it, many loathe it, yet it keeps expanding. Such unrelenting growth implies that bureaucracy is parasitic and its growth uncontrollable - in other words it is a cancer that eludes the host immune system. Old-fashioned functional, 'rational' bureaucracy that incorporated individual decision-making is now all-but extinct, rendered obsolete by computerization. But modern bureaucracy evolved from it, the key 'parasitic' mutation being the introduction of committees for major decision-making or decision-ratification. Committees are a fundamentally irrational, incoherent, unpredictable decision-making procedure; which has the twin advantages that it cannot be formalized and replaced by computerization, and that it generates random variation or 'noise' which provides the basis for natural selection processes. Modern bureaucracies have simultaneously grown and spread in a positive feedback cycle; such that interlinking bureaucracies now constitute the major environmental feature of human society which affects organizational survival and reproduction. Individual bureaucracies must become useless parasites which ignore the 'real-world' in order to adapt to rapidly-changing 'bureaucratic reality'. Within science, the major manifestation of bureaucracy is peer review, which - cancer-like - has expanded to obliterate individual authority and autonomy. There has been local elaboration of peer review and metastatic spread of peer review to include all major functions such as admissions, appointments, promotions, grant review, project management, research evaluation, journal and book refereeing and the award of prizes. Peer review eludes the immune system of science since it has now been accepted by other bureaucracies as intrinsically valid, such that any residual individual decision-making (no matter how effective in real-world terms) is regarded as intrinsically unreliable (self-interested and corrupt). Thus the endemic failures of peer review merely trigger demands for ever-more elaborate and widespread peer review. Just as peer review is killing science with its inefficiency and ineffectiveness, so parasitic bureaucracy is an un-containable phenomenon; dangerous to the extent that it cannot be allowed to exist unmolested, but must be utterly extirpated. Or else modernizing societies will themselves be destroyed by sclerosis, resource misallocation, incorrigibly-wrong decisions and the distortions of 'bureaucratic reality'. However, unfortunately, social collapse is the more probable outcome, since parasites can evolve more rapidly than host immune systems.

In-Suit Light Exercise (ISLE) Prebreathe Protocol Peer Review Assessment. Part 2; Appendices

NASA Technical Reports Server (NTRS)

Brady, Timothy K.; Polk, James D.

2011-01-01

The performance of extravehicular activity (EVA) by National Aeronautics and Space Administration astronauts involves the risk of decompression sickness. This risk has been mitigated by the use of oxygen "prebreathe" to effectively wash out tissue nitrogen prior to each EVA. Now that the Space Shuttle Program (SSP) is being retired, high-pressure oxygen will become a limited resource. The In-Suit Light Exercise (ISLE) Prebreathe Protocol offers several potential benefits including its potential to save 6 pounds of oxygen per EVA. At the request of the NASA Engineering and Safety Center, the peer review convened on October 14, 2010. The major recommendation of the Review Committee was that the ISLE protocol was acceptable for operational use as a prebreathe option prior to EVA. The appendices to Volume I of the report are contained in this document.

Peer support and peer-led family support for persons living with schizophrenia.

PubMed

Duckworth, Kenneth; Halpern, Lisa

2014-05-01

Peer support and peer-led family psychoeducation represent two distinct and complementary recovery-oriented models to support individuals who live with schizophrenia and their families, respectively. The goals of these models focus on improving knowledge, coping, self-care, social support, and self-management strategies. These models represent important capacity-building strategies for people who live with the illness and the people who love them. This brief article is intended to provide the practicing clinician, person living with schizophrenia, and policy maker with a working knowledge of the current state of the literature in these two related fields. Practitioners should consider these resources and integrate them into their care. A person living with schizophrenia could use this review to advocate for appropriate resources and to identify career opportunities. Policy makers could benefit from an understanding of the literature to mitigate financial and cultural barriers to adopting these practices. The last 5 years have seen a dramatic expansion of the application of randomized controlled trials (RCTs) to give evidence to match the experience of people in these programs. The field has seen Wellness Recovery Action Plan (WRAP) named as evidence-based practice by the National Registry of Evidence-Based Practices. A RCT was also conducted for another peer-developed and led program called Building Recovery of Individual Dreams & Goals through Education & Support. Family to Family, the largest peer-led family psychoeducation course, was also found to have significant impact after the study and also 6 months later in RCT. Family to Family has also been named as an evidence-based practice. The field of people who are living well with schizophrenia working as resources and supports to others living with the illness is an idea that is growing momentum. This momentum has been matched by the RCT evidence. Peer support as a professional role has an emerging literature that needs to be grown. WRAP and National Alliance on Mental Illness's Family to Family program are evidence-based practices and widely available. Peer support and peer-led family support for persons living with schizophrenia is a nascent field with much potential.

Enhancing Students' Written Mathematical Arguments

ERIC Educational Resources Information Center

Lepak, Jerilynn

2014-01-01

Writing in mathematics is complex. The purpose of this article is to share how one teacher, Ms. Hill, used peer-review activities involving rubrics to explicitly communicate mathematical resources that students could draw from when justifying a claim. She found that helping students understand which type of statements could be used in…

Assessment of Institutional Effectiveness at the University of Tennessee, Knoxville.

ERIC Educational Resources Information Center

Banta, Trudy W.; And Others

1986-01-01

The University of Tennessee at Knoxville has successfully integrated a program for assessing student outcomes in the ongoing institutional processes of peer review, strategic planning, and internal resource allocation. Students are tested in general education and their major fields and participate in curriculum and instructional evaluations.…

Systematically Evaluating the Effectiveness of Quality Assurance Programmes in Leading to Improvements in Institutional Performance

ERIC Educational Resources Information Center

Lillis, Deirdre

2012-01-01

Higher education institutions worldwide invest significant resources in their quality assurance systems. Little empirical evidence exists that demonstrates the effectiveness (or otherwise) of these systems. Methodological approaches for determining effectiveness are also underdeveloped. Self-study-with-peer-review is a widely used model for…

76 FR 63359 - Endangered and Threatened Wildlife and Plants; Proposed Designation of Critical Habitat for the...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-10-12

... resource extraction (e.g., coal mining, silviculture, natural gas development), agriculture, road... channel instability, and natural gas development. Chucky Madtom The chucky madtom (Noturus crypticus) is a... information sources may include articles in peer-reviewed journals, conservation plans developed by States and...

Citizen science can improve conservation science, natural resource management, and environmental protection

USDA-ARS?s Scientific Manuscript database

Citizen science has advanced science for hundreds of years, contributed to many peer-reviewed articles, and informed land management decisions and policies across the United States. Over the last 10 years, citizen science has grown immensely in the United States and many other countries. Here, we sh...

Peer reviewing e-learning: opportunities, challenges, and solutions.

PubMed

Ruiz, Jorge G; Candler, Chris; Teasdale, Thomas A

2007-05-01

Peer review is the foundation of academic publication and a necessary step in the scrutiny of any scholarly work. Simply defined, peer review is the attentive, unbiased assessment of any scholarly work that is submitted for formal scrutiny. Although medical school faculty increasingly use technology in clinical teaching, e-learning materials are often not subjected to a rigorous peer review process. The authors contrast peer review of e-learning materials with that of print materials, describe peer review issues regarding e-learning materials, propose approaches to address the challenges of peer review of e-learning materials, and outline directions for refinement of the e-learning peer review process. At its core, the peer review of e-learning materials should not differ substantially from that of traditional manuscripts. However, e-learning introduces new demands that impel reviewers to consider aspects that are unique to educational technology, including pedagogy, format, usability, navigation, interactivity, delivery, ease of updating, distribution, and access. Four approaches are offered to ease the burden and improve the quality of e-learning peer review: develop peer review training, embrace multidisciplinary peer review, develop guidelines, and provide incentives and compensation. The authors conclude with suggestions about peer review research.

Outcomes of online support and resources for cancer survivors: a systematic literature review.

PubMed

Hong, Yan; Peña-Purcell, Ninfa C; Ory, Marcia G

2012-03-01

This study aims to review systematically the available literature on health outcomes of online cancer support and resources. We searched major databases with the following selection criteria: (1) empirical study on use of online support or resources by cancer survivors, (2) reporting effects or outcomes of online support or resources, (3) focusing on adult cancer survivors, and (4) peer-reviewed articles published by 2010. A total of 24 studies (37 articles) were included in the review. Most studies were focused on breast cancer survivors and had small sample sizes. Fifteen studies employed a cross-sectional design including eight qualitative studies. Only five studies used pre-post design, and four employed RCT design. The outcome measures have focused on psychosocial effects; most studies reported positive effects, although none of the RCT studies reported significant outcomes. Existing studies of online cancer support and resources have demonstrated preliminary but inconclusive evidence for positive outcomes. We call for additional studies with rigorous study designs and the inclusion of more diverse participants and cancer conditions. Connecting diverse cancer survivors to culturally appropriate, evidence-based online support and resources is a strategy to enhance health outcomes. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

28 CFR 34.106 - Number of peer reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Number of peer reviewers. 34.106 Section 34.106 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.106 Number of peer reviewers. The number of peer reviewers will vary by program (as...

28 CFR 34.106 - Number of peer reviewers.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Number of peer reviewers. 34.106 Section 34.106 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.106 Number of peer reviewers. The number of peer reviewers will vary by program (as...

Peer-assisted learning and orthopaedic evaluation psychomotor skills.

PubMed

Weidner, Thomas G; Popp, Jennifer K

2007-01-01

Athletic training educators often anecdotally suggest that athletic training students enhance their learning by teaching their peers. However, peer-assisted learning (PAL) has not been examined within athletic training education to provide evidence for PAL's current use or for its use as a pedagogic tool. To assess the effectiveness of intentional, formal PAL on the performance of psychomotor skills and to identify students' perceptions of PAL. Randomized, pretest-posttest experimental design. Athletic Training Research and Education Laboratory. Fifty-one undergraduate students (27 athletic training majors, 24 nonmajors). Review sessions led by either an Approved Clinical Instructor or peer tutor. We assessed pretest and posttest performance scores (number of correct skills) and the amount of time to complete the psychomotor skills in 3 categories of orthopaedic evaluation of the hand and wrist for subjects assigned to either a peer tutor or an Approved Clinical Instructor review group. Using the Athletic Training Peer-Assisted Learning Assessment Survey, we evaluated the perceptions of students assigned to the peer-tutor group regarding the benefits of, and preferences for, PAL. Differences in the pretest-posttest skill scores were noted in both groups (P < .05). No differences in the posttest skills scores or the times to perform the skills were seen between the groups. The Athletic Training Peer-Assisted Learning Assessment Survey revealed that most (n = 19, 70.4%) of the subjects felt less anxious when practicing psychomotor skills with peer tutors than with the laboratory instructor, and many students (n = 12, 44.4%) felt more self-confident when practicing psychomotor skills with a peer tutor. Peer-assisted learning appears to be a valid method for improving athletic training psychomotor skills. Peers can be resources for practicing clinical skills and report benefiting from the collaboration. Peer-assisted learning should be deliberately integrated into athletic training education programs to enhance student learning and collaboration.

Do peer review models affect clinicians' trust in journals? A survey of junior doctors.

PubMed

Patel, Jigisha; Pierce, Mary; Boughton, Stephanie L; Baldeweg, Stephanie E

2017-01-01

The aim of this survey was to determine the level of awareness and understanding of peer review and peer review models amongst junior hospital doctors and whether this influences clinical decision-making. A 30-question online anonymous survey was developed aimed at determining awareness of peer review models and the purpose of peer review, perceived trustworthiness of different peer review models and the role of peer review in clinical decision-making. It was sent to 800 trainee doctors in medical specialties on the University College London Partners trainee database. The response rate was (178/800) 22%. Most respondents were specialist registrars. Checking that research is conducted correctly (152/178, 85%) and the data interpreted correctly (148/178, 83%) were viewed as the most important purposes of peer review. Most respondents were aware of open (133/178, 75%), double-blind (125/178, 70%) and single-blind peer review (121/178, 68%). 101/178 (57%) had heard of collaborative, 87/178 (49%) of post publication and 29/178 (16%) of decoupled peer review. Of those who were aware of double-blind, single-blind open and collaborative peer review, 85 (68%), 82 (68%), 74 (56%) and 24 (24%), respectively, understood how they worked. The NEJM , Lancet and The BMJ were deemed to have most trustworthy peer review, 137/178 (77%), 129/178 (72%) and 115/178 (65%), respectively. That peer review had taken place was important for a journal content to be used for clinical decision-making 152/178 (85%), but the ability to see peer review reports was not as important 22/178 (12%). Most felt there was a need for peer review training and that this should be at the specialist registrar stage of training. Junior hospital doctors view peer review to be important as a means of quality control, but do not value the ability to scrutinize peer review themselves. The unquestioning acceptance of peer review as final validation in the field of medicine emphasises not only the responsibility held by medical journals to ensure peer review is done well but also the need to raise awareness amongst the medical community of the limitations of the current peer review process.

Clinical peer review in the United States: history, legal development and subsequent abuse.

PubMed

Vyas, Dinesh; Hozain, Ahmed E

2014-06-07

The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews.

Clinical peer review in the United States: History, legal development and subsequent abuse

PubMed Central

Vyas, Dinesh; Hozain, Ahmed E

2014-01-01

The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews. PMID:24914357

The Influence of Community Health Resources on Effectiveness and Sustainability of Community and Lay Health Worker Programs in Lower-Income Countries: A Systematic Review

PubMed Central

Pool, Robert

2017-01-01

Background Despite the availability of practical knowledge and effective interventions required to reduce priority health problems in low-income countries, poor and vulnerable populations are often not reached. One possible solution to this problem is the use of Community or Lay Health Workers (CLHWs). So far, however, the development of sustainability in CLHW programs has failed and high attrition rates continue to pose a challenge. We propose that the roles and interests which support community health work should emerge directly from the way in which health is organized at community level. This review explores the evidence available to assess if increased levels of integration of community health resources in CLHW programs indeed lead to higher program effectiveness and sustainability. Methods and Findings This review includes peer-reviewed articles which meet three eligibility criteria: 1) specific focus on CLHWs or equivalent; 2) randomized, quasi-randomized, before/after methodology or substantial descriptive assessment; and 3) description of a community or peer intervention health program located in a low- or middle-income country. Literature searches using various article databases led to 2930 hits, of which 359 articles were classified. Of these, 32 articles were chosen for extensive review, complemented by analysis of the results of 15 other review studies. Analysis was conducted using an excel based data extraction form. Because results showed that no quantitative data was published, a descriptive synthesis was conducted. The review protocol was not proactively registered. Findings show minimal inclusion of even basic community level indicators, such as the degree to which the program is a community initiative, community input in the program or training, the background and history of CLHW recruits, and the role of the community in motivation and retention. Results show that of the 32 studies, only one includes one statistical measure of community integration. As a result of this lack of data we are unable to derive an evidence-based conclusion to our propositions. Instead, our results indicate a larger problem, namely the complete absence of indicators measuring community relationships with the programs studied. Studies pay attention only to gender and peer roles, along with limited demographic information about the recruits. The historicity of the health worker and the community s/he belongs to is absent in most studies reviewed. None of the studies discuss or test for the possibility that motivation emanates from the community. Only a few studies situate attrition and retention as an issue enabled by the community. The results were limited by a focus on low-income countries and English, peer-reviewed published articles only. Conclusion Published, peer-reviewed studies evaluating the effectiveness and sustainability of CLHW interventions in health programs have not yet adequately tested for the potential of utilizing existing community health roles or social networks for the development of effective and sustainable (retentive) CLHW programs. Community relationships are generally seen as a “black box” represented by an interchangeable CLHW labor unit. This disconnect from community relationships and resources may have led to a systematic and chronic undervaluing of community agency in explanations of programmatic effectiveness and sustainability. PMID:28095475

Final Independent External Peer Review Report for the Intake Diversion Dam Modification Lower Yellowstone Project, Montana Draft Supplement to the 26 April 2010 Environmental Assessment and Appendices

DTIC Science & Technology

2013-02-08

Fish and Wildlife Service WRDA Water Resources Development Act Intake Project IEPR Final IEPR Report February 8, 2013 x... Wildlife Service (USFWS), Natural Resources Conservation Service (NRCS), Montana Department of Environmental Quality, The Nature Conservancy...30% design features and channel entrance and exit pre-appraisal study to provide fish passage around Intake Dam, Montana. U.S. Fish and Wildlife

Open peer review at four STEM journals: an observational overview.

PubMed

Ford, Emily

2015-01-01

Open peer review, peer review where authors' and reviewers' identities are disclosed to one another, is a growing trend in scholarly publishing. Through observation of four journals in STEM disciplines, PLOS One, Atmospheric Chemistry & Physics, PeerJ, and F1000Research, an observational overview is conducted. The overview relies on defined characteristics of open peer review. Results show that despite differing open peer review implementations, each journal retains editorial involvement in scholarly publishing. Further, the analysis shows that only one of these implementations is fully transparent in its peer review and decision making process. Finally, the overview contends that journals should clearly outline peer review and editorial processes in order to allow for open peer review to be better understood and adopted by authors, reviewers, editors, and readers of science communications.

Economic models for management of resources in peer-to-peer and grid computing

NASA Astrophysics Data System (ADS)

Buyya, Rajkumar; Stockinger, Heinz; Giddy, Jonathan; Abramson, David

2001-07-01

The accelerated development in Peer-to-Peer (P2P) and Grid computing has positioned them as promising next generation computing platforms. They enable the creation of Virtual Enterprises (VE) for sharing resources distributed across the world. However, resource management, application development and usage models in these environments is a complex undertaking. This is due to the geographic distribution of resources that are owned by different organizations or peers. The resource owners of each of these resources have different usage or access policies and cost models, and varying loads and availability. In order to address complex resource management issues, we have proposed a computational economy framework for resource allocation and for regulating supply and demand in Grid computing environments. The framework provides mechanisms for optimizing resource provider and consumer objective functions through trading and brokering services. In a real world market, there exist various economic models for setting the price for goods based on supply-and-demand and their value to the user. They include commodity market, posted price, tenders and auctions. In this paper, we discuss the use of these models for interaction between Grid components in deciding resource value and the necessary infrastructure to realize them. In addition to normal services offered by Grid computing systems, we need an infrastructure to support interaction protocols, allocation mechanisms, currency, secure banking, and enforcement services. Furthermore, we demonstrate the usage of some of these economic models in resource brokering through Nimrod/G deadline and cost-based scheduling for two different optimization strategies on the World Wide Grid (WWG) testbed that contains peer-to-peer resources located on five continents: Asia, Australia, Europe, North America, and South America.

Building Collaboration: A Scoping Review of Cultural Competency and Safety Education and Training for Healthcare Students and Professionals in Canada.

PubMed

Guerra, Olivia; Kurtz, Donna

2017-01-01

Phenomenon: This scoping literature review summarizes current Canadian health science education and training aimed to lessen health gaps between Aboriginal and non-Aboriginal peoples. Keyword searches of peer-reviewed and gray literature databases, websites, and resources recommended by local Aboriginal community members identified 1,754 resources. Using specific inclusion and exclusion criteria, 26 resources relevant to education and training of healthcare professionals and students in Canada were selected. Information included self-assessment for cultural competency/safety skills, advocacy within Canadian healthcare, and descriptions of current programs and training approaches. In spite of increasing awareness and use of cultural competency and safety concepts, few programs have been successfully implemented. Insights: A concerted effort among health science education and training bodies to develop integrated and effective programs could result in comprehensive processes that hasten the Canadian culturally safe healthcare provision, thus reducing the gaps among populations.

Peer review and the publication process.

PubMed

Ali, Parveen Azam; Watson, Roger

2016-10-01

To provide an overview of the peer review process, its various types, selection of peer reviewers, the purpose and significance of the peer review with regard to the assessment and management of quality of publications in academic journals. Discussion paper. This paper draws on information gained from literature on the peer review process and the authors' knowledge and experience of contributing as peer reviewers and editors in the field of health care, including nursing. There are various types of peer review: single blind; double blind; open; and post-publication review. The role of the reviewers in reviewing manuscripts and their contribution to the scientific and academic community remains important.

OHD/HL - National Weather Hydrology Laboratory

Science.gov Websites

resources and services. Design and Programming Standards and Guidelines General Programming C C++ FORTRAN Java v 2.0 updated 3/28/2008 Java v 1.9 Korn and Bash Shell Software Design Phase Guidelines OHD Design Specification Template OHD Design Specification Example Software Peer Review Guidelines and Checklists Software

Stakeholder Engagement Road Map and Peer Review Overview for EPA's Study of the Potential Impacts of Hydraulic Fracturing on Drinking Water Resources

EPA Pesticide Factsheets

This roadmap outlines EPA’s plans to build upon the Agency’s commitment to transparency & stakeholder engagement coordinated during the development of the Hydraulic Fracturing (HF) Study Plan & will help inform the 2014 HF study draft assessment report.

Science, Philosophy & Religion. Working Papers Series Volume 1.

ERIC Educational Resources Information Center

Schenck, David, Ed.

Lehigh University Technology Studies Resource Center has coordinated and produced a series of publications that focus on expanding an understanding of the social context of technology in contemporary society. This volume is the first in a series of working papers that aim to stimulate new research, facilitate dissemination, encourage peer review,…

Evolution of E-Learning Projects: A Creative Experience?

ERIC Educational Resources Information Center

Wakeford, Carol

2011-01-01

e-Learning Projects involve the construction by final year students of e-learning resources in project work. Students are supported in a blended training course in which they acquire appropriate skills and critically review eresources of their peers This paper describes innovations in course design that have lead to the evolution of eresources…

Bystanders Are the Key to Stopping Bullying

ERIC Educational Resources Information Center

Padgett, Sharon; Notar, Charles E.

2013-01-01

Bullying is the dominance over another. Bullying occurs when there is an audience. Peer bystanders provide an audience 85% of instances of bullying. If you remove the audience bullying should stop. The article is a review of literature (2002-2013) on the role of bystanders; importance of bystanders; why bystanders behave as they do; resources to…

The Living Textbook of Nuclear Chemistry: A Peer-Reviewed, Web-Based, Education Resource

ERIC Educational Resources Information Center

Loveland, W.; Gallant, A.; Joiner, C.

2004-01-01

The recent developments in nuclear chemistry education are presented and an attempt is made to collect supplemental materials relating to the study and practice of nuclear chemistry. The Living Textbook of Nuclear Chemistry functions as an authoritative Web site with supplemental material for teaching nuclear and radiochemistry.

MedEdPORTAL: Educational Scholarship for Teaching

ERIC Educational Resources Information Center

Reynolds, Robby J.; Candler, Christopher S.

2008-01-01

MedEdPORTAL is an online publication service provided at no charge by the Association of American Medical Colleges (AAMC). The intent is to promote collaboration and educational scholarship by helping educators publish and share educational resources. With MedEdPORTAL, users can quickly locate high-quality, peer-reviewed teaching materials in both…

Pioneering quality assessment in European cancer centers: a data analysis of the organization for European cancer institutes accreditation and designation program.

PubMed

Saghatchian, Mahasti; Thonon, Frédérique; Boomsma, Femke; Hummel, Henk; Koot, Bert; Harrison, Chris; Rajan, Abinaya; de Valeriola, Dominique; Otter, Renée; Laranja Pontes, José; Lombardo, Claudio; McGrath, Eoin; Ringborg, Ulrik; Tursz, Thomas; van Harten, Wim

2014-09-01

In order to improve the quality of care in Cancer Centers (CC) and designate Comprehensive Cancer Centers (CCCs), the Organization for European Cancer Institutes (OECI) launched an Accreditation and Designation (A&D) program. The program facilitates the collection of defined data and the assessment of cancer center quality. This study analyzes the results of the first 10 European centers that entered the program. The assessment included 927 items divided across qualitative and quantitative questionnaires. Data collected during self-assessment and peer-review from the 10 first participating centers were combined in a database for comparative analysis using simple statistics. Quantitative and qualitative results were validated by auditors during the peer review visits. Volumes of various functions and activities dedicated to care, research, and education varied widely among centers. There were no significant differences in resources for radiology, radiotherapy, pathologic diagnostic, and surgery. Differences were observed in the use of clinical pathways but not for the practices of holding multidisciplinary team meetings and conforming to guidelines. Regarding human resources, main differences were in the composition and number of supportive care and research staff. All 10 centers applied as CCCs; five obtained the label, and five were designated as CCs. The OECI A&D program allows comparisons between centers with regard to management, research, care, education, and designation as CCs or CCCs. Through the peer review system, recommendations for improvements are given. Assessing the added value of the program, as well as research and patient treatment outcomes, is the next step. Copyright © 2014 by American Society of Clinical Oncology.

Talking to children about their HIV status: a review of available resources, tools, and models for improving and promoting pediatric disclosure.

PubMed

Wright, S; Amzel, A; Ikoro, N; Srivastava, M; Leclerc-Madlala, S; Bowsky, S; Miller, H; Phelps, B R

2017-08-01

As children living with HIV (CLHIV) grow into adolescence and adulthood, caregivers and healthcare providers are faced with the sensitive challenge of when to disclose to a CLHIV his or her HIV status. Despite WHO recommendations for CLHIV to know their status, in countries most affected by HIV, effective resources are often limited, and national guidance on disclosure is often lacking. To address the need for effective resources, gray and scientific literature was searched to identify existing tools and resources that can aid in the disclosure process. From peer-reviewed literature, seven disclosure models from six different countries were identified. From the gray literature, 23 resources were identified including children's books (15), job aides to assist healthcare providers (5), and videos (3). While these existing resources can be tailored to reflect local norms and used to aid in the disclosure process, careful consideration must be taken in order to avoid damaging disclosure practices.

NASA SMD and DPS Resources for Higher Education Faculty

NASA Astrophysics Data System (ADS)

Buxner, Sanlyn; Grier, Jennifer; Meinke, Bonnie; Schneider, Nick; Low, Rusty; Schultz, Greg; Manning, James; Fraknoi, Andrew; Gross, Nicholas

2015-11-01

The NASA Education and Public Outreach Forums have developed and provided resources for higher education for the past six years through a cooperative agreement with NASA’s Science Mission Directorate. Collaborations with science organizations, including AAS’s Division of Planetary Sciences, have resulted in more tools, professional training opportunities, and dissemination of resources for teaching in the undergraduate classroom. Resources have been developed through needs assessments of the community and with input from scientists and undergraduate instructors. All resources are freely available.NASA Wavelength (nasawavelength.org) is a collection of digital peer reviewed Earth and space science resources for formal and informal educators of all levels. All resources were developed through funding of the NASA Science Mission Directorate and have undergone a peer-review process through which educators and scientists ensure the content is accurate and useful in an educational setting. Within NASA Wavelength are specific lists of activities and resources for higher education faculty. Additionally, several resources have been developed for introductory college classrooms. The DPS Discovery slide sets are 3-slide presentations that can be incorporated into college lectures to keep classes apprised of the fast moving field of planetary science (http://dps.aas.org/education/dpsdisc). The “Astro 101 slide sets”, developed by the Astro Forum, are presentations 5-7 slides in length on a new development or discovery from a NASA Astrophysics mission relevant to topics in introductory astronomy courses of discoveries not yet in textbooks. Additional resources guides are available for Astro 101 courses and include cosmology and exoplanets. (https://www.astrosociety.org/education/resources-for-the-higher-education-audience/).Professional development opportunities are available to faculty to increase content knowledge and pedagogical tools. These include workshops at scientific meetings and online webinars that are archived for later viewing. For more information, visit the SMD E/PO community workspace at http://smdepo.org.

Organizational Policies and Programs to Reduce Job Stress and Risk of Workplace Violence Among K-12 Education Staff.

PubMed

Landsbergis, Paul; Zoeckler, Jeanette; Kashem, Zerin; Rivera, Bianca; Alexander, Darryl; Bahruth, Amy

2018-02-01

We examine strategies, programs, and policies that educators have developed to reduce work stressors and thus health risks. First, we review twenty-seven empirical studies and review papers on organizational programs and policies in K-12 education published from 1990 to 2015 and find some evidence that mentoring, induction, and Peer Assistance and Review programs can increase support, skill development, decision-making authority, and perhaps job security, for teachers-and thus have the potential to reduce job stressors. Second, we describe efforts to reduce workplace violence in Oregon, especially in special education, including legislation, collective bargaining, research, and public awareness. We conclude that to reduce workplace violence, adequate resources are needed for staffing, training, equipment, injury/assault reporting, and investigation. Third, we discuss collective bargaining initiatives that led to mentoring and Peer Assistance and Review and state legislation on prevention of bullying and harassment of school staff. Finally, we present a research agenda on these issues.

Redefining the Practice of Peer Review Through Intelligent Automation Part 2: Data-Driven Peer Review Selection and Assignment.

PubMed

Reiner, Bruce I

2017-12-01

In conventional radiology peer review practice, a small number of exams (routinely 5% of the total volume) is randomly selected, which may significantly underestimate the true error rate within a given radiology practice. An alternative and preferable approach would be to create a data-driven model which mathematically quantifies a peer review risk score for each individual exam and uses this data to identify high risk exams and readers, and selectively target these exams for peer review. An analogous model can also be created to assist in the assignment of these peer review cases in keeping with specific priorities of the service provider. An additional option to enhance the peer review process would be to assign the peer review cases in a truly blinded fashion. In addition to eliminating traditional peer review bias, this approach has the potential to better define exam-specific standard of care, particularly when multiple readers participate in the peer review process.

Group consensus peer review in radiation oncology: commitment to quality.

PubMed

Duggar, W Neil; Bhandari, Rahul; Yang, Chunli Claus; Vijayakumar, Srinivasan

2018-03-27

Peer review, especially prospective peer review, has been supported by professional organizations as an important element in optimal Radiation Oncology practice based on its demonstration of efficacy at detecting and preventing errors prior to patient treatment. Implementation of peer review is not without barriers, but solutions do exist to mitigate or eliminate some of those barriers. Peer review practice at our institution involves three key elements: new patient conference, treatment planning conference, and chart rounds. The treatment planning conference is an adaptation of the group consensus peer review model from radiology which utilizes a group of peers reviewing each treatment plan prior to implementation. The peer group in radiation oncology includes Radiation Oncologists, Physician Residents, Medical Physicists, Dosimetrists, and Therapists. Thus, technical and clinical aspects of each plan are evaluated simultaneously. Though peer review is held in high regard in Radiation Oncology, many barriers commonly exist preventing optimal implementation such as time intensiveness, repetition, and distraction from clinic time with patients. Through the use of automated review tools and commitment by individuals and administration in regards to staffing, scheduling, and responsibilities, these barriers have been mitigated to implement this Group Consensus Peer Review model into a Radiation Oncology Clinic. A Group Consensus Peer Review model has been implemented with strategies to address common barriers to effective and efficient peer review.

Adolescent Resource Control: Associations with Physical and Relational Aggression, Prosocial and Withdrawn Behaviors, and Peer Regard

ERIC Educational Resources Information Center

Findley, Danielle; Ojanen, Tiina

2013-01-01

This study examined adolescent coercive and prosocial resource control strategies in relation to various indices of peer-reported behaviors and peer regard ("N" = 384; 12-14 years). Coercive control was uniquely positively related to physical and relational aggression and peer disliking, and negatively to prosocial behaviors when…

A digital peer-to-peer learning platform for clinical skills development.

PubMed

Basnak, Jesse; Ortynski, Jennifer; Chow, Meghan; Nzekwu, Emeka

2017-02-01

Due to constraints in time and resources, medical curricula may not provide adequate opportunities for pre-clerkship students to practice clinical skills. To address this, medical students at the University of Alberta developed a digital peer-to-peer learning initiative. The initiative assessed if students can learn clinical skills from their peers in co-curricular practice objective structured clinical exams (OSCEs). A total of 144 first-year medical students participated. Students wrote case scenarios that were reviewed by physicians. Students enacted the cases in practice OSCEs, acting as the patient, physician, and evaluator. Verbal and electronic evaluations were completed. A digital platform was used to automate the process. Surveys were disseminated to assess student perceptions of their experience. Seventy-five percent of participants said they needed opportunities to practice patient histories and physical exams in addition to those provided in the medical school curriculum. All participants agreed that the co-curricular practice OSCEs met this need. The majority of participants also agreed that the digital platform was efficient and easy to use. Students found the practice OSCEs and digital platform effective for learning clinical skills. Thus, peer-to-peer learning and computer automation can be useful adjuncts to traditional medical curricula.

Popularity and Resource Control Goals as Predictors of Adolescent Indirect Aggression.

PubMed

Dyches, Karmon D; Mayeux, Lara

2015-01-01

Resource Control Theory conceptualizes aggression as a behavior that allows access to, and control of, limited resources (P. H. Hawley, 1999 ). This study investigated the associations of adolescents' indirect aggression with their resource control goals, or goals related to controlling social resources such as dating opportunities and peer status, and with their levels of popularity and social intelligence. Participants were 109 seventh-graders (52% girls) who completed a resource control goals measure, the Tromsø Social Intelligence Scale, and peer nominations of popularity and indirect aggression. Results indicated positive associations between resource control goals and peer-nominated indirect aggression, with popularity further moderating these associations. These findings suggest that the resource control goals of adolescents can be a motivating force to engage in hurtful behaviors. They provide a context from which peer relations researchers can improve their understanding and prevention of adolescents' indirect aggression.

Joint Rhythmic Movement Increases 4-Year-Old Children's Prosocial Sharing and Fairness Toward Peers.

PubMed

Rabinowitch, Tal-Chen; Meltzoff, Andrew N

2017-01-01

The allocation of resources to a peer partner is a prosocial act that is of fundamental importance. Joint rhythmic movement, such as occurs during musical interaction, can induce positive social experiences, which may play a role in developing and enhancing young children's prosocial skills. Here, we investigated whether joint rhythmic movement, free of musical context, increases 4-year-olds' sharing and sense of fairness in a resource allocation task involving peers. We developed a precise procedure for administering joint synchronous experience, joint asynchronous experience, and a baseline control involving no treatment. Then we tested how participants allocated resources between self and peer. We found an increase in the generous allocation of resources to peers following both synchronous and asynchronous movement compared to no treatment. At a more theoretical level, this result is considered in relation to previous work testing other aspects of child prosociality, for example, peer cooperation, which can be distinguished from judgments of fairness in resource allocation tasks. We draw a conceptual distinction between two types of prosocial behavior: resource allocation (an other-directed individual behavior) and cooperation (a goal-directed collaborative endeavor). Our results highlight how rhythmic interactions, which are prominent in joint musical engagements and synchronized activity, influence prosocial behavior between preschool peers.

Joint Rhythmic Movement Increases 4-Year-Old Children’s Prosocial Sharing and Fairness Toward Peers

PubMed Central

Rabinowitch, Tal-Chen; Meltzoff, Andrew N.

2017-01-01

The allocation of resources to a peer partner is a prosocial act that is of fundamental importance. Joint rhythmic movement, such as occurs during musical interaction, can induce positive social experiences, which may play a role in developing and enhancing young children’s prosocial skills. Here, we investigated whether joint rhythmic movement, free of musical context, increases 4-year-olds’ sharing and sense of fairness in a resource allocation task involving peers. We developed a precise procedure for administering joint synchronous experience, joint asynchronous experience, and a baseline control involving no treatment. Then we tested how participants allocated resources between self and peer. We found an increase in the generous allocation of resources to peers following both synchronous and asynchronous movement compared to no treatment. At a more theoretical level, this result is considered in relation to previous work testing other aspects of child prosociality, for example, peer cooperation, which can be distinguished from judgments of fairness in resource allocation tasks. We draw a conceptual distinction between two types of prosocial behavior: resource allocation (an other-directed individual behavior) and cooperation (a goal-directed collaborative endeavor). Our results highlight how rhythmic interactions, which are prominent in joint musical engagements and synchronized activity, influence prosocial behavior between preschool peers. PMID:28694786

28 CFR 34.110 - Management of peer reviews.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Management of peer reviews. 34.110 Section 34.110 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.110 Management of peer reviews. A technical support contractor may assist in managing...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2010 CFR

2010-07-01

...” describes a process that evolves in accordance with experience and opportunities to effect improvements. The... Review § 34.102 Peer review procedures. The OJJDP peer review process is contained in an OJJDP “Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

Tools for Scientist Engagement in E/PO: NASA SMD Community Workspace and Online Resources

NASA Astrophysics Data System (ADS)

Dalton, H.; Shipp, S. S.; Grier, J.; Gross, N. A.; Buxner, S.; Bartolone, L.; Peticolas, L. M.; Woroner, M.; Schwerin, T. G.

2014-12-01

The Science Mission Directorate (SMD) Science Education and Public Outreach (E/PO) Forums are here to help you get involved in E/PO! The Forums have been developing several online resources to support scientists who are - or who are interested in becoming - involved in E/PO. These include NASA Wavelength, EarthSpace, and the SMD E/PO online community workspace. NASA Wavelength is the one-stop shop of all peer-reviewed NASA education resources to find materials you - or your audiences - can use. Browse by audience (pre-K through 12, higher education, and informal education) or topic, or choose to search for something specific by keyword and audience. http://nasawavelength.org. EarthSpace, an online clearinghouse of Earth and space materials for use in the higher education classroom, is driven by a powerful search engine that allows you to browse the collection of resources by science topic, audience, type of material or key terms. All materials are peer-reviewed before posting, and because all submissions receive a digital object identifier (doi), submitted materials can be listed as publications. http://www.lpi.usra.edu/earthspace. The SMD E/PO online community workspace contains many resources for scientists. These include one-page guides on how to get involved, tips on how to make the most of your time spent on E/PO, and sample activities, as well as news on funding, policy, and what's happening in the E/PO community. The workspace also provides scientists and the public pathways to find opportunities for participation in E/PO, to learn about SMD E/PO projects and their impacts, to connect with SMD E/PO practitioners, and to explore resources to improve professional E/PO practice, including literature reviews, information about the Next Generation Science Standards, and best practices in evaluation and engaging diverse audiences. http://smdepo.org.

Clinical Nurse Specialists Guide Staff Nurses to Promote Practice Accountability Through Peer Review.

PubMed

Semper, Julie; Halvorson, Betty; Hersh, Mary; Torres, Clare; Lillington, Linda

2016-01-01

The aim of the study was to describe the clinical nurse specialist role in developing and implementing a staff nurse education program to promote practice accountability using peer review principles. Peer review is essential for professional nursing practice demanding a significant culture change. Clinical nurse specialists in a Magnet-designated community hospital were charged with developing a staff nurse peer review education program. Peer review is a recognized mechanism of professional self-regulation to ensure delivery of quality care. The American Nurses Association strongly urges incorporating peer review in professional nursing practice models. Clinical nurse specialists play a critical role in educating staff nurses about practice accountability. Clinical nurse specialists developed an education program guided by the American Nurses Association's principles of peer review. A baseline needs assessment identified potential barriers and learning needs. Content incorporated tools and strategies to build communication skills, collaboration, practice change, and peer accountability. The education program resulted in increased staff nurse knowledge about peer review and application of peer review principles in practice. Clinical nurse specialists played a critical role in helping staff nurses understand peer review and its application to practice. The clinical nurse specialist role will continue to be important in sustaining the application of peer review principles in practice.

The ethics of peer review in bioethics

PubMed Central

Wendler, David; Miller, Franklin

2014-01-01

A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. PMID:24131903

Maximising Benefit from Defence Research: A Review of Defence Research and Technology for Alignment, Quality and Exploitation

DTIC Science & Technology

2006-09-01

exploited and that we get best value for money from our investment. We announced in the Strategy that we had set in place an evidence-based peer review of...currently meets the Department’s needs. The study was also to set a benchmark for future regular reviews of the programme to ensure quality, value for...The level of resources devoted to such research should be seen in the context of the overall value of expenditure flowing from such decisions. The

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 45 Public Welfare 4 2010-10-01 2010-10-01 false Peer review. 1388.9 Section 1388.9 Public Welfare... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review... D, Section 152 of the Act, must be evaluated through the peer review process. (c) Panels must be...

Peer Review in Higher Education: Student Perceptions before and after Participation

ERIC Educational Resources Information Center

Mulder, Raoul A.; Pearce, Jon M.; Baik, Chi

2014-01-01

Peer review is integral to academic endeavour, but opportunities for students to benefit from peer review in higher education remain limited, and relatively little is known about how student perceptions influence their appreciation of peer review. University student perceptions were examined before and after experiencing student peer review in…

Peer Review: Has It a Future?

ERIC Educational Resources Information Center

Soh, Kay Cheng

2013-01-01

Although its history is short, peer review has fast become a fixture of journal publications acquiring the status of a ritual in the academia. Many relevant and important issues have been raised leading to doubts about the value of peer review. The advent of electronic publishing further threatens the future of peer review. For peer review to…

40 CFR 194.27 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 24 2010-07-01 2010-07-01 false Peer review. 194.27 Section 194.27... § 194.27 Peer review. (a) Any compliance application shall include documentation of peer review that has... barrier evaluation as required in § 194.44. (b) Peer review processes required in paragraph (a) of this...

A prospective study on an innovative online forum for peer reviewing of surgical science.

PubMed

Almquist, Martin; von Allmen, Regula S; Carradice, Dan; Oosterling, Steven J; McFarlane, Kirsty; Wijnhoven, Bas

2017-01-01

Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews.

The Effects of Resident Peer- and Self-Chart Review on Outpatient Laboratory Result Follow-up.

PubMed

Hale, Andrew J; Nall, Ryan W; Mukamal, Kenneth J; Libman, Howard; Smith, C Christopher; Sternberg, Scot B; Kim, Hans S; Kriegel, Gila

2016-05-01

Performing and teaching appropriate follow-up of outpatient laboratory results (LRs) is a challenge. The authors tested peer-review among residents as a potentially valuable intervention. Investigators assigned residents to perform self-review (n = 27), peer-review (n = 21), or self- + peer-review (n = 30) of outpatient charts. They also compared residence performance with that of historical controls (n = 20). In September 2012, residents examined 10 LRs from April 2012 onward. A second review in November 2012 ascertained whether performing chart review improved residents' practice behaviors. Initially, the least-square (LS) mean number of LRs without documentation of follow-up per resident in the self-, peer-, and self- + peer-review group was, respectively, 0.5 (SD 1.0), 1.0 (SD 1.7), and 0.9 (SD 1.3), and post intervention, this was 1.0 (SD 0.2), 0.3 (SD 0.2), and 0.6 (SD 0.2) (self- versus peer-review P = .03). Initially the LS mean follow-up time per resident in the self-, peer-, and self- + peer-review group was, respectively, 4.2 (SD 1.2), 6.9 (SD 1.4), and 5.9 (SD 1.2) days, and after the intervention, LS mean time was 5.0 (SD 0.5), 2.5 (SD 0.6), and 3.9 (SD 0.5) days (self- versus peer-review P < .01). Self-review was not associated with significant improvements in practice. In this comparison of self- and peer-review, only residents who performed peer-review demonstrated significant improvements in their documentation practices. These findings support the use of resident peer-review in improving LR follow-up, and potentially, in other, broader resident quality improvement initiatives.

Conservation practices for climate change mitigation and adaptation will be needed for food security in the 21st century

USDA-ARS?s Scientific Manuscript database

It has been documented across the peer-reviewed scientific literature that the challenges that we will have during the XXI century such as climate change, depletion of water resources needed for agricultural production, and higher demand for food and fiber due to a larger global population, will pla...

Dedication and Teamwork Highlight Efforts to Advance Normal Birth

PubMed Central

Humenick, Sharron S.

2006-01-01

The editor of The Journal of Perinatal Education describes the contents of this issue, which offer a broad range of resources, research, and inspiration for childbirth educators in their efforts to promote normal birth. Also, the editor notes the outstanding quality of dedication and teamwork among many who are involved in producing this quarterly, peer-reviewed journal.

Critical Appraisal of Information on the Web in Practice: Undergraduate Students' Knowledge, Reported Use, and Behaviour

ERIC Educational Resources Information Center

Hogan, Neil; Varnhagen, Connie

2012-01-01

Undergraduates use a wide range of information resources for academic and nonacademic purposes, including web sites that range from credible, peer reviewed, online journal sites, to biased and inaccurate promotional web sites. Students are taught basic critical appraisal skills, but do they apply these skills to make decisions about information in…

A prospective study on an innovative online forum for peer reviewing of surgical science

PubMed Central

von Allmen, Regula S.; Carradice, Dan; Oosterling, Steven J.; McFarlane, Kirsty; Wijnhoven, Bas

2017-01-01

Background Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors’ and reviewers’ opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. Methods In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. Results The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Conclusion Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews. PMID:28662046

Variability in Students' Evaluating Processes in Peer Assessment with Calibrated Peer Review

ERIC Educational Resources Information Center

Russell, J.; Van Horne, S.; Ward, A. S.; Bettis, E. A., III; Gikonyo, J.

2017-01-01

This study investigated students' evaluating process and their perceptions of peer assessment when they engaged in peer assessment using Calibrated Peer Review. Calibrated Peer Review is a web-based application that facilitates peer assessment of writing. One hundred and thirty-two students in an introductory environmental science course…

Peer Review as a Strategy for Improving Students' Writing Process

ERIC Educational Resources Information Center

Baker, Kimberly M.

2016-01-01

Peer review is an established strategy for improving the quality of students' writing. This study moves beyond the focus on outcomes to assess the peer-review process. In particular, this study focuses on the timing of the peer review, a highly structured feedback form, and student writers' revisions after engaging in peer review. This study draws…

Designing Peer Review for Pedagogical Success: What Can We Learn from Professional Science?

ERIC Educational Resources Information Center

Trautmann, Nancy M.

2009-01-01

This article compares peer review in professional versus education settings, summarizing key aspects of scientific peer review and reflecting on how these relate to the process as experienced by students. Consideration of professional peer review benefits educators in two ways. First, systems used for student peer review can employ some of the…

34 CFR 350.50 - What is the peer review process for this Program?

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 2 2010-07-01 2010-07-01 false What is the peer review process for this Program? 350... peer review process for this Program? (a) The Secretary refers each application for a grant governed by those regulations in this part to a peer review panel established by the Secretary. (b) Peer review...

The Power of Peer Reviewing to Enhance Writing in Horticulture: Greenhouse Management

ERIC Educational Resources Information Center

Anderson, Neil O.; Flash, Pamela

2014-01-01

Peer review is not included in undergraduate horticultural curricula. Our research objectives in an 8- year study, which ranged from 2000 to 2007 in two sections (2000-2002 non-peer reviewed and 2003-2007 peer-reviewed) of Greenhouse Management students at the University of Minnesota were to determine whether iterative peer reviews would result in…

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 28 Judicial Administration 1 2011-07-01 2011-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 28 Judicial Administration 1 2014-07-01 2014-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 28 Judicial Administration 1 2012-07-01 2012-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

28 CFR 34.102 - Peer review procedures.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer... substantive and procedural matters related to the peer review process, the “Guideline” addresses such issues...

A survey of radiation treatment planning peer-review activities in a provincial radiation oncology programme: current practice and future directions

PubMed Central

Brundage, Michael; Foxcroft, Sophie; McGowan, Tom; Gutierrez, Eric; Sharpe, Michael; Warde, Padraig

2013-01-01

Objectives To describe current patterns of practice of radiation oncology peer review within a provincial cancer system, identifying barriers and facilitators to its use with the ultimate aim of process improvement. Design A survey of radiation oncology programmes at provincial cancer centres. Setting All cancer centres within the province of Ontario, Canada (n=14). These are community-based outpatient facilities overseen by Cancer Care Ontario, the provincial cancer agency. Participants A delegate from each radiation oncology programme filled out a single survey based on input from their multidisciplinary team. Outcome measures Rated importance of peer review; current utilisation; format of the peer-review process; organisation and timing; case attributes; outcomes of the peer-review process and perceived barriers and facilitators to expanding peer-review processes. Results 14 (100%) centres responded. All rated the importance of peer review as at least 8/10 (10=extremely important). Detection of medical error and improvement of planning processes were the highest rated perceived benefits of peer review (each median 9/10). Six centres (43%) reviewed at least 50% of curative cases; four of these centres (29%) conducted peer review in more than 80% of cases treated with curative intent. Fewer than 20% of cases treated with palliative intent were reviewed in most centres. Five centres (36%) reported usually conducting peer review prior to the initiation of treatment. Five centres (36%) recorded the outcomes of peer review on the medical record. Thirteen centres (93%) planned to expand peer-review activities; a critical mass of radiation oncologists was the most important limiting factor (median 6/10). Conclusions Radiation oncology peer-review practices can vary even within a cancer system with provincial oversight. The application of guidelines and standards for peer-review processes, and monitoring of implementation and outcomes, will require effective knowledge translation activities. PMID:23903814

OReFiL: an online resource finder for life sciences.

PubMed

Yamamoto, Yasunori; Takagi, Toshihisa

2007-08-06

Many online resources for the life sciences have been developed and introduced in peer-reviewed papers recently, ranging from databases and web applications to data-analysis software. Some have been introduced in special journal issues or websites with a search function, but others remain scattered throughout the Internet and in the published literature. The searchable resources on these sites are collected and maintained manually and are therefore of higher quality than automatically updated sites, but also require more time and effort. We developed an online resource search system called OReFiL to address these issues. We developed a crawler to gather all of the web pages whose URLs appear in MEDLINE abstracts and full-text papers on the BioMed Central open-access journals. The URLs were extracted using regular expressions and rules based on our heuristic knowledge. We then indexed the online resources to facilitate their retrieval and comparison by researchers. Because every online resource has at least one PubMed ID, we can easily acquire its summary with Medical Subject Headings (MeSH) terms and confirm its credibility through reference to the corresponding PubMed entry. In addition, because OReFiL automatically extracts URLs and updates the index, minimal time and effort is needed to maintain the system. We developed OReFiL, a search system for online life science resources, which is freely available. The system's distinctive features include the ability to return up-to-date query-relevant online resources introduced in peer-reviewed papers; the ability to search using free words, MeSH terms, or author names; easy verification of each hit following links to the corresponding PubMed entry or to papers citing the URL through the search systems of BioMed Central, Scirus, HighWire Press, or Google Scholar; and quick confirmation of the existence of an online resource web page.

OReFiL: an online resource finder for life sciences

PubMed Central

Yamamoto, Yasunori; Takagi, Toshihisa

2007-01-01

Background Many online resources for the life sciences have been developed and introduced in peer-reviewed papers recently, ranging from databases and web applications to data-analysis software. Some have been introduced in special journal issues or websites with a search function, but others remain scattered throughout the Internet and in the published literature. The searchable resources on these sites are collected and maintained manually and are therefore of higher quality than automatically updated sites, but also require more time and effort. Description We developed an online resource search system called OReFiL to address these issues. We developed a crawler to gather all of the web pages whose URLs appear in MEDLINE abstracts and full-text papers on the BioMed Central open-access journals. The URLs were extracted using regular expressions and rules based on our heuristic knowledge. We then indexed the online resources to facilitate their retrieval and comparison by researchers. Because every online resource has at least one PubMed ID, we can easily acquire its summary with Medical Subject Headings (MeSH) terms and confirm its credibility through reference to the corresponding PubMed entry. In addition, because OReFiL automatically extracts URLs and updates the index, minimal time and effort is needed to maintain the system. Conclusion We developed OReFiL, a search system for online life science resources, which is freely available. The system's distinctive features include the ability to return up-to-date query-relevant online resources introduced in peer-reviewed papers; the ability to search using free words, MeSH terms, or author names; easy verification of each hit following links to the corresponding PubMed entry or to papers citing the URL through the search systems of BioMed Central, Scirus, HighWire Press, or Google Scholar; and quick confirmation of the existence of an online resource web page. PMID:17683589

28 CFR 34.108 - Selection of reviewers.

Code of Federal Regulations, 2010 CFR

2010-07-01

....108 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.108 Selection of reviewers. The Program Manager, through the Director of the OJJDP program... by the Administrator. The selection process for peer reviewers is detailed in the OJJDP “Peer Review...

Working toward equitable opportunities for science students with disabilities: using professional development and technology.

PubMed

Bargerhuff, Mary Ellen; Cowan, Heidi; Kirch, Susan A

2010-01-01

As a result of federal legislation, adolescents with disabilities and other exceptionalities are increasingly included in science and math classes alongside their peers who are typically developing. The effectiveness of this placement option, however, is largely dependent on the skill level of the general educator and the support afforded to this teacher through various channels. Efforts arising from two National Science Foundation grants address both skill and support. Center's Lesson Adaptations for Student Success (CLASS) project used summer professional development opportunities to equip teachers with the knowledge and skills needed to provide students with physical, sensory and learning disabilities equitable access to laboratory and field experiences. Second, to support teachers back in their classrooms, the Ohio Resource Center's Lesson Adaptations for Student Success (OR-CLASS) uses web resources to share high quality, peer-reviewed lesson plans, complete with specific recommendations on adaptations for students with a variety of exceptional learning needs.

Building a Data Science capability for USGS water research and communication

NASA Astrophysics Data System (ADS)

Appling, A.; Read, E. K.

2015-12-01

Interpreting and communicating water issues in an era of exponentially increasing information requires a blend of domain expertise, computational proficiency, and communication skills. The USGS Office of Water Information has established a Data Science team to meet these needs, providing challenging careers for diverse domain scientists and innovators in the fields of information technology and data visualization. Here, we detail the experience of building a Data Science capability as a bridging element between traditional water resources analyses and modern computing tools and data management techniques. This approach includes four major components: 1) building reusable research tools, 2) documenting data-intensive research approaches in peer reviewed journals, 3) communicating complex water resources issues with interactive web visualizations, and 4) offering training programs for our peers in scientific computing. These components collectively improve the efficiency, transparency, and reproducibility of USGS data analyses and scientific workflows.

7 CFR 3400.21 - Scientific peer review for research activities.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 7 Agriculture 15 2011-01-01 2011-01-01 false Scientific peer review for research activities. 3400... § 3400.21 Scientific peer review for research activities. Scientific peer review is an evaluation of a... with the scientific knowledge and technical skills to conduct the proposed research work. Peer...

Peer Review in Scientific Publications: Benefits, Critiques, & A Survival Guide

PubMed Central

Kelly, Jacalyn; Sadeghieh, Tara

2014-01-01

Peer review has been defined as a process of subjecting an author’s scholarly work, research or ideas to the scrutiny of others who are experts in the same field. It functions to encourage authors to meet the accepted high standards of their discipline and to control the dissemination of research data to ensure that unwarranted claims, unacceptable interpretations or personal views are not published without prior expert review. Despite its wide-spread use by most journals, the peer review process has also been widely criticised due to the slowness of the process to publish new findings and due to perceived bias by the editors and/or reviewers. Within the scientific community, peer review has become an essential component of the academic writing process. It helps ensure that papers published in scientific journals answer meaningful research questions and draw accurate conclusions based on professionally executed experimentation. Submission of low quality manuscripts has become increasingly prevalent, and peer review acts as a filter to prevent this work from reaching the scientific community. The major advantage of a peer review process is that peer-reviewed articles provide a trusted form of scientific communication. Since scientific knowledge is cumulative and builds on itself, this trust is particularly important. Despite the positive impacts of peer review, critics argue that the peer review process stifles innovation in experimentation, and acts as a poor screen against plagiarism. Despite its downfalls, there has not yet been a foolproof system developed to take the place of peer review, however, researchers have been looking into electronic means of improving the peer review process. Unfortunately, the recent explosion in online only/electronic journals has led to mass publication of a large number of scientific articles with little or no peer review. This poses significant risk to advances in scientific knowledge and its future potential. The current article summarizes the peer review process, highlights the pros and cons associated with different types of peer review, and describes new methods for improving peer review. PMID:27683470

Random Versus Nonrandom Peer Review: A Case for More Meaningful Peer Review.

PubMed

Itri, Jason N; Donithan, Adam; Patel, Sohil H

2018-05-10

Random peer review programs are not optimized to discover cases with diagnostic error and thus have inherent limitations with respect to educational and quality improvement value. Nonrandom peer review offers an alternative approach in which diagnostic error cases are targeted for collection during routine clinical practice. The objective of this study was to compare error cases identified through random and nonrandom peer review approaches at an academic center. During the 1-year study period, the number of discrepancy cases and score of discrepancy were determined from each approach. The nonrandom peer review process collected 190 cases, of which 60 were scored as 2 (minor discrepancy), 94 as 3 (significant discrepancy), and 36 as 4 (major discrepancy). In the random peer review process, 1,690 cases were reviewed, of which 1,646 were scored as 1 (no discrepancy), 44 were scored as 2 (minor discrepancy), and none were scored as 3 or 4. Several teaching lessons and quality improvement measures were developed as a result of analysis of error cases collected through the nonrandom peer review process. Our experience supports the implementation of nonrandom peer review as a replacement to random peer review, with nonrandom peer review serving as a more effective method for collecting diagnostic error cases with educational and quality improvement value. Copyright © 2018 American College of Radiology. Published by Elsevier Inc. All rights reserved.

The Impact of Peer Review on Writing in a Psychology Course: Lessons Learned

ERIC Educational Resources Information Center

Bhullar, Naureen; Rose, Karen C.; Utell, Janine M.; Healey, Kathryn N.

2014-01-01

The authors assessed the impact of peer review on student writing in four sections of an undergraduate Developmental Psychology course. They hypothesized that peer review would result in better writing in the peer review group compared to the group with no peer review. Writing was rated independently by two instructors who were blind to the…

28 CFR 34.111 - Compensation.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.111 Compensation. All peer reviewers will be eligible to be paid according to applicable regulations... provided in the OJJDP “Peer Review Guideline”. ...

Total Risk Integrated Methodology (TRIM) - Peer Review and Publications

EPA Pesticide Factsheets

Peer review: Consistent with Agency peer review policy, and the 1994 Agency Task Force on Environmental Regulatory Modeling, internal and external peer review has been an integral part of the TRIM development plan.

Scholarly publishing depends on peer reviewers.

PubMed

Fernandez-Llimos, Fernando

2018-01-01

The peer-review crisis is posing a risk to the scholarly peer-reviewed journal system. Journals have to ask many potential peer reviewers to obtain a minimum acceptable number of peers accepting reviewing a manuscript. Several solutions have been suggested to overcome this shortage. From reimbursing for the job, to eliminating pre-publication reviews, one cannot predict which is more dangerous for the future of scholarly publishing. And, why not acknowledging their contribution to the final version of the article published? PubMed created two categories of contributors: authors [AU] and collaborators [IR]. Why not a third category for the peer-reviewer?

How long is too long in contemporary peer review? Perspectives from authors publishing in conservation biology journals.

PubMed

Nguyen, Vivian M; Haddaway, Neal R; Gutowsky, Lee F G; Wilson, Alexander D M; Gallagher, Austin J; Donaldson, Michael R; Hammerschlag, Neil; Cooke, Steven J

2015-01-01

Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academics as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to a total of 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time is six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. Majority of participants attributed lengthy review times to the 'stress' on the peer-review system (i.e., reviewer and editor fatigue), while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times appear to be greater for early career researchers and can also have impact on author morale (e.g. motivation or frustration). Competition among colleagues were also of concern to respondents. Incentivizing peer review was among the top suggested alterations to the system along with training graduate students in peer review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study view the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer review models.

The ethics of peer review in bioethics.

PubMed

Wendler, David; Miller, Franklin

2014-10-01

A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Medical journal peer review: process and bias.

PubMed

Manchikanti, Laxmaiah; Kaye, Alan D; Boswell, Mark V; Hirsch, Joshua A

2015-01-01

Scientific peer review is pivotal in health care research in that it facilitates the evaluation of findings for competence, significance, and originality by qualified experts. While the origins of peer review can be traced to the societies of the eighteenth century, it became an institutionalized part of the scholarly process in the latter half of the twentieth century. This was a response to the growth of research and greater subject specialization. With the current increase in the number of specialty journals, the peer review process continues to evolve to meet the needs of patients, clinicians, and policy makers. The peer review process itself faces challenges. Unblinded peer review might suffer from positive or negative bias towards certain authors, specialties, and institutions. Peer review can also suffer when editors and/or reviewers might be unable to understand the contents of the submitted manuscript. This can result in an inability to detect major flaws, or revelations of major flaws after acceptance of publication by the editors. Other concerns include potentially long delays in publication and challenges uncovering plagiarism, duplication, corruption and scientific misconduct. Conversely, a multitude of these challenges have led to claims of scientific misconduct and an erosion of faith. These challenges have invited criticism of the peer review process itself. However, despite its imperfections, the peer review process enjoys widespread support in the scientific community. Peer review bias is one of the major focuses of today's scientific assessment of the literature. Various types of peer review bias include content-based bias, confirmation bias, bias due to conservatism, bias against interdisciplinary research, publication bias, and the bias of conflicts of interest. Consequently, peer review would benefit from various changes and improvements with appropriate training of reviewers to provide quality reviews to maintain the quality and integrity of research without bias. Thus, an appropriate, transparent peer review is not only ideal, but necessary for the future to facilitate scientific progress.

Peer Review and the Assessment of Higher Education Quality: An International Perspective. Higher Education Report No. 3.

ERIC Educational Resources Information Center

Brennan, John; And Others

This report examines the practices of 19 peer review agencies in the United States, Britain, Denmark, Germany, France, the Netherlands, and Hong Kong to determine variations in peer review in the field of higher education. The report addresses: (1) the sources of authority for peer review; (2) the types and status of peer reviewers; (3) the…

Challenges of Human Papillomavirus Infection and Associated Diseases in Low-Resource Countries.

PubMed

Nweke, Michael Chukwugoziem; Okolo, Clement Abu; Daous, Yara; Esan, Olukemi Ayotunde

2018-06-01

- The prevalence of human papillomavirus (HPV) infection varies worldwide. The high-risk viruses are usually associated with cancers of the cervix, vagina, and vulva in women, cancer of the penis in men, and cancers of the anus, tonsils, oropharynx, and base of the tongue in both sexes. - To review literature about the challenges and burden associated with HPV infection in low-resource (ie, developing) countries, focusing on sub-Saharan Africa. To review the prevention, incidence, prevalence, morbidity, and mortality of HPV infections in sub-Saharan Africa. To review the therapy and management of HPV infections in low-resource countries in comparison to developed countries. - Peer-reviewed literature and experience of some of the authors. - Sub-Saharan Africa has high HPV infection prevalence rates, with predominance of high-risk subtypes 16, 18, and 45. The difficulty of access to health care has led to higher morbidity and mortality related to HPV-related cancers. Improvement in screening programs will help in monitoring the spread of HPV infections. Survival studies can be more informative if reliable cancer registries are improved. HPV vaccination is not yet widely available and this may be the key to curtailing the spread of HPV infections in resource-poor countries.

Re-Viewing Peer Review

ERIC Educational Resources Information Center

Flynn, Elizabeth A.

2011-01-01

In this article, the author revisits her essay, "Students as Readers of Their Classmates' Writing," by providing a review of the literature on peer review over the past three decades and comments on patterns she sees in waves of peer review research and theorizing. She describes her subsequent experience with peer review in her own classes, and…

Comparison of self-citation by peer reviewers in a journal with single-blind peer review versus a journal with open peer review.

PubMed

Levis, Alexander W; Leentjens, Albert F G; Levenson, James L; Lumley, Mark A; Thombs, Brett D

2015-12-01

Some peer reviewers may inappropriately, or coercively request that authors include references to the reviewers' own work. The objective of this study was to evaluate whether, compared to reviews for a journal with single-blind peer review, reviews for a journal with open peer review included (1) fewer self-citations; (2) a lower proportion of self-citations without a rationale; and (3) a lower ratio of proportions of citations without a rationale in self-citations versus citations to others' work. Peer reviews for published manuscripts submitted in 2012 to a single-blind peer review journal, the Journal of Psychosomatic Research, were previously evaluated (Thombs et al., 2015). These were compared to publically available peer reviews of manuscripts published in 2012 in an open review journal, BMC Psychiatry. Two investigators independently extracted data for both journals. There were no significant differences between journals in the proportion of all reviewer citations that were self-citations (Journal of Psychosomatic Research: 71/225, 32%; BMC Psychiatry: 90/315, 29%; p=.50), or in the proportion of self-citations without a rationale (Journal of Psychosomatic Research: 15/71, 21%; BMC Psychiatry: 12/90, 13%; p=.21). There was no significant difference between journals in the proportion of self-citations versus citations to others' work without a rationale (p=.31). Blind and open peer review methodologies have distinct advantages and disadvantages. The present study found that, in reasonably similar journals that use single-blind and open review, there were no substantive differences in the pattern of peer reviewer self-citations. Copyright © 2015 Elsevier Inc. All rights reserved.

Advancing Kinesiology through Improved Peer Review

ERIC Educational Resources Information Center

Knudson, Duane V.; Morrow, James R., Jr.; Thomas, Jerry R.

2014-01-01

Peer review of scholarship is essential to journal quality, evidence, knowledge advancement, and application of that knowledge in any field. This commentary summarizes recent literature on issues related to peer-review quality and current review practice in kinesiology and provides recommendations to improve peer review in kinesiology journals. We…

Securing Resources in Collaborative Environments: A Peer-to-peerApproach

DOE Office of Scientific and Technical Information (OSTI.GOV)

Berket, Karlo; Essiari, Abdelilah; Thompson, Mary R.

2005-09-19

We have developed a security model that facilitates control of resources by autonomous peers who act on behalf of collaborating users. This model allows a gradual build-up of trust. It enables secure interactions among users that do not necessarily know each other and allows them to build trust over the course of their collaboration. This paper describes various aspects of our security model and describes an architecture that implements this model to provide security in pure peer-to-peer environments.

Demystifying the peer-review process - workshop

EPA Science Inventory

Scientific writing and peer-review are integral parts of the publishing process. This workshop aims to demystify the peer-review process for early career scientists and provide insightful tips for streamlining the submission and peer review process for all researchers. Providing ...

Academic Primer Series: Key Papers About Peer Review.

PubMed

Yarris, Lalena M; Gottlieb, Michael; Scott, Kevin; Sampson, Christopher; Rose, Emily; Chan, Teresa M; Ilgen, Jonathan

2017-06-01

Peer review, a cornerstone of academia, promotes rigor and relevance in scientific publishing. As educators are encouraged to adopt a more scholarly approach to medical education, peer review is becoming increasingly important. Junior educators both receive the reviews of their peers, and are also asked to participate as reviewers themselves. As such, it is imperative for junior clinician educators to be well-versed in the art of peer reviewing their colleagues' work. In this article, our goal was to identify and summarize key papers that may be helpful for faculty members interested in learning more about the peer-review process and how to improve their reviewing skills. The online discussions of the 2016-17 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program included a robust discussion about peer review, which highlighted a number of papers on that topic. We sought to augment this list with further suggestions by guest experts and by an open call on Twitter for other important papers. Via this process, we created a list of 24 total papers on the topic of peer review. After gathering these papers, our authorship group engaged in a consensus-building process incorporating Delphi methods to identify the papers that best described peer review, and also highlighted important tips for new reviewers. We found and reviewed 24 papers. In our results section, we present our authorship group's top five most highly rated papers on the topic of peer review. We also summarize these papers with respect to their relevance to junior faculty members and to faculty developers. We present five key papers on peer review that can be used for faculty development for novice writers and reviewers. These papers represent a mix of foundational and explanatory papers that may provide some basis from which junior faculty members might build upon as they both undergo the peer-review process and act as reviewers in turn.

Academic Primer Series: Key Papers About Peer Review

PubMed Central

Yarris, Lalena M.; Gottlieb, Michael; Scott, Kevin; Sampson, Christopher; Rose, Emily; Chan, Teresa M.; Ilgen, Jonathan

2017-01-01

Introduction Peer review, a cornerstone of academia, promotes rigor and relevance in scientific publishing. As educators are encouraged to adopt a more scholarly approach to medical education, peer review is becoming increasingly important. Junior educators both receive the reviews of their peers, and are also asked to participate as reviewers themselves. As such, it is imperative for junior clinician educators to be well-versed in the art of peer reviewing their colleagues’ work. In this article, our goal was to identify and summarize key papers that may be helpful for faculty members interested in learning more about the peer-review process and how to improve their reviewing skills. Methods The online discussions of the 2016–17 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program included a robust discussion about peer review, which highlighted a number of papers on that topic. We sought to augment this list with further suggestions by guest experts and by an open call on Twitter for other important papers. Via this process, we created a list of 24 total papers on the topic of peer review. After gathering these papers, our authorship group engaged in a consensus-building process incorporating Delphi methods to identify the papers that best described peer review, and also highlighted important tips for new reviewers. Results We found and reviewed 24 papers. In our results section, we present our authorship group’s top five most highly rated papers on the topic of peer review. We also summarize these papers with respect to their relevance to junior faculty members and to faculty developers. Conclusion We present five key papers on peer review that can be used for faculty development for novice writers and reviewers. These papers represent a mix of foundational and explanatory papers that may provide some basis from which junior faculty members might build upon as they both undergo the peer-review process and act as reviewers in turn. PMID:28611894

Tools for Implementing Science Practice in a Large Introductory Class

NASA Astrophysics Data System (ADS)

Prothero, W. A.

2008-12-01

Scientists must have in-depth background knowledge of their subject area and know where current knowledge can be advanced. They perform experiments that gather data to test new or existing theories, present their findings at meetings, publish their results, critically review the results of others, and respond to the reviews of their own work. In the context of a course, these activities correspond to learning the background material by listening to lectures or reading a text, formulating a problem, exploring data using student friendly data access and plotting software, giving brief talks to classmates in a small class or lab setting, writing a science paper or lab report, reviewing the writing of their peers, and receiving feedback (and grades) from their instructors and/or peers. These activities can be supported using course management software and online resources. The "LearningWithData" software system allows solid Earth (focused on plate tectonics) data exploration and plotting. Ocean data access, display, and plotting are also supported. Background material is delivered using animations and slide show type displays. Students are accountable for their learning through included homework assignments. Lab and small group activities provide support for data exploration and interpretation. Writing is most efficiently implemented using the "Calibrated Peer Review" method. This methodology is available at http://cpr.molsci.ucla.edu/. These methods have been successfully implemented in a large oceanography class at UCSB.

Paired peer review of university classroom teaching in a school of nursing and midwifery.

PubMed

Bennett, Paul N; Parker, Steve; Smigiel, Heather

2012-08-01

Peer review of university classroom teaching can increase the quality of teaching but is not universally practiced in Australian universities. To report an evaluation of paired peer-review process using both paper and web based teaching evaluation tools. Twenty university teachers in one metropolitan Australian School of Nursing and Midwifery were randomly paired and then randomly assigned to a paper based or web-based peer review tool. Each teacher reviewed each other's classroom teaching as part of a peer review program. The participants then completed an 18 question survey evaluating the peer review tool and paired evaluation process. Responses were analyzed using frequencies and percentages. Regardless of the tool used, participants found this process of peer review positive (75%), collegial (78%), supportive (61%) and non-threatening (71%). Participants reported that the peer review will improve their own classroom delivery (61%), teaching evaluation (61%) and planning (53%). The web-based tool was found to be easier to use and allowed more space than the paper-based tool. Implementation of a web-based paired peer review system can be a positive method of peer review of university classroom teaching. Pairing of teachers to review each other's classroom teaching is a promising strategy and has the potential to improve teaching in teaching universities. Copyright © 2011 Elsevier Ltd. All rights reserved.

"I sleep better at night:" How peer review of radiation treatment plans indirectly improves quality of care across radiation treatment programs.

PubMed

Brundage, Michael D; Hart, Margaret; O'Donnell, Jennifer; Reddeman, Lindsay; Gutierrez, Eric; Foxcroft, Sophie; Warde, Padraig

Peer review of radiation oncology treatment plans is increasingly recognized as an important component of quality assurance in radiation treatment planning and delivery. Peer review of treatment plans can directly improve the quality of those plans and can also have indirect effects on radiation treatment programs. We undertook a systematic, qualitative approach to describing the indirect benefits of peer review, factors that were seen to facilitate or act as barriers to the implementation of peer review, and strategies to address these barriers across a provincial jurisdiction of radiation oncology programs (ROPs). Semistructured qualitative interviews were held with radiation oncology department heads and radiation therapy managers (or delegates) in all 14 ROPs in Ontario, Canada. We used a theoretically guided phenomenological qualitative approach to design and analyze the interview content. Themes were recorded by 2 independent reviewers, and any discordance was resolved by consensus. A total of 28 interviews were completed with 32 interviewees. Twenty-two unique themes addressed perceived benefits of peer review, relating to either peer review structure (n = 3), process (n = 9), or outcome (n = 10). Of these 22 themes, 19 related to indirect benefits to ROPs. In addition, 18 themes related to factors that facilitated peer review activities and 30 themes related to key barriers to implementing peer review were identified. Findings were consistent with, and enhanced the understanding of, previous survey-based assessments of the benefits and challenges of implementing peer review programs. Although challenges and concerns regarding the implementation of peer review were evident, the indirect benefits to radiation programs are numerous, far outweigh the implementation challenges, and strongly complement the direct individual-patient benefits that result from peer review quality assurance of radiation treatment plans. Copyright © 2016. Published by Elsevier Inc.

Peer review versus editorial review and their role in innovative science.

PubMed

Steinhauser, Georg; Adlassnig, Wolfram; Risch, Jesaka Ahau; Anderlini, Serena; Arguriou, Petros; Armendariz, Aaron Zolen; Bains, William; Baker, Clark; Barnes, Martin; Barnett, Jonathan; Baumgartner, Michael; Baumgartner, Thomas; Bendall, Charles A; Bender, Yvonne S; Bichler, Max; Biermann, Teresa; Bini, Ronaldo; Blanco, Eduardo; Bleau, John; Brink, Anthony; Brown, Darin; Burghuber, Christopher; Calne, Roy; Carter, Brian; Castaño, Cesar; Celec, Peter; Celis, Maria Eugenia; Clarke, Nicky; Cockrell, David; Collins, David; Coogan, Brian; Craig, Jennifer; Crilly, Cal; Crowe, David; Csoka, Antonei B; Darwich, Chaza; Del Kebos, Topiciprin; Derinaldi, Michele; Dlamini, Bongani; Drewa, Tomasz; Dwyer, Michael; Eder, Fabienne; de Palma, Raúl Ehrichs; Esmay, Dean; Rött, Catherine Evans; Exley, Christopher; Falkov, Robin; Farber, Celia Ingrid; Fearn, William; Felsmann, Sophie; Flensmark, Jarl; Fletcher, Andrew K; Foster, Michaela; Fountoulakis, Kostas N; Fouratt, Jim; Blanca, Jesus Garcia; Sotelo, Manuel Garrido; Gittler, Florian; Gittler, Georg; Gomez, Juan; Gomez, Juan F; Polar, Maria Grazia Gonzales; Gonzalez, Jossina; Gösselsberger, Christoph; Habermacher, Lynn; Hajek, Michael; Hakala, Faith; Haliburton, Mary-Sue; Hankins, John Robert; Hart, Jason; Hasslberger, Sepp; Hennessey, Donalyn; Herrmann, Andrea; Hersee, Mike; Howard, Connie; Humphries, Suzanne; Isharc, Laeeth; Ivanovski, Petar; Jenuth, Stephen; Jerndal, Jens; Johnson, Christine; Keleta, Yonas; Kenny, Anna; Kidd, Billie; Kohle, Fritz; Kolahi, Jafar; Koller-Peroutka, Marianne; Kostova, Lyubov; Kumar, Arunachalam; Kurosawa, Alejandro; Lance, Tony; Lechermann, Michael; Lendl, Bernhard; Leuchters, Michael; Lewis, Evan; Lieb, Edward; Lloyd, Gloria; Losek, Angelika; Lu, Yao; Maestracci, Saadia; Mangan, Dennis; Mares, Alberto W; Barnett, Juan Mazar; McClain, Valerie; McNair, John Sydney; Michael, Terry; Miller, Lloyd; Monzani, Partizia; Moran, Belen; Morris, Mike; Mößmer, Georg; Mountain, Johny; Phuthe, Onnie Mary Moyo; Muñoz, Marcos; Nakken, Sheri; Wambui, Anne Nduta; Neunteufl, Bettina; Nikolić, Dimitrije; Oberoi, Devesh V; Obmode, Gregory; Ogar, Laura; Ohara, Jo; Rybine, Naion Olej; Owen, Bryan; Owen, Kim Wilson; Parikh, Rakesh; Pearce, Nicholas J G; Pemmer, Bernhard; Piper, Chris; Prince, Ian; Reid, Terence; Rindermann, Heiner; Risch, Stefan; Robbins, Josh; Roberts, Seth; Romero, Ajeandro; Rothe, Michael Thaddäus; Ruiz, Sergio; Sacher, Juliane; Sackl, Wolfgang; Salletmaier, Markus; Sanand, Jairaj; Sauerzopf, Clemens; Schwarzgruber, Thomas; Scott, David; Seegers, Laura; Seppi, David; Shields, Kyle; Siller-Matula, Jolanta; Singh, Beldeu; Sithole, Sibusio; Six, Florian; Skoyles, John R; Slofstra, Jildou; Sole, Daphne Anne; Sommer, Werner F; Sonko, Mels; Starr-Casanova, Chrislie J; Steakley, Marjorie Elizabeth; Steinhauser, Wolfgang; Steinhoff, Konstantin; Sterba, Johannes H; Steppan, Martin; Stindl, Reinhard; Stokely, Joe; Stokely, Karri; St-Pierre, Gilles; Stratford, James; Streli, Christina; Stryg, Carl; Sullivan, Mike; Summhammer, Johann; Tadesse, Amhayes; Tavares, David; Thompson, Laura; Tomlinson, Alison; Tozer, Jack; Trevisanato, Siro I; Trimmel, Michaela; Turner, Nicole; Vahur, Paul; van der Byl, Jennie; van der Maas, Tine; Varela, Leo; Vega, Carlos A; Vermaak, Shiloh; Villasenor, Alex; Vogel, Matt; von Wintzigerode, Georg; Wagner, Christoph; Weinberger, Manuel; Weinberger, Peter; Wilson, Nick; Wolfe, Jennifer Finocchio; Woodley, Michael A; Young, Ian; Zuraw, Glenn; Zwiren, Nicole

2012-10-01

Peer review is a widely accepted instrument for raising the quality of science. Peer review limits the enormous unstructured influx of information and the sheer amount of dubious data, which in its absence would plunge science into chaos. In particular, peer review offers the benefit of eliminating papers that suffer from poor craftsmanship or methodological shortcomings, especially in the experimental sciences. However, we believe that peer review is not always appropriate for the evaluation of controversial hypothetical science. We argue that the process of peer review can be prone to bias towards ideas that affirm the prior convictions of reviewers and against innovation and radical new ideas. Innovative hypotheses are thus highly vulnerable to being "filtered out" or made to accord with conventional wisdom by the peer review process. Consequently, having introduced peer review, the Elsevier journal Medical Hypotheses may be unable to continue its tradition as a radical journal allowing discussion of improbable or unconventional ideas. Hence we conclude by asking the publisher to consider re-introducing the system of editorial review to Medical Hypotheses.

The Nanchang communication about the potential for the implementation of conservation practices for climate change mitigation and adaptation to achieve food security in the 21st century

USDA-ARS?s Scientific Manuscript database

Several recent peer reviewed manuscripts have reported on the great challenges humanity is confronting during the XXI century, including a changing climate, depletion of water resources from groundwater and/or snow caps sources that are needed for agricultural production, deforestation, desertificat...

A digital library of radiology images.

PubMed

Kahn, Charles E

2006-01-01

A web-based virtual library of peer-reviewed radiological images was created for use in education and clinical decision support. Images were obtained from open-access content of five online radiology journals and one e-learning web site. Figure captions were indexed by Medical Subject Heading (MeSH) codes, imaging modality, and patient age and sex. This digital library provides a new, valuable online resource.

Development and validation of a nursing professionalism evaluation model in a career ladder system.

PubMed

Kim, Yeon Hee; Jung, Young Sun; Min, Ja; Song, Eun Young; Ok, Jung Hui; Lim, Changwon; Kim, Kyunghee; Kim, Ji-Su

2017-01-01

The clinical ladder system categorizes the degree of nursing professionalism and rewards and is an important human resource tool for managing nursing. We developed a model to evaluate nursing professionalism, which determines the clinical ladder system levels, and verified its validity. Data were collected using a clinical competence tool developed in this study, and existing methods such as the nursing professionalism evaluation tool, peer reviews, and face-to-face interviews to evaluate promotions and verify the presented content in a medical institution. Reliability and convergent and discriminant validity of the clinical competence evaluation tool were verified using SmartPLS software. The validity of the model for evaluating overall nursing professionalism was also analyzed. Clinical competence was determined by five dimensions of nursing practice: scientific, technical, ethical, aesthetic, and existential. The structural model explained 66% of the variance. Clinical competence scales, peer reviews, and face-to-face interviews directly determined nursing professionalism levels. The evaluation system can be used for evaluating nurses' professionalism in actual medical institutions from a nursing practice perspective. A conceptual framework for establishing a human resources management system for nurses and a tool for evaluating nursing professionalism at medical institutions is provided.

On the evolving open peer review culture for chemical information science.

PubMed

Walters, W Patrick; Bajorath, Jürgen

2015-01-01

Compared to the traditional anonymous peer review process, open post-publication peer review provides additional opportunities -and challenges- for reviewers to judge scientific studies. In this editorial, we comment on the open peer review culture and provide some guidance for reviewers of manuscripts submitted to the Chemical Information Science channel of F1000Research.

A novel approach to quality improvement in a safety-net practice: concurrent peer review visits.

PubMed

Fiscella, Kevin; Volpe, Ellen; Winters, Paul; Brown, Melissa; Idris, Amna; Harren, Tricia

2010-12-01

Concurrent peer review visits are structured office visits conducted by clinician peers of the primary care clinician that are specifically designed to reduce competing demands, clinical inertia, and bias. We assessed whether a single concurrent peer review visit reduced clinical inertia and improved control of hypertension, hyperlipidemia, and diabetes control among underserved patients. We conducted a randomized encouragement trial to evaluate concurrent peer review visits with a community health center. Seven hundred twenty-seven patients with hypertension, hyperlipidemia, and/or diabetes who were not at goal for systolic blood pressure (SBP), low-density lipoprotein cholesterol (LDL-C), and/or glycated hemoglobin (A1c) were randomly assigned to an invitation to participate in a concurrent peer review visit or to usual care. We compared change in these measures using mixed models and rates of therapeutic intensification during concurrent peer review visits with control visits. One hundred seventy-one patients completed a concurrent peer review visit. SBP improved significantly (p < .01) more among those completing concurrent peer review visits than among those who failed to respond to a concurrent peer review invitation or those randomized to usual care. There were no differences seen for changes in LDL-C or A1c. Concurrent peer review visits were associated with statistically significant greater clinician intensification of blood pressure (p < .001), lipid (p < .001), and diabetes (p < .005) treatment than either for control visits for patients in either the nonresponse group or usual care group. Concurrent peer review visits represent a promising strategy for improving blood pressure control and improving therapeutic intensification in community health centers.

Peering is not a formal indicator of subordination in bonobos (Pan paniscus).

PubMed

Stevens, Jeroen M G; Vervaecke, Hilde; De Vries, Han; Van Elsacker, Linda

2005-03-01

It has been suggested that peering behavior in bonobos is a formal signal acknowledging social dominance status. We investigated whether peering meets the published criteria for a formal signal of subordination in five captive groups of bonobos. The degree of linearity in the set of peering relationships was significantly high in all study groups, and a linear rank order was found. However, unidirectionality was low, and there was little correspondence between the peering order and the agonistic dominance rank. Therefore, peering does not satisfy the criteria of a formal subordination indicator. We also studied the relation between peering and agonistic dominance rank, age, and sex. Animals directed peering significantly more often at high-ranking animals in four of the groups. We suggest that peering is indirectly related to dominance rank by the resource-holding potential of individuals. In contexts where dominant individuals can monopolize resources, peerers may direct their attention at those high-ranking animals. When resources are distributed more evenly, high-ranking animals may peer down the hierarchy. We speculate on the reasons why a formal dominance or subordination signal appears to be absent in bonobos. Copyright (c) 2005 Wiley-Liss, Inc.

Why Participate in Peer Review as a Journal Manuscript Reviewer: What's in It for You?

PubMed

Pytynia, Kristen B

2017-06-01

The peer review process for scientific journals relies on the efforts of volunteer reviewers. Reviewers are selected due to their expertise in their fields. With so many demands on professional time, the benefits of participating in peer review may not be obvious. However, reviewers benefit by exposure to the latest developments in their fields, facilitating their keeping up-to-date with the latest publications. Tenure committees look favorably on participation in peer review, and invitations to review underscore that the reviewer is a respected subject matter expert. Contacts made during the peer review process can lead to long-lasting collaboration. Continuing medical education credit can be obtained through various mechanisms. Overall, participating in peer review is an important part of career development and should be viewed as a critical component of advancement.

48 CFR 215.270 - Peer Reviews.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 3 2010-10-01 2010-10-01 false Peer Reviews. 215.270 Section 215.270 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT... of Proposals and Information 215.270 Peer Reviews. Agency officials shall conduct Peer Reviews in...

Optimal strategies to consider when peer reviewing a systematic review and meta-analysis.

PubMed

Moher, David

2015-11-02

Systematic reviews are popular. A recent estimate indicates that 11 new systematic reviews are published daily. Nevertheless, evidence indicates that the quality of reporting of systematic reviews is not optimal. One likely reason is that the authors' reports have received inadequate peer review. There are now many different types of systematic reviews and peer reviewing them can be enhanced by using a reporting guideline to supplement whatever template the journal editors have asked you, as a peer reviewer, to use. Additionally, keeping up with the current literature, whether as a content expert or being aware of advances in systematic review methods is likely be make for a more comprehensive and effective peer review. Providing a brief summary of what the systematic review has reported is an important first step in the peer review process (and not performed frequently enough). At its core, it provides the authors with some sense of what the peer reviewer believes was performed (Methods) and found (Results). Importantly, it also provides clarity regarding any potential problems in the methods, including statistical approaches for meta-analysis, results, and interpretation of the systematic review, for which the peer reviewer can seek explanations from the authors; these clarifications are best presented as questions to the authors.

Operational research training: the course and beyond

PubMed Central

Harries, A. D.; Reid, A. J.; Edginton, M.; Hinderaker, S. G.; Satyanarayana, S.; Enarson, D. A.; Zachariah, R.

2012-01-01

Insufficient operational research (OR) is generated within programmes and health systems in low- and middle-income countries, partly due to limited capacity and skills to undertake and publish OR in peer-reviewed journals. To address this, a three-module course was piloted by the International Union Against Tuberculosis and Lung Disease and Médecins Sans Frontières in 2009–2010, with 12 participants. Five received mentorship and financial support as OR Fellows. Eleven of 12 participants submitted a paper to a peer-reviewed journal within 4 weeks of the end of the course. Evaluation shows that participants continued OR activities beyond the course. During the subsequent year, they submitted and/or published 19 papers, made 10 posters and/or presentations, and many participated in training, mentoring and/or paper reviewing. Some described changes in policy and practice influenced by their research, and changes in their organisation’s approach to OR. They provided recommendations for improving and expanding OR. We conclude that participants can, with certain enabling conditions, take research questions through to publication, use skills gained to undertake and promote OR thereafter and contribute to improvement in policy and practice. An internet-based network will provide participants and graduates with a platform for collection of course outcomes and ongoing mentor- and peer-based support, resources and incentives. PMID:26392960

Lessons from Peer Support Among Individuals with Mental Health Difficulties: A Review of the Literature

PubMed Central

Miyamoto, Yuki; Sono, Tamaki

2012-01-01

We conducted a comprehensive narrative review and used a systematic search strategy to identify studies related to peer support among adults with mental health difficulties. The purposes of this review were to describe the principles, effects and benefits of peer support documented in the published literature, to discuss challenging aspects of peer support and to investigate lessons from peer support. Fifty-one studies, including 8 review articles and 19 qualitative studies, met the inclusion criteria for this review. Most of the challenges for peer support were related to “role” and “relationship” issues; that is, how peer support providers relate to people who receive peer support and how peer support providers are treated in the system. The knowledge gained from peer support relationships, such as mutual responsibility and interdependence, might be a clue toward redefining the helper-helper relationship as well as the concepts of help and support. PMID:22563347

Important Earthquake Engineering Resources

Science.gov Websites

PEER logo Pacific Earthquake Engineering Research Center home about peer news events research Engineering Resources Site Map Search Important Earthquake Engineering Resources - American Concrete Institute Motion Observation Systems (COSMOS) - Consortium of Universities for Research in Earthquake Engineering

Retrospective analysis of the quality of reports by author-suggested and non-author-suggested reviewers in journals operating on open or single-blind peer review models

PubMed Central

Kowalczuk, Maria K; Dudbridge, Frank; Nanda, Shreeya; Harriman, Stephanie L; Patel, Jigisha; Moylan, Elizabeth C

2015-01-01

Objectives To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations. Design Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys. Setting BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models. Sample Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation. Results For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (p<0.0001 for BMC Infectious Diseases, BMC Microbiology and the Journal of Inflammation). For BMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used. Conclusions Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind. PMID:26423855

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 42 Public Health 1 2010-10-01 2010-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC....5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her qualifications have been reviewed by a PHS peer review committee and the committee has recommended appointment to...

Rethinking Feedback Practices in Higher Education: A Peer Review Perspective

ERIC Educational Resources Information Center

Nicol, David; Thomson, Avril; Breslin, Caroline

2014-01-01

Peer review is a reciprocal process whereby students produce feedback reviews on the work of peers and receive feedback reviews from peers on their own work. Prior research has primarily examined the learning benefits that result from the receipt of feedback reviews, with few studies specifically exploring the merits of producing feedback reviews…

What is open peer review? A systematic review.

PubMed

Ross-Hellauer, Tony

2017-01-01

Background : "Open peer review" (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only "invited experts" are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods : Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of "open peer review" or "open review", to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results : This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase "open peer review" has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions : I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process.

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals.

PubMed

Wicherts, Jelte M

2016-01-01

Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals' websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors' ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal's impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals.

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals

PubMed Central

Wicherts, Jelte M.

2016-01-01

Background Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Methods and Findings Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals’ websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors’ ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal’s impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. Conclusions The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals. PMID:26824759

Detailed prospective peer review in a community radiation oncology clinic.

PubMed

Mitchell, James D; Chesnut, Thomas J; Eastham, David V; Demandante, Carlo N; Hoopes, David J

In 2012, we instituted detailed prospective peer review of new cases. We present the outcomes of peer review on patient management and time required for peer review. Peer review rounds were held 3 to 4 days weekly and required 2 physicians to review pertinent information from the electronic medical record and treatment planning system. Eight aspects were reviewed for each case: 1) workup and staging; 2) treatment intent and prescription; 3) position, immobilization, and simulation; 4) motion assessment and management; 5) target contours; 6) normal tissue contours; 7) target dosimetry; and 8) normal tissue dosimetry. Cases were marked as, "Meets standard of care," "Variation," or "Major deviation." Changes in treatment plan were noted. As our process evolved, we recorded the time spent reviewing each case. From 2012 to 2014, we collected peer review data on 442 of 465 (95%) radiation therapy patients treated in our hospital-based clinic. Overall, 91 (20.6%) of the cases were marked as having a variation, and 3 (0.7%) as major deviation. Forty-two (9.5%) of the cases were altered after peer review. An overall peer review score of "Variation" or "Major deviation" was highly associated with a change in treatment plan (P < .01). Changes in target contours were recommended in 10% of cases. Gastrointestinal cases were significantly associated with a change in treatment plan after peer review. Indicators on position, immobilization, simulation, target contours, target dosimetry, motion management, normal tissue contours, and normal tissue dosimetry were significantly associated with a change in treatment plan. The mean time spent on each case was 7 minutes. Prospective peer review is feasible in a community radiation oncology practice. Our process led to changes in 9.5% of cases. Peer review should focus on technical factors such as target contours and dosimetry. Peer review required 7 minutes per case. Published by Elsevier Inc.

How Long Is Too Long in Contemporary Peer Review? Perspectives from Authors Publishing in Conservation Biology Journals

PubMed Central

Nguyen, Vivian M.; Haddaway, Neal R.; Gutowsky, Lee F. G.; Wilson, Alexander D. M.; Gallagher, Austin J.; Donaldson, Michael R.; Hammerschlag, Neil; Cooke, Steven J.

2015-01-01

Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academia as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time was six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. The majority of participants attributed lengthy review times to reviewer and editor fatigue, while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times were perceived to be greater for early career researchers and to have impact on author morale (e.g. motivation or frustration). Competition among colleagues was also of concern to respondents. Incentivizing peer-review was among the top suggested alterations to the system along with training graduate students in peer-review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study viewed the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer-review models. PMID:26267491

Peer-supported review of teaching: making the grade in midwifery and nursing education.

PubMed

Murphy Tighe, Sylvia; Bradshaw, Carmel

2013-11-01

This paper outlines the value of peer-supported review of teaching for nurse and midwifery educators in an academic environment. Reflection and continuing professional development are important tenets of an educators' practice and can be addressed via peer observation. Definitions and models of peer observation are presented. The strengths and challenges associated with peer-supported review of teaching are discussed. The reasons why peer observation is underutilised are explored with some suggestions on how to overcome these challenges. Recent developments in relation to peer observation and peer-supported review are outlined. The need for tangible evidence of development and enhancement of existing teaching expertise is very pronounced in the current economic climate, it is concluded that peer-supported review of teaching can provide such evidence. Copyright © 2012 Elsevier Ltd. All rights reserved.

Peer review in hematopoietic cell transplantation: are we doing our fair share?

PubMed

Giralt, S; Korngold, R; Lazarus, H M

2016-09-01

Peer review is believed to be important in maintaining the quality and integrity of research in academic endeavors. Recently, the value of the current peer review process, which is more than 100 years old has come into question. In the field of hematopoietic cell transplantation (HCT), peer review was unable to prevent the publication of the largest and most notorious scientific fraud in our field. In order to assess how the HCT community views and how engaged it is with the peer review process, the American Society of Blood and Marrow Transplantation conducted a survey of all of its members in 2014. The survey was sent to all active members through multiple email communications in August and September 2014. Of a total of 1183 members, 149 responded. Almost all of the respondents had participated in the peer review process, with few respondents declining ever to review manuscripts. The most common cause for declining review requests was lack of time. Most respondents (68%) thought that the current peer review process was relatively fair and unbiased, whereas only 9% of the respondents stated that they did not believe in the peer review process. In conclusion, among the respondents of this survey most felt the peer review process to be valuable and fair, however, the lack of response suggests that further study into improving the peer review process in the field of HCT is warranted in the era of electronic publishing and communication.

The Potential of Peer Review

ERIC Educational Resources Information Center

Johnson, Susan Moore; Fiarman, Sarah E.

2012-01-01

Peer review of teachers is controversial for several reasons. Some say peer reviewers encroach on the rightful domain of the principal as instructional leader. Others argue that, because peer evaluators are fellow teachers, they may be biased or unwilling to make hard decisions. Many teachers find the prospect of peer evaluation unsettling because…

Appreciation of the 2015 JGR Space Physics Peer Reviewers

NASA Technical Reports Server (NTRS)

Liemohn, Michael W.; Balikhin, Michael; Kepko, Larry; Rodger, Alan; Wang, Yuming

2016-01-01

The Editors of the Journal of Geophysical Research Space Physics are deeply indebted to the many people among the research community that serve this journal through peer review. The journal could not exist without the time and effort invested by the community through this voluntary activity, providing expert evaluations and thoughtful assessments of the work of others. In 2015, the journal had 1506 scientists contribute to the process with at least one peer review, for a total of 3575 reviews completed, including additional reviews of resubmitted manuscripts. There were 277 reviewers that contributed four or more reports in 2015. The average number of reviews per referee in 2015 was, therefore, 2.4. Note that the total number of manuscript final decisions (i.e., accept or reject) for Journal of Geophysical Research (JGR) Space Physics was 1147 in 2015. Of this, 774 were accepted and 373 were declined, for an acceptance rate of 67% last year. If the 1334 "revision" decisions are included in the tally, then the total number of decisions made in 2015 was 2481. Working out the arithmetic, it means that on average, a manuscript gets about 1.2 revision decisions before a final accept-or-reject decision. This explains the 3.1 average number of reviews per manuscript throughout each paper's lifetime in the submission-revision editorial process. We are pleased and happy that the research community is willing and able to devote their resources toward this service endeavor. We appreciate each and every one of you that helped maintain the high quality of papers in JGR Space Physics last year. We look forward to another excellent year working with all of you through the year ahead.

28 CFR 34.105 - Peer review methods.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Peer review methods. 34.105 Section 34... Review § 34.105 Peer review methods. (a) For both competitive and noncompetitive applications, peer... announcement or otherwise established by the Administrator, together with the assignment of numerical values...

7 CFR 3400.21 - Scientific peer review for research activities.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Scientific peer review for research activities. 3400... STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Peer and Merit Review Arranged by Grantees § 3400.21 Scientific peer review for research...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2014 CFR

2014-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2014-07-01 2014-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2013 CFR

2013-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2013-07-01 2013-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2012 CFR

2012-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2012-07-01 2012-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

28 CFR 34.109 - Qualifications of peer reviewers.

Code of Federal Regulations, 2011 CFR

2011-07-01

... be used in the selection of peer reviewers are: (a) Generalized knowledge of juvenile justice or... 28 Judicial Administration 1 2011-07-01 2011-07-01 false Qualifications of peer reviewers. 34.109 Section 34.109 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES...

Peer Review of Teaching: Sharing Best Practices

ERIC Educational Resources Information Center

Golparian, Shaya; Chan, Judy; Cassidy, Alice

2015-01-01

In this paper, we share examples of best peer review of teaching practices, drawing on our involvement in the design and implementation of the Peer Review of Teaching program at the Centre for Teaching, Learning and Technology. We review the history of the Peer Review of Teaching Initiative at the University of British Columbia and explain key…

Peer feedback for examiner quality assurance on MRCGP International South Asia: a mixed methods study.

PubMed

Perera, D P; Andrades, Marie; Wass, Val

2017-12-08

The International Membership Examination (MRCGP[INT]) of the Royal College of General Practitioners UK is a unique collaboration between four South Asian countries with diverse cultures, epidemiology, clinical facilities and resources. In this setting good quality assurance is imperative to achieve acceptable standards of inter rater reliability. This study aims to explore the process of peer feedback for examiner quality assurance with regard to factors affecting the implementation and acceptance of the method. A sequential mixed methods approach was used based on focus group discussions with examiners (n = 12) and clinical examination convenors who acted as peer reviewers (n = 4). A questionnaire based on emerging themes and literature review was then completed by 20 examiners at the subsequent OSCE exam. Qualitative data were analysed using an iterative reflexive process. Quantitative data were integrated by interpretive analysis looking for convergence, complementarity or dissonance. The qualitative data helped understand the issues and informed the process of developing the questionnaire. The quantitative data allowed for further refining of issues, wider sampling of examiners and giving voice to different perspectives. Examiners stated specifically that peer feedback gave an opportunity for discussion, standardisation of judgments and improved discriminatory abilities. Interpersonal dynamics, hierarchy and perception of validity of feedback were major factors influencing acceptance of feedback. Examiners desired increased transparency, accountability and the opportunity for equal partnership within the process. The process was stressful for examiners and reviewers; however acceptance increased with increasing exposure to receiving feedback. The process could be refined to improve acceptability through scrupulous attention to training and selection of those giving feedback to improve the perceived validity of feedback and improved reviewer feedback skills to enable better interpersonal dynamics and a more equitable feedback process. It is important to highlight the role of quality assurance and peer feedback as a tool for continuous improvement and maintenance of standards to examiners during training. Examiner quality assurance using peer feedback was generally a successful and accepted process. The findings highlight areas for improvement and guide the path towards a model of feedback that is responsive to examiner views and cultural sensibilities.

Adolescent peer group identification and characteristics: A review of the literature

PubMed Central

Sussman, Steve; Pokhrel, Pallav; Ashmore, Richard D.; Brown, B. Bradford

2011-01-01

This study provides an exhaustive review of 44 peer-reviewed quantitative or qualitative data-based peer-reviewed studies completed on adolescent peer group identification. Adolescent peer group identification is one’s self-perceived or other-perceived membership in discrete teenage peer groups. The studies reviewed suggest that adolescent peer groups consist of five general categories differentiable by lifestyle characteristics: Elites, Athletes, Academics, Deviants, and Others. We found that the Deviant adolescent group category reported relatively greater participation in drug use and other problem behaviors across studies, whereas Academics and Athletes exhibited the least participation in these problem behaviors. Additional research is needed in this arena to better understand the operation of adolescent group labels. PMID:17188815

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Use of peer review. 34.104 Section 34.104 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34... programs for which a large number of applications is expected, preapplications (concept papers) may be...

The Potential of Dual-Language Cross-Cultural Peer Review

ERIC Educational Resources Information Center

Ruecker, Todd

2011-01-01

This article explores the potential of dual-language cross-cultural peer review and how it improves on traditional monolingual and monocultural peer review. Drawing on scholarship related to international exchange programmes, peer review, and two-way immersion programmes in the United States as well as data collected while facilitating the…

7 CFR 550.17 - Peer review.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 6 2010-01-01 2010-01-01 false Peer review. 550.17 Section 550.17 Agriculture... § 550.17 Peer review. Upon request of the REE Agency, cooperators may be requested to provide documentation in support of peer review activities and cooperator personnel may be requested to participate in...

7 CFR 3411.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2011 CFR

2011-01-01

... INSTITUTE OF FOOD AND AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411.10 Establishment and operation of peer review groups. Subject to § 3411.5, the Administrator shall adopt procedures for the conduct of peer reviews and the...

Toward the Integration of Peer Reviewing and Computational Linguistics Approaches

ERIC Educational Resources Information Center

Park, Juhwa; Cho, Kwangsu

2017-01-01

Previous research has shown the effectiveness of peer reviewing on the improvement of writing quality. However, the fact that students themselves, arguably novices, judged the improvement leads to concerns about the validity of peer reviewing. We measured writing quality before and after peer reviewing using Coh-Metrix, which computationally…

Combustion Research aboard the ISS Utilizing the Combustion Integrated Rack and Microgravity Science Glovebox

NASA Astrophysics Data System (ADS)

Sutliff, T. J.; Otero, A. M.; Urban, D. L.

2002-01-01

The Physical Sciences Research Program of NASA has chartered a broad suite of peer-reviewed research investigating both fundamental combustion phenomena and applied combustion research topics. Fundamental research provides insights to develop accurate simulations of complex combustion processes and allows developers to improve the efficiency of combustion devices, to reduce the production of harmful emissions, and to reduce the incidence of accidental uncontrolled combustion (fires, explosions). The applied research benefit humans living and working in space through its fire safety program. The Combustion Science Discipline is implementing a structured flight research program utilizing the International Space Station (ISS) and two of its premier facilities, the Combustion Integrated Rack of the Fluids and Combustion Facility and the Microgravity Science Glovebox to conduct this space-based research. This paper reviews the current vision of Combustion Science research planned for International Space Station implementation from 2003 through 2012. A variety of research efforts in droplets and sprays, solid-fuels combustion, and gaseous combustion have been independently selected and critiqued through a series of peer-review processes. During this period, while both the ISS carrier and its research facilities are under development, the Combustion Science Discipline has synergistically combined research efforts into sub-topical areas. To conduct this research aboard ISS in the most cost effective and resource efficient manner, the sub-topic research areas are implemented via a multi-user hardware approach. This paper also summarizes the multi-user hardware approach and recaps the progress made in developing these research hardware systems. A balanced program content has been developed to maximize the production of fundamental and applied combustion research results within the current budgetary and ISS operational resource constraints. Decisions on utilizing the Combustion Integrated Rack and the Microgravity Science Glovebox are made based on facility capabilities and research requirements. To maximize research potential, additional research objectives are specified as desires a priori during the research design phase. These expanded research goals, which are designed to be achievable even with late addition of operational resources, allow additional research of a known, peer-endorsed scope to be conducted at marginal cost. Additional operational resources such as upmass, crewtime, data downlink bandwidth, and stowage volume may be presented by the ISS planners late in the research mission planning process. The Combustion Discipline has put in place plans to be prepared to take full advantage of such opportunities.

Asymmetric peer selections among Blacks, Asians, and Whites in a virtual environment: Preliminary evidence for triangulated threat theory.

PubMed

Tawa, John

2017-01-01

Black, Asian, and White participants (N = 210) created self-resembling avatars and engaged in peer-selection tasks during social events in the virtual world, Second Life, that were designed to simulate various types of resource competition. Participants in merit-based resource competition settings had less diversity in their peer groups compared to participants in settings where no resource competition was present, and Asian participants had lower preference for Black peers. Furthermore, these relationships were mediated by out-group discomfort. Results are discussed in relation to partial support for triangulated threat theory of group relations among Blacks, Asians, and Whites.

Collaborative Learning through Formative Peer Review: Pedagogy, Programs and Potential

ERIC Educational Resources Information Center

Sondergaard, Harald; Mulder, Raoul A.

2012-01-01

We examine student peer review, with an emphasis on formative practice and collaborative learning, rather than peer grading. Opportunities to engage students in such formative peer assessment are growing, as a range of online tools become available to manage and simplify the process of administering student peer review. We consider whether…

Evaluating alternative systems of peer review: a large-scale agent-based modelling approach to scientific publication.

PubMed

Kovanis, Michail; Trinquart, Ludovic; Ravaud, Philippe; Porcher, Raphaël

2017-01-01

The debate on whether the peer-review system is in crisis has been heated recently. A variety of alternative systems have been proposed to improve the system and make it sustainable. However, we lack sufficient evidence and data related to these issues. Here we used a previously developed agent-based model of the scientific publication and peer-review system calibrated with empirical data to compare the efficiency of five alternative peer-review systems with the conventional system. We modelled two systems of immediate publication, with and without online reviews (crowdsourcing), a system with only one round of reviews and revisions allowed (re-review opt-out) and two review-sharing systems in which rejected manuscripts are resubmitted along with their past reviews to any other journal (portable) or to only those of the same publisher but of lower impact factor (cascade). The review-sharing systems outperformed or matched the performance of the conventional one in all peer-review efficiency, reviewer effort and scientific dissemination metrics we used. The systems especially showed a large decrease in total time of the peer-review process and total time devoted by reviewers to complete all reports in a year. The two systems with immediate publication released more scientific information than the conventional one but provided almost no other benefit. Re-review opt-out decreased the time reviewers devoted to peer review but had lower performance on screening papers that should not be published and relative increase in intrinsic quality of papers due to peer review than the conventional system. Sensitivity analyses showed consistent findings to those from our main simulations. We recommend prioritizing a system of review-sharing to create a sustainable scientific publication and peer-review system.

Interventional radiology peer, a newly developed peer-review scoring system designed for interventional radiology practice.

PubMed

d'Othée, Bertrand Janne; Haskal, Ziv J

2013-10-01

Existing diagnostic radiology peer-review systems do not address the specificities of interventional radiology (IR) practice. The purpose of this study was to assess the feasibility of a specifically developed interventional peer review method, IR Peer. Retrospective review of a prospectively encoded pilot database aimed at demonstrating the feasibility of IR Peer in a multiphysician practice was performed. This scoring system used morning peer review of selected IR cases from the previous day in the form of a five-item questionnaire and an ordinal answer scale that grades reviewers' agreement with imaging findings, procedural/technical management, early outcomes, and follow-up plan. Patient lists from IR Peer and morbidity and mortality (M&M) conferences were compared to evaluate the amount of overlap and capability of IR Peer to help detect adverse events (AEs). A total of 417 consecutive reviews of IR attending physician cases by peers were performed in 163 consecutive patients over 18 months, and 94% of cases were reviewed by two or three IR attending physicians. Each question was answered 99%-100% of the time. Answers showed disagreement in 10% of cases (2% by a single reviewer, 8% by several), most related to procedural technique. Overall AE incidence was 1.8%. IR Peer contributed 10.7% of cases to the M&M list. IR Peer is feasible, relevant, and easy to implement in a multiphysician IR practice. When used along with other quality-assurance processes, it might help in the detection of AEs for M&M; the latter will require further confirmatory research. © SIR, 2013.

The evolution of peer review as a basis for scientific publication: directional selection towards a robust discipline?

PubMed

Ferreira, Catarina; Bastille-Rousseau, Guillaume; Bennett, Amanda M; Ellington, E Hance; Terwissen, Christine; Austin, Cayla; Borlestean, Adrian; Boudreau, Melanie R; Chan, Kevin; Forsythe, Adrian; Hossie, Thomas J; Landolt, Kristen; Longhi, Jessica; Otis, Josée-Anne; Peers, Michael J L; Rae, Jason; Seguin, Jacob; Watt, Cristen; Wehtje, Morgan; Murray, Dennis L

2016-08-01

Peer review is pivotal to science and academia, as it represents a widely accepted strategy for ensuring quality control in scientific research. Yet, the peer-review system is poorly adapted to recent changes in the discipline and current societal needs. We provide historical context for the cultural lag that governs peer review that has eventually led to the system's current structural weaknesses (voluntary review, unstandardized review criteria, decentralized process). We argue that some current attempts to upgrade or otherwise modify the peer-review system are merely sticking-plaster solutions to these fundamental flaws, and therefore are unlikely to resolve them in the long term. We claim that for peer review to be relevant, effective, and contemporary with today's publishing demands across scientific disciplines, its main components need to be redesigned. We propose directional changes that are likely to improve the quality, rigour, and timeliness of peer review, and thereby ensure that this critical process serves the community it was created for. © 2015 Cambridge Philosophical Society.

Implementing Head and Neck Contouring Peer Review without Pathway Delay: The On-demand Approach.

PubMed

Fong, C; Sanghera, P; Good, J; Nightingale, P; Hartley, A

2017-12-01

Peer review of contour volume is a priority in the radiotherapy treatment quality assurance process for head and neck cancer. It is essential that incorporation of peer review activity does not introduce additional delays. An on-demand peer review process was piloted to assess the feasibility and efficiency of this approach, as compared with a historic scheduled weekly approach. Between November 2016 and April 2017 four head and neck clinicians in one centre took part in an on-demand peer review process. Cases were of radical or adjuvant intent of any histology and submitted on a voluntary basis. The outcome of contour peer review would be one of unchanged (UC), unchanged with variation or discretion noted (UV), minor change (M) or significant change (S). The time difference between the completion of the on-demand peer review was compared with the time difference to a hypothetical next Monday or Tuesday weekly peer review meeting. The time taken to review each case was also documented in the latter period of the pilot project. In total, 62 cases underwent peer review. Peer review on-demand provided dosimetrists with an average of an extra two working days available per case to meet treatment start dates. The proportion of cases with outcomes UC, UV, M and S were 45%, 16%, 26% and 13%, respectively. The mean peer review time spent per case was 17 min (12 cases). The main reason for S was discrepancy in imaging interpretation (4/8 cases). A lower proportion of oropharyngeal cases were submitted and had S outcomes. A higher proportion of complex cases, e.g. sinonasal/nasopharynx location or previous downstaging chemotherapy had S outcomes. The distribution of S outcomes appears to be similar regardless of clinician experience. The level of peer review activity among individuals differed by workload and job timetable. On-demand peer review of the head and neck contour volume is feasible, reduces delay to the start of dosimetry planning and bypasses the logistical barriers of weekly meetings. An audit of participation will be required to ensure successful implementation. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Ancient texts to PubMed: a brief history of the peer-review process.

PubMed

Farrell, P R; Magida Farrell, L; Farrell, M K

2017-01-01

The formal evaluation of scientific literature by invited referees (peer reviewers) is a relatively recent phenomenon and now is considered a cornerstone of modern science. However, its roots can be traced back to antiquity. As the speed and complexity of scientific information and publishing increases in the digital age, peer review must continue to evolve. To understand the future direction of peer review, we must understand its past. Here, we briefly explore the history of scientific peer review. This may help us predict and design appropriate peer review for the new era. This work was originally presented at the Pediatric Academic Societies Annual Meeting in Baltimore, Maryland in the Spring of 2016.

Multi-resource peer assisted learning in postgraduate setting: a pilot study.

PubMed

Ali, Asif; Evans, Phillip

2013-04-01

To evaluate the satisfaction of participants and the effectiveness of an enhanced and relatively formal type of peer assisted learning (PAL) in postgraduate (PG) setting. An observational study. Layton Rehmat Ullah Benevolent Trust, Eye Hospital, Sargodha between 2008 and 2009. Participants were 6 medical officers and 2 consultants. Resources and sessions were defined and the curriculum agreed through consensus between all peers. Thirty clinically relevant topics on diseases, techniques and practicals were selected for PAL sessions. A 26-item questionnaire was used to evaluate PAL on Likert-scale. It also included a free text question about one strength and one weakness of PAL. The participants consented to all aspects of multi-resource PAL and they completed a questionnaire, from which data was gathered and analysed to reveal the impact of course. As a peer group they were satisfied with the teamwork experience. Seven out of eight peers reported to have increased their motivation level. In addition, as a peer tutor all peers accepted that the course equipped them with teaching skills and that teaching skills should be learnt. Similarly, as a peer tutee, they believe that peer assistance in a multiresource format had a positive impact on their learning and their difficult issues were unravelled. Finally, facilitated small group teaching, discussion and summing-up helped the peers to comprehend a given clinical topic. A pilot multi-resource PAL was evaluated and the participants appraised the course favourably and recommended it to their colleagues. The interest and zeal shown by the participants suggests that further investigation through a larger, prospective study is warranted.

Peer review in forensic science.

PubMed

Ballantyne, Kaye N; Edmond, Gary; Found, Bryan

2017-08-01

Peer review features prominently in the forensic sciences. Drawing on recent research and studies, this article examines different types of peer review, specifically: editorial peer review; peer review by the scientific community; technical and administrative review; and verification (and replication). The article reviews the different meanings of these quite disparate activities and their utility in relation to enhancing performance and reducing error. It explains how forensic practitioners should approach and use peer review, as well as how it should be described in expert reports and oral testimony. While peer review has considerable potential, and is a key component of modern quality management systems, its actual value in most forensic science settings has yet to be determined. In consequence, forensic practitioners should reflect on why they use specific review procedures and endeavour to make their actual practices and their potential value transparent to consumers; whether investigators, lawyers, jurors or judges. Claims that review increases the validity of a scientific technique or accuracy of opinions within a particular case should be avoided until empirical evidence is available to support such assertions. Copyright © 2017 Elsevier B.V. All rights reserved.

Science supporting the economic and environmental benefits of using wood and wood products in green building construction

Treesearch

Michael A. Ritter; Kenneth Skog; Richard Bergman

2011-01-01

The objective of this report is to summarize the scientific findings that support the environmental and economic benefits of using wood and wood products in green building construction. Despite documented advantages in many peer-reviewed scientific articles, most building professionals and members of the public do not recognize wood as a renewable resource or the role...

Final Report from the External Peer Review of the IRIS ...

EPA Pesticide Factsheets

This document is the final report for the 2004 external peer review for the EPA IRIS Reassessment of the Inhalation Carcinogenicity of Naphthalene, prepared by the Office of Research and Development's National Center for Environmental Assessment (NCEA), for the Integrated Risk Information System (IRIS) Database. A panel of external peer reviewers met to discuss the IRIS report and their responses to the charge questions on July 30, 2004. This document contains the final written comments of the external peer reviewers. This document is the final report for the 2004 external peer review for the IRIS Reassessment of the Inhalation Carcinogenicity of Naphthalene, prepared by the U.S. Environmental Protection Agency (EPA), National Center for Environmental Assessment (NCEA), for the Integrated Risk Information System (IRIS). A panel of external peer reviewers met to discuss their responses to the charge questions on July 30, 2004. This document contains the final written comments of the external peer reviewers.

Non-financial conflicts of interest in academic grant evaluation: a qualitative study of multiple stakeholders in France.

PubMed

Abdoul, Hendy; Perrey, Christophe; Tubach, Florence; Amiel, Philippe; Durand-Zaleski, Isabelle; Alberti, Corinne

2012-01-01

Peer review is the most widely used method for evaluating grant applications in clinical research. Criticisms of peer review include lack of equity, suspicion of biases, and conflicts of interest (CoI). CoIs raise questions of fairness, transparency, and trust in grant allocation. Few observational studies have assessed these issues. We report the results of a qualitative study on reviewers' and applicants' perceptions and experiences of CoIs in reviews of French academic grant applications. We designed a qualitative study using semi-structured interviews and direct observation. We asked members of assessment panels, external reviewers, and applicants to participate in semi-structured interviews. Two independent researchers conducted in-depth reviews and line-by-line coding of all transcribed interviews, which were also subjected to Tropes® software text analysis, to detect and qualify themes associated with CoIs. Most participants (73/98) spontaneously reported that non-financial CoIs predominated over financial CoIs. Non-financial CoIs mainly involved rivalry among disciplines, cronyism, and geographic and academic biases. However, none of the participants challenged the validity of peer review. Reviewers who felt they might be affected by CoIs said they reacted in a variety of ways: routine refusal to review, routine attempt to conduct an impartial review, or decision on a case-by-case basis. Multiple means of managing non-financial CoIs were suggested, including increased transparency throughout the review process, with public disclosure of non-financial CoIs, and careful selection of independent reviewers, including foreign experts and methodologists. Our study underscores the importance of considering non-financial CoIs when reviewing research grant applications, in addition to financial CoIs. Specific measures are needed to prevent a negative impact of non-financial CoIs on the fairness of resource allocation. Whether and how public disclosure of non-financial CoIs should be accomplished remains debatable.

Community-Clinical Linkages With Community Health Workers in the United States: A Scoping Review.

PubMed

Lohr, Abby M; Ingram, Maia; Nuñez, Annabelle V; Reinschmidt, Kerstin M; Carvajal, Scott C

2018-05-01

Despite the proliferation of community-clinical linkage (CCL) interventions with community health workers (CHWs), little is known about the components of these programs or how linkages are realized. In this scoping review, we synthesize evidence concerning the role of CHWs in creating and sustaining CCLs aimed at improving individual health outcomes. Our inclusion criteria included peer-reviewed articles that described a CHW intervention in the United States that used a CCL model. A total of 2,776 titles and/or abstracts were screened and 47 articles underwent full text review. Two independent reviewers rated the screened articles based on additional criteria including the CHW connection to community and evidence of linkage follow up rather than simple referral. For the 11 peer-reviewed articles included in the final review, we describe the CHW's relationship to the community, training, and role within the intervention, linkage, and outcomes. We used a standardized framework to determine commonalities in CHW roles across the interventions. CCLs with CHWs positively affect the delivery of both clinical care and community resources across a range of disease areas in a variety of contexts. To identify effective CCL models, additional information on CHW training, CCL follow-up methods, and the CHW role in CCLs is recommended.

Technology-Enhanced Peer Review: Benefits and Implications of Providing Multiple Reviews

ERIC Educational Resources Information Center

Papadopoulos, Pantelis M.; Lagkas, Thomas D.; Demetriadis, Stavros N.

2017-01-01

This study analyses the impact of self and peer feedback in technology-enhanced peer review settings. The impact of receiving peer comments ("receiver" perspective) is compared to that of reaching own insights by reviewing others' work ("giver" perspective). In this study, 38 sophomore students were randomly assigned in two…

Undergraduate Essay Writing: Online and Face-to-Face Peer Reviews

ERIC Educational Resources Information Center

Chong, Mike R.; Goff, Lori; Dej, Kimberly

2012-01-01

We implemented two different approaches of using peer review to support undergraduate essay assignments for students taking large second-year courses in life sciences and biology: a web-based online peer review (OPR) approach and a more traditional face-to-face peer review (FPR) approach that was conducted in tutorial settings. The essays…

7 CFR 3401.12 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Establishment and operation of peer review groups... GRANTS PROGRAM Scientific Peer Review of Research Applications for Funding § 3401.12 Establishment and operation of peer review groups. Subject to § 3401.7, the Administrator will adopt procedures for the...

The Importance of Peer Review: Thoughts on Knudson, Morrow, and Thomas (2014)

ERIC Educational Resources Information Center

Fischman, Mark G.

2014-01-01

Knudson, Morrow, and Thomas (2014) recently summarized a number of important issues related to the quality of peer review and current peer-review practice in kinesiology. This writer endorses their six recommendations for improving peer review in kinesiology journals. The purpose of this commentary is to further highlight the importance of…

Focusing on Content: Discourse in L2 Peer Review Groups

ERIC Educational Resources Information Center

Vorobel, Oksana; Kim, Deoksoon

2014-01-01

Recent studies on peer review groups in second language classes have focused on various topics, including collaboration (Carr, 2008) and the effect of peer review versus teacher feedback on students' writing (Zhang, 1995). One area that has received little attention is the content of students' speech during peer review. This longitudinal case…

Peer Reviewers Learn from Giving Comments

ERIC Educational Resources Information Center

Cho, Young Hoan; Cho, Kwangsu

2011-01-01

Research on peer reviewing has revealed that comments received from peer reviewers are helpful when it comes to making revisions in an individual's writing, but the role of providing comments to peer writers has been little explored despite the potential value of such research. In this study, we explored how student reviewers learn by reviewing…

Analysis of Peer Review Comments: QM Recommendations and Feedback Intervention Theory

ERIC Educational Resources Information Center

Schwegler, Andria F.; Altman, Barbara W.

2015-01-01

Because feedback is a critical component of the continuous improvement cycle of the Quality Matters (QM) peer review process, the present research analyzed the feedback that peer reviewers provided to course developers after a voluntary, nonofficial QM peer review of online courses. Previous research reveals that the effects of feedback on…

Pre-University Chemistry Students in a Mimicked Scholarly Peer Review

ERIC Educational Resources Information Center

van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein

2014-01-01

Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a…

Assessing RN-to-RN peer review on clinical units.

PubMed

Pfeiffer, Judith A; Wickline, Mary A; Deetz, Jill; Berry, Elise S

2012-04-01

The primary purpose of this study was to measure informal registered nurse (RN)-to-RN peer review (defined as collegial communication about the quality of nursing care) at the work-unit level. Survey design with cluster sampling of 28 hospital or ambulatory care units (n = 541 respondents). Results were compared with existing patient safety and satisfaction data. A chi-squared test was used to compare responses against nurse characteristics. Nurses agreed that RN-to-RN peer review takes place on their units, but no correlation with patient safety and satisfaction data was found. Misunderstandings about the meaning of peer review were evident. Open-ended comments revealed barriers to peer review: fear of retribution, language barriers and lack of professionalism. Nurses need clarification of peer review. Issues with common language in a professional environment need to be addressed and nurses can learn collaboration from each other's cultures. Managers should support RN-to-RN peer review on clinical units. Methods used here may be useful to assess current departmental nurse peer review. © 2011 Blackwell Publishing Ltd.

Peer Review in Radiology: A Resident and Fellow Perspective.

PubMed

Grenville, Jeffrey; Doucette-Preville, David; Vlachou, Paraskevi A; Mnatzakanian, Gevork N; Raikhlin, Antony; Colak, Errol

2016-02-01

The purpose of this study was to explore Canadian radiology residents' and fellows' understanding, attitudes, opinions, and preferences toward peer review. An Internet-based anonymous questionnaire designed to understand one's familiarity, attitudes, opinions, and preferences toward peer review was distributed to radiology residents and fellows across Canada. Data were analyzed using descriptive statistics, and answers were stratified by level of training. A total of 136 trainees responded to the survey with 92 completed survey responses available for descriptive statistics. Approximately half of respondents are familiar with peer review (49%), and 39% of trainees are involved in peer review. Most respondents (92%) expressed an interest in learning more about peer review; believe that it should be incorporated into the residency training curriculum (86%), be mandatory (72%), and that current participation will increase odds of future participation (91%). Most trainees (80%) are comfortable advising one another about errors, but less comfortable advising staff (21%). Residents and fellows welcome the opportunity to learn more about peer review and believe it should be incorporated into the residency training curriculum. Understanding the attitudes and perceptions held by trainees regarding peer review is important, as a means to optimize education and maximize current and future participation in peer review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

A Community of Peer Interactions as a Resource to Prepare Music Teacher Educators

ERIC Educational Resources Information Center

Shin, Jihae

2013-01-01

The purpose of this study was to investigate interactions between two doctoral students and their colleagues in a graduate music education program and determine how a community of peer interactions functions as a resource to prepare music teacher educators. Results of this study showed that peer interactions between two participants and other…

Retrospective analysis of the quality of reports by author-suggested and non-author-suggested reviewers in journals operating on open or single-blind peer review models.

PubMed

Kowalczuk, Maria K; Dudbridge, Frank; Nanda, Shreeya; Harriman, Stephanie L; Patel, Jigisha; Moylan, Elizabeth C

2015-09-29

To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations. Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys. BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models. Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation. For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (p<0.0001 for BMC Infectious Diseases, BMC Microbiology and the Journal of Inflammation). For BMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used. Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Peer Portal: Quality Enhancement in Thesis Writing Using Self-Managed Peer Review on a Mass Scale

ERIC Educational Resources Information Center

Aghaee, Naghmeh; Hansson, Henrik

2013-01-01

This paper describes a specially developed online peer-review system, the Peer Portal, and the first results of its use for quality enhancement of bachelor's and master's thesis manuscripts. The peer-review system is completely student driven and therefore saves time for supervisors and creates a direct interaction between students without…

Investing in citizen science can improve natural resource management and environmental protection

USGS Publications Warehouse

McKinley, Duncan C.; Miller-Rushing, Abraham J.; Ballard, Heidi L.; Bonney, Rick; Brown, Hutch; Evans, Daniel M.; French, Rebecca A.; Parrish, Julia K.; Phillips, Tina B.; Ryan, Sean F.; Shanley, Lea A.; Shirk, Jennifer L.; Stepenuck, Kristine F.; Weltzin, Jake F.; Wiggins, Andrea; Boyle, Owen D.; Briggs, Russell D.; Chapin, Stuart F.; Hewitt, David A.; Preuss, Peter W.; Soukup, Michael A.

2015-01-01

Citizen science has made substantive contributions to science for hundreds of years. More recently, it has contributed to many articles in peer-reviewed scientific journals and has influenced natural resource management and environmental protection decisions and policies across the nation. Over the last 10 years, citizen science—participation by the public in a scientific project—has seen explosive growth in the United States, particularly in ecology, the environmental sciences, and related fields of inquiry. In this report, we explore the current use of citizen science in natural resource and environmental science and decision making in the United States and describe the investments organizations might make to benefit from citizen science.

Development of a Curriculum on the Child With Medical Complexity: Filling a Gap When Few Practice Guidelines Exist.

PubMed

Shah, Neha H; Anspacher, Melanie; Davis, Aisha; Bhansali, Priti

2015-01-01

Pediatric hospitalists are increasingly involved in the clinical management of children with medical complexity (CMC), specifically those with neurologic impairment and technology dependence. Clinical care guidelines and educational resources on management of the diseases and devices prevalent in CMC are scarce. The objective of this study was to develop and evaluate a web-based curriculum on care of CMC for hospitalists at our institution using a novel approach to validate educational content. Junior faculty collaborated with senior hospitalist peer mentors to create multimedia learning modules on highly-desired topics as determined by needs assessment. Module authors were encouraged to work with subspecialty experts from within the institution and to submit their modules for external peer review. Pilot study participants were asked to complete all modules, associated knowledge tests, and evaluations over a 4-month period. Sixteen of 33 eligible hospitalists completed the curriculum and associated assessments. High scores with respect to satisfaction were seen across all modules. There was a significant increase in posttest knowledge scores (P < 0.001) with sustained retention at 6 months posttest (P < 0.013). Participants were most likely to make changes to their teaching and clinical practice based on participation in this curriculum. We used a novel approach for content development in this curriculum that incorporated consultation with experts and external peer review, resulting in improved knowledge, high satisfaction, and behavior change. Our approach may be a useful method to improve content validity for educational resources on topics that do not have established clinical care guidelines.

Gender bias in scholarly peer review.

PubMed

Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian

2017-03-21

Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing.

Meaningful Peer Review in Radiology: A Review of Current Practices and Potential Future Directions.

PubMed

Moriarity, Andrew K; Hawkins, C Matthew; Geis, J Raymond; Dreyer, Keith J; Kamer, Aaron P; Khandheria, Paras; Morey, Jose; Whitfill, James; Wiggins, Richard H; Itri, Jason N

2016-12-01

The current practice of peer review within radiology is well developed and widely implemented compared with other medical specialties. However, there are many factors that limit current peer review practices from reducing diagnostic errors and improving patient care. The development of "meaningful peer review" requires a transition away from compliance toward quality improvement, whereby the information and insights gained facilitate education and drive systematic improvements that reduce the frequency and impact of diagnostic error. The next generation of peer review requires significant improvements in IT functionality and integration, enabling features such as anonymization, adjudication by multiple specialists, categorization and analysis of errors, tracking, feedback, and easy export into teaching files and other media that require strong partnerships with vendors. In this article, the authors assess various peer review practices, with focused discussion on current limitations and future needs for meaningful peer review in radiology. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

Research Integrity and Peer Review-past highlights and future directions.

PubMed

Boughton, Stephanie L; Kowalczuk, Maria K; Meerpohl, Joerg J; Wager, Elizabeth; Moylan, Elizabeth C

2018-01-01

In May 2016, we launched Research Integrity and Peer Review , an international, open access journal with fully open peer review (reviewers are identified on their reports and named reports are published alongside the article) to provide a home for research on research and publication ethics, research reporting, and research on peer review. As the journal enters its third year, we reflect on recent events and highlights for the journal and explore how the journal is faring in terms of gender and diversity in peer review. We also share the particular interests of our Editors-in-Chief regarding models of peer review, reporting quality, common research integrity issues that arise during the publishing process, and how people interact with the published literature. We continue to encourage further research into peer review, research and publication ethics and research reporting, as we believe that all new initiatives should be evidence-based. We also remain open to constructive discussions of the developments in the field that offer new solutions.

On the Nature and Role of Peer Review in Mathematics.

PubMed

Andersen, Line Edslev

2017-01-01

For the past three decades, peer review practices have received much attention in the literature. But although this literature covers many research fields, only one previous systematic study has been devoted to the practice of peer review in mathematics, namely a study by Geist, Löwe, and Van Kerkhove from 2010. This lack of attention may be due to a view that peer review in mathematics is more reliable, and therefore less interesting as an object of study, than peer review in other fields. In fact, Geist, Löwe, and Van Kerkhove argue that peer review in mathematics is relatively reliable. At the same time, peer review in mathematics differs from peer review in most, if not all, other fields in that papers submitted to mathematical journals are usually only reviewed by a single referee. Furthermore, recent empirical studies indicate that the referees do not check the papers line by line. I argue that, in spite of this, mathematical practice in general and refereeing practices in particular are such that the common practice of mathematical journals of using just one referee is justified from the point of view of proof validity assessment. The argument is based on interviews I conducted with seven mathematicians.

Non-Financial Conflicts of Interest in Academic Grant Evaluation: A Qualitative Study of Multiple Stakeholders in France

PubMed Central

Abdoul, Hendy; Perrey, Christophe; Tubach, Florence; Amiel, Philippe; Durand-Zaleski, Isabelle; Alberti, Corinne

2012-01-01

Background Peer review is the most widely used method for evaluating grant applications in clinical research. Criticisms of peer review include lack of equity, suspicion of biases, and conflicts of interest (CoI). CoIs raise questions of fairness, transparency, and trust in grant allocation. Few observational studies have assessed these issues. We report the results of a qualitative study on reviewers’ and applicants’ perceptions and experiences of CoIs in reviews of French academic grant applications. Methodology and Principal Findings We designed a qualitative study using semi-structured interviews and direct observation. We asked members of assessment panels, external reviewers, and applicants to participate in semi-structured interviews. Two independent researchers conducted in-depth reviews and line-by-line coding of all transcribed interviews, which were also subjected to Tropes® software text analysis, to detect and qualify themes associated with CoIs. Most participants (73/98) spontaneously reported that non-financial CoIs predominated over financial CoIs. Non-financial CoIs mainly involved rivalry among disciplines, cronyism, and geographic and academic biases. However, none of the participants challenged the validity of peer review. Reviewers who felt they might be affected by CoIs said they reacted in a variety of ways: routine refusal to review, routine attempt to conduct an impartial review, or decision on a case-by-case basis. Multiple means of managing non-financial CoIs were suggested, including increased transparency throughout the review process, with public disclosure of non-financial CoIs, and careful selection of independent reviewers, including foreign experts and methodologists. Conclusions Our study underscores the importance of considering non-financial CoIs when reviewing research grant applications, in addition to financial CoIs. Specific measures are needed to prevent a negative impact of non-financial CoIs on the fairness of resource allocation. Whether and how public disclosure of non-financial CoIs should be accomplished remains debatable. PMID:22496913

Stats About Paralysis

MedlinePlus

... library Get support Ask us anything Get a peer mentor Find resources in your area Join the discussion ... partners Get support Ask us anything Get a peer mentor Resources in your area Funding for nonprofits Forum ...

Cooperation between referees and authors increases peer review accuracy.

PubMed

Leek, Jeffrey T; Taub, Margaret A; Pineda, Fernando J

2011-01-01

Peer review is fundamentally a cooperative process between scientists in a community who agree to review each other's work in an unbiased fashion. Peer review is the foundation for decisions concerning publication in journals, awarding of grants, and academic promotion. Here we perform a laboratory study of open and closed peer review based on an online game. We show that when reviewer behavior was made public under open review, reviewers were rewarded for refereeing and formed significantly more cooperative interactions (13% increase in cooperation, P = 0.018). We also show that referees and authors who participated in cooperative interactions had an 11% higher reviewing accuracy rate (P = 0.016). Our results suggest that increasing cooperation in the peer review process can lead to a decreased risk of reviewing errors.

How Does Student Peer Review Influence Perceptions, Engagement and Academic Outcomes? A Case Study

ERIC Educational Resources Information Center

Mulder, Raoul; Baik, Chi; Naylor, Ryan; Pearce, Jon

2014-01-01

Involving students in peer review has many pedagogical benefits, but few studies have explicitly investigated relationships between the content of peer reviews, student perceptions and assessment outcomes. We conducted a case study of peer review within a third-year undergraduate subject at a research-intensive Australian university, in which we…

Do Peer Reviews Help Improve Student Writing Abilities in an EFL High School Classroom?

ERIC Educational Resources Information Center

Kurihara, Noriko

2017-01-01

Several studies have reported the benefits of peer reviews in English as a second language (ESL) and English as a foreign language (EFL) writing classrooms. However, there has been little empirical research on whether such peer reviews improve students' writing abilities. The current study investigated the effects of peer review on the development…

Predicting Academics' Willingness to Participate in Peer Review of Teaching: A Quantitative Investigation

ERIC Educational Resources Information Center

White, Kiri; Boehm, Emilia; Chester, Andrea

2014-01-01

Peer review of teaching is a collegial process designed to help academics reflect on and improve their teaching practice. Considerable research supports the value of peer review of teaching. However, uptake of voluntary programs is typically low. Few studies have examined the predictors of engagement in voluntary peer review. This study surveyed…

LeaD-In: A Cultural Change Model for Peer Review of Teaching in Higher Education

ERIC Educational Resources Information Center

Barnard, A.; Nash, R.; McEvoy, K.; Shannon, S.; Waters, C.; Rochester, S.; Bolt, S.

2015-01-01

Peer review of teaching is recognized increasingly as one strategy for academic development even though historically peer review of teaching is often unsupported by policy, action and culture in many Australian universities. Higher education leaders report that academics generally do not engage with peer review of teaching in a systematic or…

Building Scholarly Writers: Student Perspectives on Peer Review in a Doctoral Writing Seminar

ERIC Educational Resources Information Center

Adamek, Margaret Ellen

2015-01-01

Peer review was used as a primary pedagogical tool in a scholarly writing course for social work doctoral students. To gauge student response to peer review and learning as a result of peer review, the instructor used narrative analysis to organize student comments into themes. Themes identified included initial trepidation, "no pain, no…

34 CFR 359.30 - How is peer review conducted under this program?

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 2 2010-07-01 2010-07-01 false How is peer review conducted under this program? 359.30 Section 359.30 Education Regulations of the Offices of the Department of Education (Continued) OFFICE OF...? § 359.30 How is peer review conducted under this program? Peer review is conducted under this program in...

Don't Tell It Like It Is: Preserving Collegiality in the Summative Peer Review of Teaching

ERIC Educational Resources Information Center

Iqbal, Isabeau A.

2014-01-01

While much literature has considered feedback and professional growth in formative peer reviews of teaching, there has been little empirical research conducted on these issues in the context of summative peer reviews. This article explores faculty members' perceptions of feedback practices in the summative peer review of teaching and reports on…

75 FR 24568 - Notice of Intent To Seek OMB Approval To Collect Information: Revision of a Form Pertaining to...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-05

... Peer Review of ARS Research Projects AGENCY: Agricultural Research Service (ARS), USDA. ACTION: Notice... scientific peer reviews of all research activities conducted by the USDA. The Office manages the ARS peer review system by centrally planning peer panel reviews for ARS research projects on a five-year cycle...

Students' Collaborative Peer Reviewing in an Online Writing Environment

ERIC Educational Resources Information Center

Bradley, Linda; Thouësny, Sylvie

2017-01-01

Peer review is applied as a powerful tool to enhance student collaboration online writing. The purpose of this paper is to analyse learners' mechanisms of peer reviewing in the nature of student interventions and interactions in written online peer reviewing and how categorization of student comments can be used as a means for analysing student…

Adapting Peer Review to an Online Course: An Exploratory Case Study

ERIC Educational Resources Information Center

Knight, Linda V.; Steinbach, Theresa A.

2011-01-01

With demonstrated benefits to higher level learning, peer review in the classroom has been well researched and popular since at least the 1990s. However, little or no prior studies exist into the peer review process for online courses. Further, we found no prior research specifically addressing the operational aspects of online peer review. This…

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

EPA is seeking peer review of the scientific basis supporting the human health hazard and dose-response assessment of ethylene oxide (cancer) that will appear in the Integrated Risk Information System (IRIS) database. EPA seeks external peer review on how the Agency responded to the SAB panel recommendations, the exposure-response modeling of epidemiologic data, including new analyses since the 2007 external peer review, and on the adequacy, transparency, and clarity of the revised draft. The peer review will include an opportunity for the public to address the peer reviewers.

External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team

DTIC Science & Technology

2015-11-02

External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team N O V E M B E R 2 , 2 0 1 5... MANAGEMENT AGENCY SUBJECT: External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment Internal Review Team...Report No. DODIG-2016-007) Attached is the External Peer Review Report on the Defense Contract Management Agency Office of Independent Assessment

AQUATOX Peer Review Documents

EPA Pesticide Factsheets

AQUATOX Release 2 underwent an external peer review in early 2003, and Release 3 underwent an external peer review in late 2008. Reviewers stated model enhancements have made AQUATOX one of the most exciting tools in aquatic ecosystem management.

Resource Management In Peer-To-Peer Networks: A Nadse Approach

NASA Astrophysics Data System (ADS)

Patel, R. B.; Garg, Vishal

2011-12-01

This article presents a common solution to Peer-to-Peer (P2P) network problems and distributed computing with the help of "Neighbor Assisted Distributed and Scalable Environment" (NADSE). NADSE supports both device and code mobility. In this article mainly we focus on the NADSE based resource management technique. How information dissemination and searching is speedup when using the NADSE service provider node in large network. Results show that performance of the NADSE network is better in comparison to Gnutella, and Freenet.

Stay Healthy on the Road

MedlinePlus

... travel Get support Ask us anything Get a peer mentor Find resources in your area Join the discussion ... partners Get support Ask us anything Get a peer mentor Resources in your area Funding for nonprofits Forum ...

Peer Feedback in Anonymous Peer Review in an EFL Writing Class in Spain

ERIC Educational Resources Information Center

Coté, Robert A.

2014-01-01

The present study reports the results of a process of peer feedback through anonymous peer review in an EFL writing class. Numerous studies have reported on the benefits of peer review (PR) in the ESL/EFL writing classroom. However, the literature also identifies social issues that can negatively affect the outcome of face-to-face PR. In this…

Expanding Group Peer Review: A Proposal for Medical Education Scholarship.

PubMed

Dumenco, Luba; Engle, Deborah L; Goodell, Kristen; Nagler, Alisa; Ovitsh, Robin K; Whicker, Shari A

2017-02-01

After participating in a group peer-review exercise at a workshop presented by Academic Medicine and MedEdPORTAL editors at the 2015 Association of American Medical Colleges Medical Education Meeting, the authors realized that the way their work group reviewed a manuscript was very different from the way by which they each would have reviewed the paper as an individual. Further, the group peer-review process yielded more robust feedback for the manuscript's authors than did the traditional individual peer-review process. This realization motivated the authors to reconvene and collaborate to write this Commentary to share their experience and propose the expanded use of group peer review in medical education scholarship.The authors consider the benefits of a peer-review process for reviewers, including learning how to improve their own manuscripts. They suggest that the benefits of a team review model may be similar to those of teamwork and team-based learning in medicine and medical education. They call for research to investigate this, to provide evidence to support group review, and to determine whether specific paper types would benefit most from team review (e.g., particularly complex manuscripts, those receiving widely disparate initial individual reviews). In addition, the authors propose ways in which a team-based approach to peer review could be expanded by journals and institutions. They believe that exploring the use of group peer review potentially could create a new methodology for skill development in research and scholarly writing and could enhance the quality of medical education scholarship.

Carbon dioxide storage in unconventional reservoirs workshop: summary of recommendations

USGS Publications Warehouse

Jones, Kevin B.; Blondes, Madalyn S.

2015-01-01

The storage capacity for all unconventional reservoirs may be modeled using a volumetric equation starting with the extent of the rock unit and adjusted using these key factors and reaction terms. The ideas that were developed during this workshop can be used by USGS scientists to develop a methodology to assess the CO2 storage resource in unconventional reservoirs. This methodology could then be released for public comment and peer review. After completing this development process, the USGS could then use the methodology to assess the CO2 storage resource in unconventional reservoirs.

Doctor of Nursing Practice: The Role of the Advanced Practice Nurse.

PubMed

Walker, Deborah Kirk; Polancich, Shea

2015-11-01

To explore the evolution and emerging roles of the Doctor of Nursing Practice (DNP) Advanced Practice Nurse (APN). Published peer reviewed literature, cancer-related professional resources, and Web-based resources. The DNP education has prepared the APN for process improvement initiatives, providing quality care, and evidence-based practice translation, which are critical with the emerging trends in this complex health care environment. DNP-prepared APNs have the opportunity to impact oncology care across the cancer trajectory, in various settings, and in various innovative roles as entrepreneurs. Copyright © 2015 Elsevier Inc. All rights reserved.

Online Radiology Reporting with Peer Review as a Learning and Feedback Tool in Radiology; Implementation, Validity, and Student Impressions.

PubMed

McEvoy, Fintan J; Shen, Nicholas W; Nielsen, Dorte H; Buelund, Lene E; Holm, Peter

2017-02-01

Communicating radiological reports to peers has pedagogical value. Students may be uneasy with the process due to a lack of communication and peer review skills or to their failure to see value in the process. We describe a communication exercise with peer review in an undergraduate veterinary radiology course. The computer code used to manage the course and deliver images online is reported, and we provide links to the executable files. We tested to see if undergraduate peer review of radiological reports has validity and describe student impressions of the learning process. Peer review scores for student-generated radiological reports were compared to scores obtained in the summative multiple choice (MCQ) examination for the course. Student satisfaction was measured using a bespoke questionnaire. There was a weak positive correlation (Pearson correlation coefficient = 0.32, p < 0.01) between peer review scores students received and the student scores obtained in the MCQ examination. The difference in peer review scores received by students grouped according to their level of course performance (high vs. low) was statistically significant (p < 0.05). No correlation was found between peer review scores awarded by the students and the scores they obtained in the MCQ examination (Pearson correlation coefficient = 0.17, p = 0.14). In conclusion, we have created a realistic radiology imaging exercise with readily available software. The peer review scores are valid in that to a limited degree they reflect student future performance in an examination. Students valued the process of learning to communicate radiological findings but do not fully appreciated the value of peer review.

Evaluating the Pros and Cons of Different Peer Review Policies via Simulation.

PubMed

Zhu, Jia; Fung, Gabriel; Wong, Wai Hung; Li, Zhixu; Xu, Chuanhua

2016-08-01

In the academic world, peer review is one of the major processes in evaluating a scholars contribution. In this study, we are interested in quantifying the merits of different policies in a peer review process, such as single-blind review, double-blind review, and obtaining authors feedback. Currently, insufficient work has been undertaken to evaluate the benefits of different peer review policies. One of the major reasons for this situation is the inability to conduct any empirical study because data are presently unavailable. In this case, a computer simulation is one of the best ways to conduct a study. We perform a series of simulations to study the effects of different policies on a peer review process. In this study, we focus on the peer review process of a typical computer science conference. Our results point to the crucial role of program chairs in determining the quality and diversity of the articles to be accepted for publication. We demonstrate the importance of discussion among reviewers, suggest circumstances in which the double-blind review policy should be adopted, and question the credibility of the authors feedback mechanism. Finally, we stress that randomness plays an important role in the peer review process, and this role cannot be eliminated. Although our model may not capture every component of a peer review process, it covers some of the most essential elements. Thus, even the simulation results clearly cannot be taken as literal descriptions of an actual peer review process. However, we can at least still use them to identify alternative directions for future study.

7 CFR 3400.14 - Proposal review.

Code of Federal Regulations, 2010 CFR

2010-01-01

... SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research... employees of the Department, the respective peer review group, and ad hoc reviewers, as required. Written...-depth discussions will be provided by peer review group members prior to recommending applications for...

How peer-review constrains cognition: on the frontline in the knowledge sector.

PubMed

Cowley, Stephen J

2015-01-01

Peer-review is neither reliable, fair, nor a valid basis for predicting 'impact': as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as 'cognition' describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as 'symbolizations', replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper's own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper's knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered 'real' science but also its 'post-academic' counterparts.

Real-Time Peer Review: An Innovative Feature to an Evidence-Based Practice Conference

PubMed Central

Eldredge, Jonathan D.; Phillips, Holly E.; Kroth, Philip J.

2013-01-01

Many health sciences librarians as well as other professionals attend conferences on a regular basis. This study sought to link an innovative peer review process of presented research papers to long-term conference outcomes in the peer-reviewed professional journal literature. An evidence-based conference included a proof-of-concept study to gauge the long-term outcomes from research papers presented during the program. Real-time peer review recommendations from the conference were linked to final versions of articles published in the peer-reviewed literature. The real-time peer review feedback served as the basis for further mentoring to guide prospective authors toward publishing their research results. These efforts resulted in the publication of two of the four research papers in the peer-viewed literature. A third presented paper appeared in a blog because the authors wanted to disseminate their findings more quickly than through the journal literature. The presenters of the fourth paper never published their study. Real-time peer review from this study can be adapted to other professional conferences that include presented research papers. PMID:24180649

Peer Review for EPA's Biologically Based Dose-Response ...

EPA Pesticide Factsheets

EPA is developing a regulation for perchlorate in drinking water. As part the regulatory process EPA must develop a Maximum Contaminant Level Goal (MCLG). FDA and EPA scientists developed a biologically based dose-response (BBDR) model to assist in deriving the MCLG. This model is designed to determine under what conditions of iodine nutrition and exposure to perchlorate across sensitive lifestages would result in low serum free and total thyroxine (hypothyroxinemia). EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. EPA is undertaking a peer review to provide a focused, objective independent peer evaluation of the draft model and its model results report. Peer review is an important component of the scientific process. The criticism, suggestions, and new ideas provided by the peer reviewers stimulate creative thought, strengthen the interpretation of the reviewed material, and confer credibility on the product. The peer review objective is to provide advice to EPA on steps that will yield a highly credible scientific product that is supported by the scientific community and a defensible perchlorate MCLG.

The effect of peer review on mortality rates.

PubMed

Krahwinkel, W; Schuler, E; Liebetrau, M; Meier-Hellmann, A; Zacher, J; Kuhlen, R

2016-10-01

Lowering of mortality rates in hospitals with mortality rates higher than accepted reference values for acute myocardial infarction (AMI), congestive heart failure (CHF), pneumonia, stroke, mechanical ventilation (MV) and colorectal surgery by using an external peer review process that identifies areas requiring rectification and implements protocols directed at improving these areas. Retrospective, observational, quality management study using administrative data to compare in-hospital mortality rates (pre and post an external peer review process that included adoption of improvement protocols) with reference values. German general hospitals of a large, private group. Hospitals with mortality rates higher than reference values. Peer review of medical records by experienced, outside physicians triggered by in-hospital mortality rates higher than expected. Inadequacies were identified, improvement protocols enforced and mortality rates subsequently re-examined. Mortality rates 1 year before and 1 year after peer review and protocol use. For AMI, CHF, pneumonia, stroke, MV and colorectal surgery, the mortality rates 1 year post-peer review were significantly decreased as compared to pre-peer review mortality rates. The standardized mortality ratio for all of the above diagnoses was 1.45, 1 year before peer review, and 0.97, 1 year after peer review. The absolute risk reduction of 7.3% translates into 710 deaths in this population which could have been prevented. Peer review triggered and conducted in the manner described here is associated with a significant lowering of in-hospital mortality rates in hospitals that previously had higher than expected mortality rates. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care.

Examining the Predictive Validity of NIH Peer Review Scores

PubMed Central

Lindner, Mark D.; Nakamura, Richard K.

2015-01-01

The predictive validity of peer review at the National Institutes of Health (NIH) has not yet been demonstrated empirically. It might be assumed that the most efficient and expedient test of the predictive validity of NIH peer review would be an examination of the correlation between percentile scores from peer review and bibliometric indices of the publications produced from funded projects. The present study used a large dataset to examine the rationale for such a study, to determine if it would satisfy the requirements for a test of predictive validity. The results show significant restriction of range in the applications selected for funding. Furthermore, those few applications that are funded with slightly worse peer review scores are not selected at random or representative of other applications in the same range. The funding institutes also negotiate with applicants to address issues identified during peer review. Therefore, the peer review scores assigned to the submitted applications, especially for those few funded applications with slightly worse peer review scores, do not reflect the changed and improved projects that are eventually funded. In addition, citation metrics by themselves are not valid or appropriate measures of scientific impact. The use of bibliometric indices on their own to measure scientific impact would likely increase the inefficiencies and problems with replicability already largely attributed to the current over-emphasis on bibliometric indices. Therefore, retrospective analyses of the correlation between percentile scores from peer review and bibliometric indices of the publications resulting from funded grant applications are not valid tests of the predictive validity of peer review at the NIH. PMID:26039440

77 FR 19126 - Defense Federal Acquisition Regulation Supplement: New Threshold for Peer Reviews of...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-03-30

... Federal Acquisition Regulation Supplement: New Threshold for Peer Reviews of Noncompetitive Contracts... Regulation Supplement (DFARS) to modify the threshold for noncompetitive contract peer reviews. DATES...-6088. SUPPLEMENTARY INFORMATION: I. Background This final rule reduces the threshold for DoD peer...

Lessons learned from the Galileo and Ulysses flight safety review experience

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bennett, Gary L.

In preparation for the launches of the Galileo and Ulysses spacecraft, a very comprehensive aerospace nuclear safety program and flight safety review were conducted. A review of this work has highlighted a number of important lessons which should be considered in the safety analysis and review of future space nuclear systems. These lessons have been grouped into six general categories: (1) establishment of the purpose, objectives and scope of the safety process; (2) establishment of charters defining the roles of the various participants; (3) provision of adequate resources; (4) provision of timely peer-reviewed information to support the safety program; (5)more » establishment of general ground rules for the safety review; and (6) agreement on the kinds of information to be provided from the safety review process.« less

The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise.

PubMed

Kovanis, Michail; Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic

2016-01-01

The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point.

The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise

PubMed Central

Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic

2016-01-01

The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point. PMID:27832157

Gender bias in scholarly peer review

PubMed Central

Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian

2017-01-01

Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing. DOI: http://dx.doi.org/10.7554/eLife.21718.001 PMID:28322725

Quality assurance in radiology: peer review and peer feedback.

PubMed

Strickland, N H

2015-11-01

Peer review in radiology means an assessment of the accuracy of a report issued by another radiologist. Inevitably, this involves a judgement opinion from the reviewing radiologist. Peer feedback is the means by which any form of peer review is communicated back to the original author of the report. This article defines terms, discusses the current status, identifies problems, and provides some recommendations as to the way forward, concentrating upon the software requirements for efficient peer review and peer feedback of reported imaging studies. Radiologists undertake routine peer review in their everyday clinical practice, particularly when reporting and preparing for multidisciplinary team meetings. More formal peer review of reported imaging studies has been advocated as a quality assurance measure to promote good clinical practice. It is also a way of assessing the competency of reporting radiologists referred for investigation to bodies such as the General Medical Council (GMC). The literature shows, firstly, that there is a very wide reported range of discrepancy rates in many studies, which have used a variety of non-comparable methodologies; and secondly, that applying scoring systems in formal peer review is often meaningless, unhelpful, and can even be detrimental. There is currently a lack of electronic peer feedback system software on the market to inform radiologists of any review of their work that has occurred or to provide them with clinical outcome information on cases they have previously reported. Learning opportunities are therefore missed. Radiologists should actively engage with the medical informatics industry to design optimal peer review and feedback software with features to meet their needs. Such a system should be easy to use, be fully integrated with the radiological information and picture archiving systems used clinically, and contain a free-text comment box, without a numerical scoring system. It should form a temporary record that cannot be permanently archived. It must provide automated feedback to the original author. Peer feedback, as part of everyday reporting, should enhance daily learning for radiologists. Software requirements for everyday peer feedback differ from those needed for a formal peer review process, which might only be necessary in the setting of a formal GMC enquiry into a particular radiologist's reporting competence, for example. Copyright © 2015 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Doing Peer Review: Reflections from an International Group of Postdoctoral Fellows

ERIC Educational Resources Information Center

Merry, Lisa; Jarvis, Kimberly; Kupoluyi, Joseph; Lual, Jomama One Jomama

2017-01-01

There is very little written regarding developing the skills of doing peer reviews. In this piece we use our own experience as postdoctoral fellows to offer our reflections on how to get the most out of doing peer reviews as a trainee researcher. We touch upon the variety and complexity of peer reviews, the debates concerning the nature and…

A proposal for an 'equal peer-review' statement.

PubMed

Moustafa, Khaled

2015-08-01

To make the peer-review process as objective as possible, I suggest the introduction of an 'equal peer-review' statement that preserves author anonymity across the board, thus removing any potential bias related to nominal or institutional 'prestige'; this would guarantee an equal peer-review process for all authors and grant applicants. Copyright © 2015 Elsevier Ltd. All rights reserved.

Peer Review in Class: Metrics and Variations in a Senior Course

ERIC Educational Resources Information Center

Yankulov, Krassimir; Couto, Richard

2012-01-01

Peer reviews are the generally accepted mode of quality assessment in scholarly communities; however, they are rarely used for evaluation at college levels. Over a period of 5 years, we have performed a peer review simulation at a senior level course in molecular genetics at the University of Guelph and have accumulated 393 student peer reviews.…

Love Canal Emergency Declaration Area habitability study. Volume 5. Peer review summary: TRC (Technical Review Committee) responses. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

Environmental studies were conducted to provide data that could be used by the Commissioner of Health for the State of New York in determining whether the Emergency Declaration Area surrounding the Love Canal hazardous-waste site is habitable. These volumes (II through IV) were reviewed by a peer-review panel of expert scientists. The scientists concluded that each of the three environmental studies was well planned and well executed. Volume V summarizes the peer review and gives additional information or clarifications as requested during the peer review. Volume V also provides additional supplemental statistical analyses requested by the peer reviewer panel.

Mentored peer reviewing for PhD faculty and students.

PubMed

Xu, Jiayun; Kim, Kyounghae; Kurtz, Melissa; Nolan, Marie T

2016-02-01

There is a need for scholars to be prepared as peer reviewers in order to ensure the continual publication of quality science. However, developing the skills to craft a constructive critique can be difficult. In this commentary, we discuss the use of a group peer review mentoring model for PhD students to gain experience in peer review from a faculty member who is experienced in peer review. Central to this model, was the opportunity for each student and faculty mentor to openly discuss their critique of the manuscript. Through this enriching experience, novice researchers were able to learn the elements of a good peer review, better determine a manuscript's substantive contribution to science, and advance the quality of their own manuscript writing. Copyright © 2015 Elsevier Ltd. All rights reserved.

Improving the peer review skills of young rheumatologists and researchers in rheumatology: the EMEUNET Peer Review Mentoring Program.

PubMed

Rodríguez-Carrio, Javier; Putrik, Polina; Sepriano, Alexandre; Moltó, Anna; Nikiphorou, Elena; Gossec, Laure; Kvien, Tore K; Ramiro, Sofia

2018-01-01

Although peer review plays a central role in the maintenance of high standards in scientific research, training of reviewing skills is not included in the common education programmes. The Emerging EULAR (European League Against Rheumatism) Network (EMEUNET) developed a programme to address this unmet need. The EMEUNET Peer Review Mentoring Program for Rheumatology Journals promotes a systematic training of reviewing skills by engaging mentees in a 'real world' peer review experience supervised by experienced mentors with support from rheumatology journals. This viewpoint provides an overview of this initiative and its outcomes, and discusses its potential limitations. Over 4 years, 18 mentors and 86 mentees have participated. Among the 33 participants who have completed the programme, 13 (39.3%) have become independent reviewers for Annals of the Rheumatic Diseases after the training. This programme has been recently evaluated by a survey and qualitative interviews, revealing a high interest in this initiative. The main strengths (involvement of a top journal and learning opportunities) and weaknesses of the programme (limited number of places and insufficient dissemination) were identified. Overall, this programme represents an innovative and successful approach to peer review training. Continuous evaluation and improvement are key to its functioning. The EMEUNET Peer Review Mentoring Program may be used as a reference for peer review training in areas outside rheumatology.

The effects of an editor serving as one of the reviewers during the peer-review process.

PubMed

Giordan, Marco; Csikasz-Nagy, Attila; Collings, Andrew M; Vaggi, Federico

2016-01-01

Background Publishing in scientific journals is one of the most important ways in which scientists disseminate research to their peers and to the wider public. Pre-publication peer review underpins this process, but peer review is subject to various criticisms and is under pressure from growth in the number of scientific publications. Methods Here we examine an element of the editorial process at eLife , in which the Reviewing Editor usually serves as one of the referees, to see what effect this has on decision times, decision type, and the number of citations. We analysed a dataset of 8,905 research submissions to eLife since June 2012, of which 2,747 were sent for peer review. This subset of 2747 papers was then analysed in detail.   Results The Reviewing Editor serving as one of the peer reviewers results in faster decision times on average, with the time to final decision ten days faster for accepted submissions (n=1,405) and five days faster for papers that were rejected after peer review (n=1,099). Moreover, editors acting as reviewers had no effect on whether submissions were accepted or rejected, and a very small (but significant) effect on citation rates. Conclusions An important aspect of eLife 's peer-review process is shown to be effective, given that decision times are faster when the Reviewing Editor serves as a reviewer. Other journals hoping to improve decision times could consider adopting a similar approach.

Evaluation of the Inhalation Carcinogenicity of Ethylene Oxide ...

EPA Pesticide Factsheets

EPA is initiating a public comment period prior to peer review of the scientific basis supporting the human health hazard and dose-response assessment of ethylene oxide (cancer) that will appear in the Integrated Risk Information System (IRIS) database. EPA seeks external peer review on how the Agency responded to the SAB panel recommendations, the exposure-response modeling of epidemiologic data, including new analyses since the 2007 external peer review, and on the adequacy, transparency, and clarity of the revised draft. The peer review will include an opportunity for the public to address the peer reviewers.

Experimental and Theoretical Studies of Autoignition and Burning Speed of JP8 and DF-2

DTIC Science & Technology

2008-10-20

publication in International Journal of Thermodynamics. List of papers submitted or published that acknowledge ARO support during this reporting period...to Chemical Relaxation Phenomena”, submitted to International Journal of Thermodynamics. (d) Manuscripts Number of Peer-Reviewed Conference Proceeding...He is an Associate Editor of ASME Journal of Energy Resources Technology. He is a member of the Editorial Board of the International Journal of

EPA releases progress report on hydraulic fracturing study

NASA Astrophysics Data System (ADS)

Showstack, Randy

2013-01-01

The U.S. Environmental Protection Agency (EPA) provided a 21 December progress report on its ongoing national study about the potential impacts of hydraulic fracturing on drinking water resources. The agency said that a draft of the congressionally requested study will be released in 2014 for public and peer review and that its progress report does not draw conclusions about the potential impacts of hydraulic fracturing, often referred to as fracking.

Improving adult immunization equity: Where do the published research literature and existing resources lead?

PubMed

Prins, Wendy; Butcher, Emily; Hall, Laura Lee; Puckrein, Gary; Rosof, Bernard

2017-05-25

Evidence suggests that disparities in adult immunization (AI) rates are growing. Providers need adequate patient resources and information about successful interventions to help them engage in effective practices to reduce AI disparities. The primary purposes of this paper were to review and summarize the evidence base regarding interventions to reduce AI disparities and to scan for relevant resources that could support providers in their AI efforts to specifically target disparities. First, building on a literature review conducted by the U.S. Centers for Disease Control and Prevention, we searched the peer-reviewed literature to identify articles that either discussed interventions to reduce AI disparities or provided reasons and associations for disparities. We scanned the articles and conducted an internet search to identify tools and resources to support efforts to improve AI rates. We limited both searches to resources that addressed influenza, pneumococcal, hepatitis B, Tdap, and/or herpes zoster vaccinations. We found that most articles characterized AI disparities, but several discussed strategies for reducing AI disparities, including practice-based changes, communication and health literacy approaches, and partnering with community-based organizations. The resources we identified were largely fact sheets and handouts for patients and journal articles for providers. Most resources pertain to influenza vaccination and Spanish was the most prevalent language after English. More evaluation is needed to assess the health literacy levels of the materials. We conclude that additional research is needed to identify effective ways to reduce AI disparities and more resources are needed to support providers in their efforts. We recommend identifying best practices of high performers, further reviewing the appropriateness and usefulness of available resources, and prioritizing which gaps should be addressed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Hospital nurses' information retrieval behaviours in relation to evidence based nursing: a literature review.

PubMed

Alving, Berit Elisabeth; Christensen, Janne Buck; Thrysøe, Lars

2018-03-01

The purpose of this literature review is to provide an overview of the information retrieval behaviour of clinical nurses, in terms of the use of databases and other information resources and their frequency of use. Systematic searches carried out in five databases and handsearching were used to identify the studies from 2010 to 2016, with a populations, exposures and outcomes (PEO) search strategy, focusing on the question: In which databases or other information resources do hospital nurses search for evidence based information, and how often? Of 5272 titles retrieved based on the search strategy, only nine studies fulfilled the criteria for inclusion. The studies are from the United States, Canada, Taiwan and Nigeria. The results show that hospital nurses' primary choice of source for evidence based information is Google and peers, while bibliographic databases such as PubMed are secondary choices. Data on frequency are only included in four of the studies, and data are heterogenous. The reasons for choosing Google and peers are primarily lack of time; lack of information; lack of retrieval skills; or lack of training in database searching. Only a few studies are published on clinical nurses' retrieval behaviours, and more studies are needed from Europe and Australia. © 2018 Health Libraries Group.

What is open peer review? A systematic review

PubMed Central

Ross-Hellauer, Tony

2017-01-01

Background: “Open peer review” (OPR), despite being a major pillar of Open Science, has neither a standardized definition nor an agreed schema of its features and implementations. The literature reflects this, with numerous overlapping and contradictory definitions. While for some the term refers to peer review where the identities of both author and reviewer are disclosed to each other, for others it signifies systems where reviewer reports are published alongside articles. For others it signifies both of these conditions, and for yet others it describes systems where not only “invited experts” are able to comment. For still others, it includes a variety of combinations of these and other novel methods. Methods: Recognising the absence of a consensus view on what open peer review is, this article undertakes a systematic review of definitions of “open peer review” or “open review”, to create a corpus of 122 definitions. These definitions are systematically analysed to build a coherent typology of the various innovations in peer review signified by the term, and hence provide the precise technical definition currently lacking. Results: This quantifiable data yields rich information on the range and extent of differing definitions over time and by broad subject area. Quantifying definitions in this way allows us to accurately portray exactly how ambiguously the phrase “open peer review” has been used thus far, for the literature offers 22 distinct configurations of seven traits, effectively meaning that there are 22 different definitions of OPR in the literature reviewed. Conclusions: I propose a pragmatic definition of open peer review as an umbrella term for a number of overlapping ways that peer review models can be adapted in line with the aims of Open Science, including making reviewer and author identities open, publishing review reports and enabling greater participation in the peer review process. PMID:28580134

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2014 CFR

2014-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2013 CFR

2013-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2011 CFR

2011-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

45 CFR 1388.9 - Peer review.

Code of Federal Regulations, 2012 CFR

2012-10-01

... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review..., including on-site visits or inspections as necessary. (b) Applications for funding opportunities under part...

A peer review process as part of the implementation of clinical pathways in radiation oncology: Does it improve compliance?

PubMed

Gebhardt, Brian J; Heron, Dwight E; Beriwal, Sushil

Clinical pathways are patient management plans that standardize evidence-based practices to ensure high-quality and cost-effective medical care. Implementation of a pathway is a collaborative process in our network, requiring the active involvement of physicians. This approach promotes acceptance of pathway recommendations, although a peer review process is necessary to ensure compliance and to capture and approve off-pathway selections. We investigated the peer review process and factors associated with time to completion of peer review. Our cancer center implemented radiation oncology pathways for every disease site throughout a large, integrated network. Recommendations are written based upon national guidelines, published literature, and institutional experience with evidence evaluated hierarchically in order of efficacy, toxicity, and then cost. Physicians enter decisions into an online, menu-driven decision support tool that integrates with medical records. Data were collected from the support tool and included the rate of on- and off-pathway selections, peer review decisions performed by disease site directors, and time to complete peer review. A total of 6965 treatment decisions were entered in 2015, and 605 (8.7%) were made off-pathway and were subject to peer review. The median time to peer review decision was 2 days (interquartile range, 0.2-6.8). Factors associated with time to peer review decision >48 hours on univariate analysis include disease site (P < .0001) with a trend toward significance (P = .066) for radiation therapy modality. There was no difference between recurrent and non-recurrent disease (P = .267). Multivariable analysis revealed disease site was associated with time to peer review (P < .001), with lymphoma and skin/sarcoma most strongly influencing decision time >48 hours. Clinical pathways are an integral tool for standardizing evidence-based care throughout our large, integrated network, with 91.3% of all treatment decisions being made as per pathway. The peer review process was feasible, with <1% selections ultimately rejected, suggesting that awareness of peer review of treatment decisions encourages compliance with clinical pathway recommendations. Copyright © 2017 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

How peer-review constrains cognition: on the frontline in the knowledge sector

PubMed Central

Cowley, Stephen J.

2015-01-01

Peer-review is neither reliable, fair, nor a valid basis for predicting ‘impact’: as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as ‘cognition’ describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as ‘symbolizations’, replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper’s own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper’s knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered ‘real’ science but also its ‘post-academic’ counterparts. PMID:26579064

Development of a peer-review framework for cancer multidisciplinary meetings.

PubMed

Johnson, Claire E; Slavova-Azmanova, Neli; Saunders, Christobel

2017-05-01

There is no mechanism in place for monitoring or quality improvement of cancer multidisciplinary meetings (MDM) in Australia. To develop a peer-review process for quality improvement of MDM. This project involved three phases: (i) development of a draft peer-review framework, supporting documents and peer-review process; (ii) consultation with key stakeholders; (iii) refinement of the framework, documents and processes following a pilot study with three MDM. Feedback indicated that specific standards included in the framework needed to allow the peer reviewers to be flexible relative to the circumstances of the individual MDM. Conversely, feedback identified the need for clear, evidence-based clinical practice guidelines for the conduct of MDM, with accepted standards and objective measures of performance. MDM members were divided about the need to employ peer reviewers from the tumour stream of the MDM under review but agreed that closer involvement of the team under review to support the implementation of recommendations is warranted. We developed an adaptable peer-review framework and process using the current available evidence and guidance. While further research is needed to establish what constitutes best practice in MDM and which processes contribute to improved patient outcomes, the structured peer-review process we describe, when modified using the disease-relevant evidence, could be utilised more broadly as a quality improvement tool. © 2017 Royal Australasian College of Physicians.

Journal peer review: a bar or bridge? An analysis of a paper's revision history and turnaround time, and the effect on citation.

PubMed

Rigby, J; Cox, D; Julian, K

2018-01-01

Journal peer review lies at the heart of academic quality control. This article explores the journal peer review process and seeks to examine how the reviewing process might itself contribute to papers, leading them to be more highly cited and to achieve greater recognition. Our work builds on previous observations and views expressed in the literature about (a) the role of actors involved in the research and publication process that suggest that peer review is inherent in the research process and (b) on the contribution reviewers themselves might make to the content and increased citation of papers. Using data from the journal peer review process of a single journal in the Social Sciences field (Business, Management and Accounting), we examine the effects of peer review on papers submitted to that journal including the effect upon citation, a novel step in the study of the outcome of peer review. Our detailed analysis suggests, contrary to initial assumptions, that it is not the time taken to revise papers but the actual number of revisions that leads to greater recognition for papers in terms of citation impact. Our study provides evidence, albeit limited to the case of a single journal, that the peer review process may constitute a form of knowledge production and is not the simple correction of errors contained in submitted papers.

A multi-disciplinary perspective on emergent and future innovations in peer review

PubMed Central

Tennant, Jonathan P.; Dugan, Jonathan M.; Graziotin, Daniel; Jacques, Damien C.; Waldner, François; Mietchen, Daniel; Elkhatib, Yehia; B. Collister, Lauren; Pikas, Christina K.; Crick, Tom; Masuzzo, Paola; Caravaggi, Anthony; Berg, Devin R.; Niemeyer, Kyle E.; Ross-Hellauer, Tony; Mannheimer, Sara; Rigling, Lillian; Katz, Daniel S.; Greshake Tzovaras, Bastian; Pacheco-Mendoza, Josmel; Fatima, Nazeefa; Poblet, Marta; Isaakidis, Marios; Irawan, Dasapta Erwin; Renaut, Sébastien; Madan, Christopher R.; Matthias, Lisa; Nørgaard Kjær, Jesper; O'Donnell, Daniel Paul; Neylon, Cameron; Kearns, Sarah; Selvaraju, Manojkumar; Colomb, Julien

2017-01-01

Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments. PMID:29188015

A multi-disciplinary perspective on emergent and future innovations in peer review.

PubMed

Tennant, Jonathan P; Dugan, Jonathan M; Graziotin, Daniel; Jacques, Damien C; Waldner, François; Mietchen, Daniel; Elkhatib, Yehia; B Collister, Lauren; Pikas, Christina K; Crick, Tom; Masuzzo, Paola; Caravaggi, Anthony; Berg, Devin R; Niemeyer, Kyle E; Ross-Hellauer, Tony; Mannheimer, Sara; Rigling, Lillian; Katz, Daniel S; Greshake Tzovaras, Bastian; Pacheco-Mendoza, Josmel; Fatima, Nazeefa; Poblet, Marta; Isaakidis, Marios; Irawan, Dasapta Erwin; Renaut, Sébastien; Madan, Christopher R; Matthias, Lisa; Nørgaard Kjær, Jesper; O'Donnell, Daniel Paul; Neylon, Cameron; Kearns, Sarah; Selvaraju, Manojkumar; Colomb, Julien

2017-01-01

Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments.

Peer Review: Promoting Efficient School District Operations

ERIC Educational Resources Information Center

Hale, Jason S.

2010-01-01

Many professions recognize the benefits of peer reviews to assess processes and operations because peers can more easily identify one another's inefficiencies and provide some kind of intervention. Generally, the goal of the peer review process is to verify whether the work satisfies the standards set by the industry. A number of states have begun…

Using Calibrated Peer Review to Teach Basic Research Skills

ERIC Educational Resources Information Center

Bracke, Marianne S.; Graveel, John G.

2014-01-01

Calibrated Peer Review (CPR) is an online tool being used in the class Introduction to Agriculture and Purdue University (AGR 10100) to integrate a writing and research component (http://cpr.molsci.ucla.edu/Home.aspx). Calibrated Peer Review combines the ability to create writing intensive assignments with an introduction to the peer-review…

Acknowledging Students' Collaborations through Peer Review: A Footnoting Practice

ERIC Educational Resources Information Center

Poe, Shelli M.; Gravett, Emily O.

2016-01-01

Student-to-student peer review or peer feedback is commonly used in student-centered or active-learning classrooms. In this article, we describe a footnoting exercise that we implemented in two of our undergraduate courses as one way to encourage students to acknowledge collaborations and contributions made during peer-review processes. This…

A Method for Improving the Integrity of Peer Review.

PubMed

Dadkhah, Mehdi; Kahani, Mohsen; Borchardt, Glenn

2017-08-15

Peer review is the most important aspect of reputable journals. Without it, we would be unsure about whether the material published was as valid and reliable as is possible. However, with the advent of the Internet, scientific literature has now become subject to a relatively new phenomenon: fake peer reviews. Some dishonest researchers have been manipulating the peer review process to publish what are often inferior papers. There are even papers that explain how to do it. This paper discusses one of those methods and how editors can defeat it by using a special review ID. This method is easy to understand and can be added to current peer review systems easily.

Measuring the effectiveness of scientific gatekeeping.

PubMed

Siler, Kyle; Lee, Kirby; Bero, Lisa

2015-01-13

Peer review is the main institution responsible for the evaluation and gestation of scientific research. Although peer review is widely seen as vital to scientific evaluation, anecdotal evidence abounds of gatekeeping mistakes in leading journals, such as rejecting seminal contributions or accepting mediocre submissions. Systematic evidence regarding the effectiveness--or lack thereof--of scientific gatekeeping is scant, largely because access to rejected manuscripts from journals is rarely available. Using a dataset of 1,008 manuscripts submitted to three elite medical journals, we show differences in citation outcomes for articles that received different appraisals from editors and peer reviewers. Among rejected articles, desk-rejected manuscripts, deemed as unworthy of peer review by editors, received fewer citations than those sent for peer review. Among both rejected and accepted articles, manuscripts with lower scores from peer reviewers received relatively fewer citations when they were eventually published. However, hindsight reveals numerous questionable gatekeeping decisions. Of the 808 eventually published articles in our dataset, our three focal journals rejected many highly cited manuscripts, including the 14 most popular; roughly the top 2 percent. Of those 14 articles, 12 were desk-rejected. This finding raises concerns regarding whether peer review is ill--suited to recognize and gestate the most impactful ideas and research. Despite this finding, results show that in our case studies, on the whole, there was value added in peer review. Editors and peer reviewers generally--but not always-made good decisions regarding the identification and promotion of quality in scientific manuscripts.

Use of computers and Internet among people with severe mental illnesses at peer support centers.

PubMed

Brunette, Mary F; Aschbrenner, Kelly A; Ferron, Joelle C; Ustinich, Lee; Kelly, Michael; Grinley, Thomas

2017-12-01

Peer support centers are an ideal setting where people with severe mental illnesses can access the Internet via computers for online health education, peer support, and behavioral treatments. The purpose of this study was to assess computer use and Internet access in peer support agencies. A peer-assisted survey assessed the frequency with which consumers in all 13 New Hampshire peer support centers (n = 702) used computers to access Internet resources. During the 30-day survey period, 200 of the 702 peer support consumers (28%) responded to the survey. More than 3 quarters (78.5%) of respondents had gone online to seek information in the past year. About half (49%) of respondents were interested in learning about online forums that would provide information and peer support for mental health issues. Peer support centers may be a useful venue for Web-based approaches to education, peer support, and intervention. Future research should assess facilitators and barriers to use of Web-based resources among people with severe mental illness in peer support centers. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

The Influence of Peer Groups on Academic Success

ERIC Educational Resources Information Center

Sallee, Margaret W.; Tierney, William G.

2007-01-01

The authors examine how peer relationships influence students' academic success. After defining peer groups, the article considers the ways in which students' peer networks facilitate or inhibit access to academic resources. The authors argue that the composition and purpose of a peer group influences academic achievement and students' likelihood…

Context-Aware Reviewer Assignment for Trust Enhanced Peer Review

PubMed Central

Li, Lei; Wang, Yan; Liu, Guanfeng; Wang, Meng; Wu, Xindong

2015-01-01

Reviewer assignment is critical to peer review systems, such as peer-reviewed research conferences or peer-reviewed funding applications, and its effectiveness is a deep concern of all academics. However, there are some problems in existing peer review systems during reviewer assignment. For example, some of the reviewers are much more stringent than others, leading to an unfair final decision, i.e., some submissions (i.e., papers or applications) with better quality are rejected. In this paper, we propose a context-aware reviewer assignment for trust enhanced peer review. More specifically, in our approach, we first consider the research area specific expertise of reviewers, and the institution relevance and co-authorship between reviewers and authors, so that reviewers with the right expertise are assigned to the corresponding submissions without potential conflict of interest. In addition, we propose a novel cross-assignment paradigm, and reviewers are cross-assigned in order to avoid assigning a group of stringent reviewers or a group of lenient reviewers to the same submission. More importantly, on top of them, we propose an academic CONtext-aware expertise relevanCe oriEnted Reviewer cross-assignmenT approach (CONCERT), which aims to effectively estimate the “true” ratings of submissions based on the ratings from all reviewers, even though no prior knowledge exists about the distribution of stringent reviewers and lenient reviewers. The experiments illustrate that compared with existing approaches, our proposed CONCERT approach can less likely assign more than one stringent reviewers or lenient reviewers to a submission simultaneously and significantly reduce the influence of ratings from stringent reviewers and lenient reviewers, leading to trust enhanced peer review and selection, no matter what kind of distributions of stringent reviewers and lenient reviewers are. PMID:26090849

International Conference in Computational Cell Biology: From the Past to the Future

DTIC Science & Technology

2016-09-12

24061 -0001 ABSTRACT Number of Papers published in peer -reviewed journals: Number of Papers published in non peer -reviewed journals: Final Report...present their latest research and discussed challenges in computational cell biology research and education. (a) Papers published in peer -reviewed...List the papers, including journal references, in the following categories: (b) Papers published in non- peer -reviewed journals (N/A for none) (c

Health and Illness in a Connected World: How Might Sharing Experiences on the Internet Affect People's Health?

PubMed Central

Ziebland, Sue; Wyke, Sally

2012-01-01

Context The use of the Internet for peer-to-peer connection has been one of its most dramatic and transformational features. Yet this is a new field with no agreement on a theoretical and methodological basis. The scientific base underpinning this activity needs strengthening, especially given the explosion of web resources that feature experiences posted by patients themselves. This review informs a National Institute for Health Research (NIHR) (UK) research program on the impact of online patients’ accounts of their experiences with health and health care, which includes the development and validation of a new e-health impact questionnaire. Methods We drew on realist review methods to conduct a conceptual review of literature in the social and health sciences. We developed a matrix to summarize the results, which we then distilled from a wide and diverse reading of the literature. We continued reading until we reached data saturation and then further refined the results after testing them with expert colleagues and a public user panel. Findings We identified seven domains through which online patients’ experiences could affect health. Each has the potential for positive and negative impacts. Five of the identified domains (finding information, feeling supported, maintaining relationships with others, affecting behavior, and experiencing health services) are relatively well rehearsed, while two (learning to tell the story and visualizing disease) are less acknowledged but important features of online resources. Conclusions The value of first-person accounts, the appeal and memorability of stories, and the need to make contact with peers all strongly suggest that reading and hearing others’ accounts of their own experiences of health and illnesss will remain a key feature of e-health. The act of participating in the creation of health information (e.g., through blogging and contributing to social networking on health topics) also influences patients’ experiences and has implications for our understanding of their role in their own health care management and information. PMID:22709387

Health and illness in a connected world: how might sharing experiences on the internet affect people's health?

PubMed

Ziebland, Sue; Wyke, Sally

2012-06-01

The use of the Internet for peer-to-peer connection has been one of its most dramatic and transformational features. Yet this is a new field with no agreement on a theoretical and methodological basis. The scientific base underpinning this activity needs strengthening, especially given the explosion of web resources that feature experiences posted by patients themselves. This review informs a National Institute for Health Research (NIHR) (UK) research program on the impact of online patients' accounts of their experiences with health and health care, which includes the development and validation of a new e-health impact questionnaire. We drew on realist review methods to conduct a conceptual review of literature in the social and health sciences. We developed a matrix to summarize the results, which we then distilled from a wide and diverse reading of the literature. We continued reading until we reached data saturation and then further refined the results after testing them with expert colleagues and a public user panel. We identified seven domains through which online patients' experiences could affect health. Each has the potential for positive and negative impacts. Five of the identified domains (finding information, feeling supported, maintaining relationships with others, affecting behavior, and experiencing health services) are relatively well rehearsed, while two (learning to tell the story and visualizing disease) are less acknowledged but important features of online resources. The value of first-person accounts, the appeal and memorability of stories, and the need to make contact with peers all strongly suggest that reading and hearing others' accounts of their own experiences of health and illnesss will remain a key feature of e-health. The act of participating in the creation of health information (e.g., through blogging and contributing to social networking on health topics) also influences patients' experiences and has implications for our understanding of their role in their own health care management and information. © 2012 Milbank Memorial Fund.

Evidence-based Peer Review for Radiation Therapy - Updated Review of the Literature with a Focus on Tumour Subsite and Treatment Modality.

PubMed

Huo, M; Gorayski, P; Poulsen, M; Thompson, K; Pinkham, M B

2017-10-01

Technological advances in radiation therapy permit steep dose gradients from the target to spare normal tissue, but increase the risk of geographic miss. Suboptimal target delineation adversely affects clinical outcomes. Prospective peer review is a method for quality assurance of oncologists' radiotherapy plans. Published surveys suggest it is widely implemented. However, it may not be feasible to review every case before commencement of radiation therapy in all departments. The rate of plan changes following peer review of cases without a specific subsite or modality is typically around 10%. Stereotactic body radiation therapy, head and neck, gynaecological, gastrointestinal, haematological and lung cases are associated with higher rates of change of around 25%. These cases could thus be prioritised for peer review. Other factors may limit peer review efficacy including organisational culture, time constraints and the physical environment in which sessions are held. Recommendations for peer review endorsed by the American Society for Radiation Oncology were made available in 2013, but a number of relevant studies have been published since. Here we review and update the literature, and provide an updated suggestion for the implementation of peer review to serve as an adjunct to published guidelines. This may help practitioners evaluate their current processes and maximise the utility and effectiveness of peer review sessions. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

Improving your journal article using feedback from peer review.

PubMed

Price, Bob

2014-09-30

While preparation of a journal article for submission may often include informal review by colleagues, an article is not accepted for publication until it has been formally peer reviewed. Peer review is the process whereby journal editors ask expert reviewers to examine the work submitted and prepare a report on its suitability for publication. Two or more revisions of the article may be required following peer review, with the author reworking the article in the light of feedback received on each occasion. This can be challenging for some authors, but used well, it offers a chance to improve the work to the required standard of the journal, and help the author present a more precise and coherent account of the arguments. The extent to which the author responds to the critical commentary of peer reviewers is important, because this may determine whether or not the article is published. This article explores the aims of peer reviewers and recommends ways in which authors can respond to the feedback provided.

Peer Collaboration: Improving Teaching through Comprehensive Peer Review

ERIC Educational Resources Information Center

Smith, Shelley L.

2014-01-01

This article includes a brief rationale and review of the literature on peer review of teaching (PRT). Based on that literature review, it offers a proposal for an optimal formative review process that results in a teaching portfolio that would reflect a faculty member's efforts and successes in a critically reflective PRT process, and contributes…

42 CFR 52h.9 - What matters must be reviewed for unsolicited contract proposals?

Code of Federal Regulations, 2010 CFR

2010-10-01

... SERVICES GRANTS SCIENTIFIC PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT... covered by this part unless the proposal has been reviewed by a peer review group in accordance with the... proposal. (b) Except to the extent otherwise provided by law, peer review group recommendations are...

Peer review.

PubMed

Twaij, H; Oussedik, S; Hoffmeyer, P

2014-04-01

The maintenance of quality and integrity in clinical and basic science research depends upon peer review. This process has stood the test of time and has evolved to meet increasing work loads, and ways of detecting fraud in the scientific community. However, in the 21st century, the emphasis on evidence-based medicine and good science has placed pressure on the ways in which the peer review system is used by most journals. This paper reviews the peer review system and the problems it faces in the digital age, and proposes possible solutions.

7 CFR 3400.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2011 CFR

2011-01-01

... INSTITUTE OF FOOD AND AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.10 Establishment and operation of peer review groups. Subject to § 3400.5, the...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2013 CFR

2013-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2014 CFR

2014-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2011 CFR

2011-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

28 CFR 34.104 - Use of peer review.

Code of Federal Regulations, 2012 CFR

2012-07-01

... the peer review process. (c) Ratings will be in the form of numerical scores assigned by individual... results of peer review for a noncompetitive new or continuation project will be in the form of numerical...

Eyes wide open: reader and author responsibility in understanding the limits of peer review.

PubMed

Benson, P J

2015-10-01

'Medical science can only flourish in a free society and dies under totalitarian repression.' (1) Peer review post-publication is relatively easy to define: when the world decides the importance of publication. Peer review pre-publication is what the scientific community frequently means when using the term 'peer review'. But what it is it? Few will agree on an exact definition; generally speaking, it refers to an independent, third party scrutiny of a manuscript by scientific experts (called peers) who advise on its suitability for publication. Peer review is expensive; although reviewers are unpaid, the cost in time is enormous and it is slow. There is often little agreement among reviewers about whether an article should be published and peer review can be a lottery. Often referred to as a quality assurance process, there are many examples of when peer review failed. Many will be aware of Woo-Suk Hwang's shocking stem cell research misconduct at Seoul National University. (2) Science famously published two breakthrough articles that were found subsequently to be completely fabricated and this happened in spite of peer review. Science is not unique in making this error. However, love it or hate it, peer review, for the present time at least, is here to stay. In this article, Philippa Benson, Managing Editor of Science Advances (the first open access journal of the American Association for the Advancement of Science), discusses the merits of peer review. Dr Benson has extensive experience in the publishing world and was Executive Director of PJB Consulting, a not-for-profit organisation supporting clients on issues related to converting to full electronic publishing workflows as well as challenges working with international authors and publishers. Her clients included the Public Library of Science journals, the American Society for Nutrition and the de Beaumont Foundation. She recently co-authored a book, What Editors Want: An Author's Guide to Scientific Journal Publishing (University of Chicago Press), which helps readers understand and navigate the publishing process in high impact science and technical journals. Her master's and doctorate degrees are from Carnegie Mellon University. JYOTI SHAH Commissioning Editor References 1. Eaton KK . Editorial: when is a peer review journal not a peer review journal? J Nutr Environ Med 1997 ; 7 : 139 - 144 . 2. van der Heyden MA , van de Ven T , Opthof T . Fraud and misconduct in science: the stem cell seduction . Neth Heart J 2009 ; 17 : 25 - 29 .

Using comprehensive geriatric assessment for quality improvements in healthcare of older people in UK care homes: protocol for realist review within Proactive Healthcare of Older People in Care Homes (PEACH) study.

PubMed

Zubair, Maria; Chadborn, Neil H; Gladman, John R F; Dening, Tom; Gordon, Adam L; Goodman, Claire

2017-10-10

Care home residents are relatively high users of healthcare resources and may have complex needs. Comprehensive geriatric assessment (CGA) may benefit care home residents and improve efficiency of care delivery. This is an approach to care in which there is a thorough multidisciplinary assessment (physical and mental health, functioning and physical and social environments) and a care plan based on this assessment, usually delivered by a multidisciplinary team. The CGA process is known to improve outcomes for community-dwelling older people and those in receipt of hospital care, but less is known about its efficacy in care home residents. Realist review was selected as the most appropriate method to explore the complex nature of the care home setting and multidisciplinary delivery of care. The aim of the realist review is to identify and characterise a programme theory that underpins the CGA intervention. The realist review will extract data from research articles which describe the causal mechanisms through which the practice of CGA generates outcomes. The focus of the intervention is care homes, and the outcomes of interest are health-related quality of life and satisfaction with services; for both residents and staff. Further outcomes may include appropriate use of National Health Service services and resources of older care home residents. The review will proceed through three stages: (1) identifying the candidate programme theories that underpin CGA through interviews with key stakeholders, systematic search of the peer-reviewed and non-peer-reviewed evidence, (2) identifying the evidence relevant to CGA in UK care homes and refining the programme theories through refining and iterating the systematic search, lateral searches and seeking further information from study authors and (3) analysis and synthesis of evidence, involving the testing of the programme theories. The PEACH project was identified as service development following submission to the UK Health Research Authority and subsequent review by the University of Nottingham Research Ethics Committee. The study protocols have been reviewed as part of good governance by the Nottinghamshire Healthcare Foundation Trust. We aim to publish this realist review in a peer-reviewed journal with international readership. We will disseminate findings to public and stakeholders using knowledge mobilisation techniques. Stakeholders will include the Quality Improvement Collaboratives within PEACH study. National networks, such as British Society of Gerontology and National Care Association will be approached for wider dissemination. The realist review has been registered on International Prospective Register of Systematic Reviews (PROSPERO 2017: CRD42017062601). © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Pre-university Chemistry Students in a Mimicked Scholarly Peer Review

NASA Astrophysics Data System (ADS)

van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein

2014-10-01

Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a mimicked scholarly peer review. This design is based on a model of a human activity system. Twenty-five different schools in Brazil, Germany, Poland and The Netherlands participated. The students (n = 880) conducted in small groups (n = 428) open inquiries on fermentation. All groups prepared an inquiry report for peer review. These reports were published on a website. Groups were randomly paired in an internet symposium, where they posted review comments to their peers. These responses were qualitatively analyzed on small groups' level of understanding regarding seven categories: inquiry question, hypothesis, management of control variables, accurate measurement, presenting results, reliability of results, discussion and conclusion. The mimicked scholarly review prompted a collective practice. Student understanding was significantly well on presenting results, discussion and conclusion, and significantly less on inquiry question and reliability of results. An enacted design, based on a model of a human activity system, created student understanding of quality in inquiries as well as an insight in a peer-reviewing practice. To what extent this model can be applied in a broader context of design research in science education needs further study.

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency.

PubMed

Shepherd, Jonathan; Frampton, Geoff K; Pickett, Karen; Wyatt, Jeremy C

2018-01-01

To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review 'innovations'. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality.

The Effectiveness of Peer Review of Teaching When Performed between Early-Career Academics

ERIC Educational Resources Information Center

Woodman, Richard J.; Parappilly, Maria B.

2015-01-01

The success of peer review of teaching (PRT) in shaping teaching practice during an academic's formative years may depend on the peers' teaching experience and the frequency of evaluation. Two Australian early-career University lecturers with no previous experience of peer review performed a single PRT on one another following a one week academic…

Multi-Stage Open Peer Review: Scientific Evaluation Integrating the Strengths of Traditional Peer Review with the Virtues of Transparency and Self-Regulation

PubMed Central

Pöschl, Ulrich

2012-01-01

The traditional forms of scientific publishing and peer review do not live up to all demands of efficient communication and quality assurance in today’s highly diverse and rapidly evolving world of science. They need to be advanced and complemented by interactive and transparent forms of review, publication, and discussion that are open to the scientific community and to the public. The advantages of open access, public peer review, and interactive discussion can be efficiently and flexibly combined with the strengths of traditional scientific peer review. Since 2001 the benefits and viability of this approach are clearly demonstrated by the highly successful interactive open access journal Atmospheric Chemistry and Physics (ACP, www.atmos-chem-phys.net) and a growing number of sister journals launched and operated by the European Geosciences Union (EGU, www.egu.eu) and the open access publisher Copernicus (www.copernicus.org). The interactive open access journals are practicing an integrative multi-stage process of publication and peer review combined with interactive public discussion, which effectively resolves the dilemma between rapid scientific exchange and thorough quality assurance. Key features and achievements of this approach are: top quality and impact, efficient self-regulation and low rejection rates, high attractivity and rapid growth, low costs, and financial sustainability. In fact, ACP and the EGU interactive open access sister journals are by most if not all standards more successful than comparable scientific journals with traditional or alternative forms of peer review (editorial statistics, publication statistics, citation statistics, economic costs, and sustainability). The high efficiency and predictive validity of multi-stage open peer review have been confirmed in a series of dedicated studies by evaluation experts from the social sciences, and the same or similar concepts have recently also been adopted in other disciplines, including the life sciences and economics. Multi-stage open peer review can be flexibly adjusted to the needs and peculiarities of different scientific communities. Due to the flexibility and compatibility with traditional structures of scientific publishing and peer review, the multi-stage open peer review concept enables efficient evolution in scientific communication and quality assurance. It has the potential for swift replacement of hidden peer review as the standard of scientific quality assurance, and it provides a basis for open evaluation in science. PMID:22783183

Content and communication: How can peer review provide helpful feedback about the writing?

PubMed Central

Shashok, Karen

2008-01-01

Background Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. Discussion The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Summary Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now. PMID:18237378

Content and communication: how can peer review provide helpful feedback about the writing?

PubMed

Shashok, Karen

2008-01-31

Peer review is assumed to improve the quality of research reports as tools for scientific communication, yet strong evidence that this outcome is obtained consistently has been elusive. Failure to distinguish between aspects of discipline-specific content and aspects of the writing or use of language may account for some deficiencies in current peer review processes. The process and outcomes of peer review may be analyzed along two dimensions: 1) identifying scientific or technical content that is useful to other researchers (i.e., its "screening" function), and 2) improving research articles as tools for communication (i.e., its "improving" function). However, editors and reviewers do not always distinguish clearly between content criteria and writing criteria. When peer reviewers confuse content and writing, their feedback can be misunderstood by authors, who may modify texts in ways that do not make the readers' job easier. When researchers in peer review confuse the two dimensions, this can lead to content validity problems that foil attempts to define informative variables and outcome measures, and thus prevent clear trends from emerging. Research on writing, revising and editing suggests some reasons why peer review is not always as effective as it might be in improving what is written. Peer review could be improved if stakeholders were more aware of variations in gatekeepers' (reviewers' and editors') ability to provide feedback about the content or the writing. Gatekeepers, academic literacy researchers, and wordface professionals (author's editors, medical writers and translators) could work together to discover the types of feedback authors find most useful. I offer suggestions to help editologists design better studies of peer review which could make the process an even stronger tool for manuscript improvement than it is now.

The transfer of land resources information into the public sector—The Texas experience

NASA Astrophysics Data System (ADS)

Wermund, E. G.

1980-03-01

Mapping of land resources and environmental geology was initiated in Texas toward better communication of geology to the public policy sector. Relevant mapping parameters have included terrain, substrate, active processes, economic resources, and hydrology as well as physical, chemical, and biologic properties. Land resources maps and reports have been prepared for public agencies and published for technical and nontechnical readers; sales of these articles are one indicator of public policy transfer. Single lectures or participation in symposia and colloquia for scientific societies have been valuable only for peer review or as a means to sharpen communicative skills. The most successful mechanisms of public policy transfer have been (1) in-state workshops and short courses for elected officials, Governmental employees, and interested citizens; (2) legislative testimonies; (3) active participation on interagency committees; (4) reviews and comments on planning statements; and (5) a temporary loan of personnel to another agency. Areas where these methods successfully have impacted public policy are reflected in the present quality of Section 208, Section 701, and coastal zone management planning; applications for surface-mining permits; and environmental impact statement records in Texas.

Applications of the Schur Basis to Quantum Algorithms

DTIC Science & Technology

2011-01-10

superpolynomial speedups based on quantum circuits. (a) Papers published in peer -reviewed journals (N/A for none) 1. D.A.Bacon, I.L. Chuang, A.W...reporting period. List the papers, including journal references, in the following categories: (b) Papers published in non- peer -reviewed journals or in...MIT, Department of EECS, 2008 7.00Number of Papers published in peer -reviewed journals: Number of Papers published in non peer -reviewed journals: (c

Redefining the Practice of Peer Review Through Intelligent Automation Part 1: Creation of a Standardized Methodology and Referenceable Database.

PubMed

Reiner, Bruce I

2017-10-01

Conventional peer review practice is compromised by a number of well-documented biases, which in turn limit standard of care analysis, which is fundamental to determination of medical malpractice. In addition to these intrinsic biases, other existing deficiencies exist in current peer review including the lack of standardization, objectivity, retrospective practice, and automation. An alternative model to address these deficiencies would be one which is completely blinded to the peer reviewer, requires independent reporting from both parties, utilizes automated data mining techniques for neutral and objective report analysis, and provides data reconciliation for resolution of finding-specific report differences. If properly implemented, this peer review model could result in creation of a standardized referenceable peer review database which could further assist in customizable education, technology refinement, and implementation of real-time context and user-specific decision support.

Radiologist Peer Review by Group Consensus.

PubMed

Harvey, H Benjamin; Alkasab, Tarik K; Prabhakar, Anand M; Halpern, Elkan F; Rosenthal, Daniel I; Pandharipande, Pari V; Gazelle, G Scott

2016-06-01

The objective of this study was to evaluate the feasibility of the consensus-oriented group review (COGR) method of radiologist peer review within a large subspecialty imaging department. This study was institutional review board approved and HIPAA compliant. Radiologist interpretations of CT, MRI, and ultrasound examinations at a large academic radiology department were subject to peer review using the COGR method from October 2011 through September 2013. Discordance rates and sources of discordance were evaluated on the basis of modality and division, with group differences compared using a χ(2) test. Potential associations between peer review outcomes and the time after the initiation of peer review or the number of radiologists participating in peer review were tested by linear regression analysis and the t test, respectively. A total of 11,222 studies reported by 83 radiologists were peer reviewed using COGR during the two-year study period. The average radiologist participated in 112 peer review conferences and had 3.3% of his or her available CT, MRI and ultrasound studies peer reviewed. The rate of discordance was 2.7% (95% confidence interval [CI], 2.4%-3.0%), with significant differences in discordance rates on the basis of division and modality. Discordance rates were highest for MR (3.4%; 95% CI, 2.8%-4.1%), followed by ultrasound (2.7%; 95% CI, 2.0%-3.4%) and CT (2.4%; 95% CI, 2.0%-2.8%). Missed findings were the most common overall cause for discordance (43.8%; 95% CI, 38.2%-49.4%), followed by interpretive errors (23.5%; 95% CI, 18.8%-28.3%), dictation errors (19.0%; 95% CI, 14.6%-23.4%), and recommendation (10.8%; 95% CI, 7.3%-14.3%). Discordant cases, compared with concordant cases, were associated with a significantly greater number of radiologists participating in the peer review process (5.9 vs 4.7 participating radiologists, P < .001) and were significantly more likely to lead to an addendum (62.9% vs 2.7%, P < .0001). COGR permits departments to collect highly contextualized peer review data to better elucidate sources of error in diagnostic imaging reports, while reviewing a sufficient case volume to comply with external standards for ongoing performance review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

The mechanisms underpinning peer support: a literature review.

PubMed

Watson, Emma

2017-12-20

The employment of Peer Support Workers, who themselves have experience of significant emotional distress, can promote recovery at an individual and organisational level. While research examining the benefits of peer support within mental health services continues to grow, an understanding of how, and through what processes, these benefits are reached remains under-developed. To review the published research literature relating to the process of peer support and its underpinning mechanisms to better understand how and why it works. A scoping review of published literature identified studies relating to peer support mechanisms, processes and relationships. Studies were summarised and findings analysed. Five mechanisms were found to underpin peer support relationships (lived experience, love labour, the liminal position of the peer worker, strengths-focussed social and practical support, and the helper role). The identified mechanisms can underpin both the success and difficulties associated with peer support relationships. Further research should review a broader range of literature and clarify how these mechanisms contribute to peer support in different contexts.

College student stressors: a review of the qualitative research.

PubMed

Hurst, Carrie S; Baranik, Lisa E; Daniel, Francis

2013-10-01

A total of 40 qualitative studies were reviewed and coded according to the college student stressors they represented. These studies utilized a variety of qualitative methods to examine stressors representing the following themes: relationships, lack of resources, academics, the environment, expectations, diversity, transitions and other stressors. Relationship stressors were the most commonly reported theme and covered areas including stress associated with family, romantic, peer and faculty relationships. Three of the themes (relationships, diversity and other) are novel categories of stressors compared with quantitative reviews on the topic, highlighting the importance of gathering both quantitative and qualitative pieces of information. This review contributes to the stress literature by synthesizing and identifying trends in the qualitative student stress research. Copyright © 2012 John Wiley & Sons, Ltd.

Effectiveness of Guided Peer Review of Student Essays in a Large Undergraduate Biology Course

ERIC Educational Resources Information Center

Kelly, Lauren

2015-01-01

Instructors and researchers often consider peer review an integral part of the writing process, providing myriad benefits for both writers and reviewers. Few empirical studies, however, directly address the relationship between specific methodological changes and peer review effectiveness, especially outside the composition classroom. To…

42 CFR 52h.6 - Availability of information.

Code of Federal Regulations, 2010 CFR

2010-10-01

... a peer review group will be available for public inspection and copying to the extent provided by... regulations (45 CFR parts 5, 5b). (b) Meetings of peer review groups reviewing grant applications or contract... by peer review groups that contain trade secrets or commercial or financial information obtained from...

Methodologies of Peer and Editorial Review: Changing Practices

ERIC Educational Resources Information Center

Selfe, Cynthia; Hawisher, Gail

2012-01-01

The authors--drawing on their varied experiences as authors and publishers of a journal and several book series--provide a historical review and consideration of peer review in publishing. They find that scholarly peer review, from the question of signed reviews to the practices of digital publications, is in the midst of change, but that at the…

42 CFR 52h.7 - What matters must be reviewed for grants?

Code of Federal Regulations, 2010 CFR

2010-10-01

... SCIENTIFIC PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT PROJECTS § 52h.7... reviewed by a peer review group in accordance with the provisions of this part and the group has made... appropriate peer review group, in accordance with the provisions of this part, and the group has made...

Comparing Peer Review and Self-Review as Ways to Improve College Students' Writing

ERIC Educational Resources Information Center

Covill, Amy E.

2010-01-01

The effect of three approaches to revision instruction on 61 college students' revision behavior and writing quality was investigated for this article. Students wrote three 5-page papers and received one of three instructional approaches: Formal Peer Review (n = 19), Formal Self-Review (n = 20), or No Formal Review (n = 22). Formal Peer Review…

Biomass Program 2007 Program Peer Review - Full Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

none,

This document summarizes the comments provided by the peer reviewers at the U.S. Department of Energy (DOE) Biomass Program’s Peer Review meeting, held on November 14-15, 2007 in Baltimore, MD and Platform Reviews conducted over the summer of 2007. The Platform Reviews provide evaluations of the Program’s projects in applied research, development, and demonstration.

CTD² Publication Guidelines | Office of Cancer Genomics

Cancer.gov

The Cancer Target Discovery and Development (CTD2) Network is a “community resource project” supported by the National Cancer Institute’s Office of Cancer Genomics. Members of the Network release data to the broader research community by depositing data into NCI-supported or public databases. Data deposition is NOT equivalent to publishing in a peer-reviewed journal. Unless there is a manuscript associated with a dataset, the Network considers data to be formally unpublished.

Translating evidence to policy: urban interventions and physical activity promotion in Bogotá, Colombia and Curitiba, Brazil.

PubMed

Díaz Del Castillo, Adriana; Sarmiento, Olga L; Reis, Rodrigo S; Brownson, Ross C

2011-06-01

The growing evidence of the influence of urban environment on physical activity (PA) underscore the need for novel policy solutions to address the inequality, lack of space, and limited PA resources in rapidly growing Latin American cities. This study aims to better understand the PA policy process by conducting two case studies of Bogotá's Ciclovía and Curitiba's CuritibAtiva. Literature review of peer- and non-peer-reviewed documents and semi-structured interviews with stakeholders was conducted. In the cases of Ciclovía and CuritibAtiva, most policies conducive to program development and sustainability were developed outside the health sector in sports and recreation, urban planning, environment, and transportation. Both programs were developed by governments as initiatives to overcome inequalities and provide quality of life. In both programs, multisectoral policies mainly from recreation and urban planning created a window of opportunity for the development and sustainability of the programs and environments supportive of PA.

Views on the peer review system of biomedical journals: an online survey of academics from high-ranking universities

PubMed Central

2013-01-01

Background Peer review is the major method used by biomedical journals for making the decision of publishing an article. This cross-sectional survey assesses views concerning the review system of biomedical journals among academics globally. Methods A total of 28,009 biomedical academics from high-ranking universities listed by the 2009 Times Higher Education Quacquarelli Symonds (THE-QS) World University Rankings were contacted by email between March 2010 and August 2010. 1,340 completed an online survey which focused on their academic background, negative experiences and views on biomedical journal peer review and the results were compared among basic scientists, clinicians and clinician scientists. Results Fewer than half of the respondents agreed that the peer review systems of biomedical journals were fair (48.4%), scientific (47.5%), or transparent (25.1%). Nevertheless, 58.2% of the respondents agreed that authors should remain anonymous and 64.4% agreed that reviewers should not be disclosed. Most, (67.7%) agreed to the establishment of an appeal system. The proportion of native English-speaking respondents who agreed that the “peer review system is fair” was significantly higher than for non-native respondents (p = 0.02). Similarly, the proportion of clinicians stating that the “peer review system is fair” was significantly higher than that for basic scientists and clinician-scientists (p = 0.004). For females, (β = −0.1, p = 0.03), the frequency of encountering personal attacks in reviewers’ comments (β = −0.1, p = 0.002) and the frequency of imposition of unnecessary references by reviewers (β = −0.06, p = 0.04) were independently and inversely associated with agreement that “the peer review system is fair”. Conclusion Academics are divided on the issue of whether the biomedical journal peer review system is fair, scientific and transparent. A majority of academics agreed with the double-blind peer review and to the establishment of an appeal system. Female academics, experience of personal attacks and imposition of unnecessary references by reviewers were related to disagreement about fairness of the peer review system of biomedical journals. PMID:23758823

Four peer reviews in support of the Tier 3 rulemaking ...

EPA Pesticide Factsheets

Peer review of ERG's KenCaryl (CO) estimated summer hot-soak distributions report in support of the Tier 3 rulemaking To peer review ERG's KenCaryl (CO) estimated summer hot-soak distributions report (for Tier 3 rulemaking)

Children's Evaluations of Resource Allocation in the Context of Group Norms

ERIC Educational Resources Information Center

Cooley, Shelby; Killen, Melanie

2015-01-01

This study investigated children's evaluations of peer group members who deviated from group norms about equal and unequal allocation of resources. Children, ages 3.5 to 4 years and 5 to 6 years (N = 73), were asked to evaluate a peer group member who deviated from 1 of 2 group allocation norms: (a) equal allocation of resources, or (b) unequal…

The Impact of Resource Programs Upon the Self-Concept and Peer Acceptance of Learning Disabled Children

ERIC Educational Resources Information Center

Sheare, Joseph B.

1978-01-01

Experimental group consisted of learning disabled children in regular classes with resource room interventions. Control group consisted of non-learning disabled children stratified by sex and classrooms. The resource based program did not result in significant changes in either self-concept or peer acceptance after one year for the LD group.…

Clinical perspective: creating an effective practice peer review process-a primer.

PubMed

Gandhi, Manisha; Louis, Frances S; Wilson, Shae H; Clark, Steven L

2017-03-01

Peer review serves as an important adjunct to other hospital quality and safety programs. Despite its importance, the available literature contains virtually no guidance regarding the structure and function of effective peer review committees. This Clinical Perspective provides a summary of the purposes, structure, and functioning of effective peer review committees. We also discuss important legal considerations that are a necessary component of such processes. This discussion includes useful templates for case selection and review. Proper committee structure, membership, work flow, and leadership as well as close cooperation with the hospital medical executive committee and legal representatives are essential to any effective peer review process. A thoughtful, fair, systematic, and organized approach to creating a peer review process will lead to confidence in the committee by providers, hospital leadership, and patients. If properly constructed, such committees may also assist in monitoring and enforcing compliance with departmental protocols, thus reducing harm and promoting high-quality practice. Copyright © 2016 Elsevier Inc. All rights reserved.

Using Short Videos to Teach Research Ethics

NASA Astrophysics Data System (ADS)

Loui, M. C.

2014-12-01

Created with support from the National Science Foundation, EthicsCORE (www.natonalethicscenter.org) is an online resource center for ethics in science and engineering. Among the resources, EthicsCORE hosts short video vignettes produced at the University of Nebraska - Lincoln that dramatize problems in the responsible conduct of research, such as peer review of journal submissions, and mentoring relationships between faculty and graduate students. I will use one of the video vignettes in an interactive pedagogical demonstration. After showing the video, I will ask participants to engage in a think-pair-share activity on the professional obligations of researchers. During the sharing phase, participants will supply the reasons for these obligations.

Creating Online Training for Procedures in Global Health with PEARLS (Procedural Education for Adaptation to Resource-Limited Settings).

PubMed

Bensman, Rachel S; Slusher, Tina M; Butteris, Sabrina M; Pitt, Michael B; On Behalf Of The Sugar Pearls Investigators; Becker, Amanda; Desai, Brinda; George, Alisha; Hagen, Scott; Kiragu, Andrew; Johannsen, Ron; Miller, Kathleen; Rule, Amy; Webber, Sarah

2017-11-01

The authors describe a multiinstitutional collaborative project to address a gap in global health training by creating a free online platform to share a curriculum for performing procedures in resource-limited settings. This curriculum called PEARLS (Procedural Education for Adaptation to Resource-Limited Settings) consists of peer-reviewed instructional and demonstration videos describing modifications for performing common pediatric procedures in resource-limited settings. Adaptations range from the creation of a low-cost spacer for inhaled medications to a suction chamber for continued evacuation of a chest tube. By describing the collaborative process, we provide a model for educators in other fields to collate and disseminate procedural modifications adapted for their own specialty and location, ideally expanding this crowd-sourced curriculum to reach a wide audience of trainees and providers in global health.

10 best resources on ... mixed methods research in health systems.

PubMed

Ozawa, Sachiko; Pongpirul, Krit

2014-05-01

Mixed methods research has become increasingly popular in health systems. Qualitative approaches are often used to explain quantitative results and help to develop interventions or survey instruments. Mixed methods research is especially important in low- and middle-income country (LMIC) settings, where understanding social, economic and cultural contexts are essential to assess health systems performance. To provide researchers and programme managers with a guide to mixed methods research in health systems, we review the best resources with a focus on LMICs. We selected 10 best resources (eight peer-reviewed articles and two textbooks) based on their importance and frequency of use (number of citations), comprehensiveness of content, usefulness to readers and relevance to health systems research in resource-limited contexts. We start with an overview on mixed methods research and discuss resources that are useful for a better understanding of the design and conduct of mixed methods research. To illustrate its practical applications, we provide examples from various countries (China, Vietnam, Kenya, Tanzania, Zambia and India) across different health topics (tuberculosis, malaria, HIV testing and healthcare costs). We conclude with some toolkits which suggest what to do when mixed methods findings conflict and provide guidelines for evaluating the quality of mixed methods research.

Intellectual capital in the healthcare sector: a systematic review and critique of the literature.

PubMed

Evans, Jenna M; Brown, Adalsteinn; Baker, G Ross

2015-12-15

Variations in the performance of healthcare organizations may be partly explained by differing "stocks" of intellectual capital (IC), and differing approaches and capacities for leveraging IC. This study synthesizes what is currently known about the conceptualization, management and measurement of IC in healthcare through a review of the literature. Peer-reviewed papers on IC in healthcare published between 1990 and 2014 were identified through searches of five databases using the following key terms: intellectual capital/assets, knowledge capital/assets/resources, and intangible assets/resources. Articles deemed relevant for inclusion underwent systematic data extraction to identify overarching themes and were assessed for their methodological quality. Thirty-seven papers were included in the review. The primary research method used was cross-sectional questionnaires focused on hospital managers' perceptions of IC, followed by semi-structured interviews and analysis of administrative data. Empirical studies suggest that IC is linked to subjective process and performance indicators in healthcare organizations. Although the literature on IC in healthcare is growing, it is not advanced. In this paper, we identify and examine the conceptual, theoretical and methodological limitations of the literature. The concept and framework of IC offer a means to study the value of intangible resources in healthcare organizations, how to manage systematically these resources together, and their mutually enhancing interactions on performance. We offer several recommendations for future research.

An approach for heterogeneous and loosely coupled geospatial data distributed computing

NASA Astrophysics Data System (ADS)

Chen, Bin; Huang, Fengru; Fang, Yu; Huang, Zhou; Lin, Hui

2010-07-01

Most GIS (Geographic Information System) applications tend to have heterogeneous and autonomous geospatial information resources, and the availability of these local resources is unpredictable and dynamic under a distributed computing environment. In order to make use of these local resources together to solve larger geospatial information processing problems that are related to an overall situation, in this paper, with the support of peer-to-peer computing technologies, we propose a geospatial data distributed computing mechanism that involves loosely coupled geospatial resource directories and a term named as Equivalent Distributed Program of global geospatial queries to solve geospatial distributed computing problems under heterogeneous GIS environments. First, a geospatial query process schema for distributed computing as well as a method for equivalent transformation from a global geospatial query to distributed local queries at SQL (Structured Query Language) level to solve the coordinating problem among heterogeneous resources are presented. Second, peer-to-peer technologies are used to maintain a loosely coupled network environment that consists of autonomous geospatial information resources, thus to achieve decentralized and consistent synchronization among global geospatial resource directories, and to carry out distributed transaction management of local queries. Finally, based on the developed prototype system, example applications of simple and complex geospatial data distributed queries are presented to illustrate the procedure of global geospatial information processing.

Why Are Chemists and Other Scientists Afraid of the Peer Review of Teaching?

NASA Astrophysics Data System (ADS)

Atwood, Charles H.; Taylor, James W.; Hutchings, Pat A.

2000-02-01

This paper presents a series of arguments that teaching should be subjected to the similar review standards that chemical research employs. Through peer review, the hope is to elevate the status of teaching in academe. The paper also describes a national effort through the American Association for Higher Education and the Carnegie Foundation for the Advancement of Teaching to establish a peer-review process appropriate for teaching. Finally, an examination of some of the perceived barriers to peer review, including fear, is detailed.

Helping agencies improve their planning analysis techniques.

DOT National Transportation Integrated Search

2011-11-18

This report summarizes the results of a peer review of the AZTDM. The peer review was : supported by the Travel Model Improvement Program (TMIP), which is sponsored by FHWA. : The peer review of a travel model can serve multiple purposes, including i...

EPA Peer Consultation Workshop Report on the Review of the Draft IRIS Toxicological Review of Dibutyl Phthalate (DBP)

EPA Science Inventory

The U.S. EPA finalized comments gathered from a public peer review of the scientific basis supporting the human health hazard and dose-response assessment of dibutyl phthalate (DBP) that will appear on the Integrated Risk Information System (IRIS) database. The peer review has en...

Giving Feedback: Preparing Students for Peer Review and Self-Evaluation

ERIC Educational Resources Information Center

Philippakos, Zoi A.

2017-01-01

Revision is an important aspect of the writing process but is often challenging for students. Peer review can be helpful, but training is needed for it to work effectively. This article suggests an approach to preparing students for peer review by teaching specific evaluation criteria and leading collaborative practice in reviewing papers written…

Writing Quality Peer Reviews of Research Manuscripts

ERIC Educational Resources Information Center

Ward, Phillip; Graber, Kim C.; van der Mars, Hans

2015-01-01

Peer review is an important mechanism for advancing knowledge in a manner deemed as acceptable by the research community. It can also serve the function of providing guidance to an author(s) to improve the likelihood that manuscripts will be accepted in peer reviewed journals. There is, however, little assistance for new or existing reviewers of…

IRIS Toxicological Review and Summary Documents for 1,4-Dichlorobenzene (External Peer Review)

EPA Science Inventory

The U.S. EPA has conducted a peer review of the scientific basis supporting the human health hazard and dose-response assessment of 1,4-dichlorobenzene that will appear on the Integrated Risk Information System (IRIS) database. Peer review is meant to ensure that science is used ...

Biomass Program 2007 Program Peer Review - Feedstock Platform Summary

DOE Office of Scientific and Technical Information (OSTI.GOV)

none,

This document discloses the comments provided by a review panel at the U.S. Department of Energy Office of the Biomass Program Peer Review held on November 15-16, 2007 in Baltimore, MD and the Feedstock Platform Portfolio Peer Review held on August 21st through 23rd in Washington D.C.

Conflict of Interest and Disclosure Policies in Psychiatry and Medicine: A Comparative Study of Peer-Reviewed Journals

ERIC Educational Resources Information Center

Khurana, Gauri; Henderson, Schuyler; Walter, Garry; Martin, Andres

2012-01-01

Objective: The authors reviewed and characterized conflict of interest (COI) and disclosure policies published in peer-reviewed psychiatric and nonpsychiatric journals. Methods: The authors examined peer-reviewed publications in the psychiatric (N=20) and nonpsychiatric (N=20) literature. Using qualitative and quantitative approaches, they…

The Problem of Humiliation in Peer Review

ERIC Educational Resources Information Center

Comer, Debra R.; Schwartz, Michael

2014-01-01

This paper examines the problem of vituperative feedback from peer reviewers. We argue that such feedback is morally unacceptable, insofar as it humiliates authors and damages their dignity. We draw from social-psychological research to explore those aspects of the peer-review process in general and the anonymity of blind reviewing in particular…

Online Peer Review: Encouraging Student Response and Development

ERIC Educational Resources Information Center

Lansiquot, Reneta; Rosalia, Christine

2015-01-01

This study explored the use of a tailored online peer review program for first-year undergraduate students at an urban college of technology. The program facilitated group peer review in meaningful and technologically elegant ways. Students in a composition class were divided into two groups. One group acted as first reviewers, and the other group…

Thank you to our 2016 peer reviewers

NASA Astrophysics Data System (ADS)

Hauck, Steven A.; Baratoux, David; Stanley, Sabine

2017-02-01

Peer review is one of most fundamental aspects of the modern practice of science. As scientists we hold our own work up to scrutiny by experts among our peers in order to encourage the best practices in scientific conduct and communication. Thorough consideration and review by professional colleagues of scientific papers are critical aspects of ensuring that the manuscripts published by JGR-Planets are accurate, valuable, and clearly communicated. Peer review is an essential element of the process of refining understanding and sharing science, and the effort and expertise shared by each reviewer are crucial to the advancement of planetary science. In 2016, JGR Planets benefited from more than 451 reviews provided by 337 of our peers for papers submitted to the journal. Thank you all for your dedication to advancing planetary science.

Extent, Awareness and Perception of Dissemination Bias in Qualitative Research: An Explorative Survey

PubMed Central

Toews, Ingrid; Glenton, Claire; Lewin, Simon; Berg, Rigmor C.; Noyes, Jane; Booth, Andrew; Marusic, Ana; Malicki, Mario; Munthe-Kaas, Heather M.; Meerpohl, Joerg J.

2016-01-01

Background Qualitative research findings are increasingly used to inform decision-making. Research has indicated that not all quantitative research on the effects of interventions is disseminated or published. The extent to which qualitative researchers also systematically underreport or fail to publish certain types of research findings, and the impact this may have, has received little attention. Methods A survey was delivered online to gather data regarding non-dissemination and dissemination bias in qualitative research. We invited relevant stakeholders through our professional networks, authors of qualitative research identified through a systematic literature search, and further via snowball sampling. Results 1032 people took part in the survey of whom 859 participants identified as researchers, 133 as editors and 682 as peer reviewers. 68.1% of the researchers said that they had conducted at least one qualitative study that they had not published in a peer-reviewed journal. The main reasons for non-dissemination were that a publication was still intended (35.7%), resource constraints (35.4%), and that the authors gave up after the paper was rejected by one or more journals (32.5%). A majority of the editors and peer reviewers “(strongly) agreed” that the main reasons for rejecting a manuscript of a qualitative study were inadequate study quality (59.5%; 68.5%) and inadequate reporting quality (59.1%; 57.5%). Of 800 respondents, 83.1% “(strongly) agreed” that non-dissemination and possible resulting dissemination bias might undermine the willingness of funders to support qualitative research. 72.6% and 71.2%, respectively, “(strongly) agreed” that non-dissemination might lead to inappropriate health policy and health care. Conclusions The proportion of non-dissemination in qualitative research is substantial. Researchers, editors and peer reviewers play an important role in this. Non-dissemination and resulting dissemination bias may impact on health care research, practice and policy. More detailed investigations on patterns and causes of the non-dissemination of qualitative research are needed. PMID:27487090

Extent, Awareness and Perception of Dissemination Bias in Qualitative Research: An Explorative Survey.

PubMed

Toews, Ingrid; Glenton, Claire; Lewin, Simon; Berg, Rigmor C; Noyes, Jane; Booth, Andrew; Marusic, Ana; Malicki, Mario; Munthe-Kaas, Heather M; Meerpohl, Joerg J

2016-01-01

Qualitative research findings are increasingly used to inform decision-making. Research has indicated that not all quantitative research on the effects of interventions is disseminated or published. The extent to which qualitative researchers also systematically underreport or fail to publish certain types of research findings, and the impact this may have, has received little attention. A survey was delivered online to gather data regarding non-dissemination and dissemination bias in qualitative research. We invited relevant stakeholders through our professional networks, authors of qualitative research identified through a systematic literature search, and further via snowball sampling. 1032 people took part in the survey of whom 859 participants identified as researchers, 133 as editors and 682 as peer reviewers. 68.1% of the researchers said that they had conducted at least one qualitative study that they had not published in a peer-reviewed journal. The main reasons for non-dissemination were that a publication was still intended (35.7%), resource constraints (35.4%), and that the authors gave up after the paper was rejected by one or more journals (32.5%). A majority of the editors and peer reviewers "(strongly) agreed" that the main reasons for rejecting a manuscript of a qualitative study were inadequate study quality (59.5%; 68.5%) and inadequate reporting quality (59.1%; 57.5%). Of 800 respondents, 83.1% "(strongly) agreed" that non-dissemination and possible resulting dissemination bias might undermine the willingness of funders to support qualitative research. 72.6% and 71.2%, respectively, "(strongly) agreed" that non-dissemination might lead to inappropriate health policy and health care. The proportion of non-dissemination in qualitative research is substantial. Researchers, editors and peer reviewers play an important role in this. Non-dissemination and resulting dissemination bias may impact on health care research, practice and policy. More detailed investigations on patterns and causes of the non-dissemination of qualitative research are needed.

Bridging the Otolaryngology Peer Review Knowledge Gap: A Call for a Residency Development Program.

PubMed

Schmalbach, Cecelia E

2016-07-01

Current otolaryngology literature and future scientific direction rely heavily on a rigorous peer review process. Just as manuscripts warrant thoughtful review with constructive feedback to the authors, the same can be said for critiques written by novice peer reviewers. Formal scientific peer review training programs are lacking. Recognizing this knowledge gap, Otolaryngology-Head and Neck Surgery is excited to offer its new Resident Reviewer Development Program. All otolaryngology residents who are postgraduate year 2 and above and in excellent academic standing are eligible to participate in this mentored program, during which they will conduct 6 manuscript reviews under the direction of a seasoned reviewer in his or her subspecialty area of interest. By completing reviews alongside a mentor, participants gain the required skills to master the peer review process-a first step that often leads to journal editorial board and associate editor invitations. © American Academy of Otolaryngology—Head and Neck Surgery Foundation 2016.

U.S. EPA. 2000. Science Policy Council Handbook: Peer Review

EPA Pesticide Factsheets

The goal of the Peer Review Policy and this Handbook is to enhance the quality and credibility of Agency decisions by ensuring that the scientific and technical work products underlying these decisions receive appropriate levels of peer review by independe

A systematic review of the effectiveness and cost-effectiveness of peer education and peer support in prisons.

PubMed

Bagnall, Anne-Marie; South, Jane; Hulme, Claire; Woodall, James; Vinall-Collier, Karen; Raine, Gary; Kinsella, Karina; Dixey, Rachael; Harris, Linda; Wright, Nat M J

2015-03-25

Prisoners experience significantly worse health than the general population. This review examines the effectiveness and cost-effectiveness of peer interventions in prison settings. A mixed methods systematic review of effectiveness and cost-effectiveness studies, including qualitative and quantitative synthesis was conducted. In addition to grey literature identified and searches of websites, nineteen electronic databases were searched from 1985 to 2012. Study selection criteria were: Prisoners resident in adult prisons and children resident in Young Offender Institutions (YOIs). Peer-based interventions. Review questions 3 and 4 compared peer and professionally led approaches. Prisoner health or determinants of health; organisational/process outcomes; views of prison populations. Quantitative, qualitative and mixed method evaluations. Fifty-seven studies were included in the effectiveness review and one study in the cost-effectiveness review; most were of poor methodological quality. Evidence suggested that peer education interventions are effective at reducing risky behaviours, and that peer support services are acceptable within the prison environment and have a positive effect on recipients, practically or emotionally. Consistent evidence from many, predominantly qualitative, studies, suggested that being a peer deliverer was associated with positive effects. There was little evidence on cost-effectiveness of peer-based interventions. There is consistent evidence from a large number of studies that being a peer worker is associated with positive health; peer support services are also an acceptable source of help within the prison environment and can have a positive effect on recipients. Research into cost-effectiveness is sparse. PROSPERO ref: CRD42012002349.

Letting the daylight in: Reviewing the reviewers and other ways to maximize transparency in science

PubMed Central

Wicherts, Jelte M.; Kievit, Rogier A.; Bakker, Marjan; Borsboom, Denny

2012-01-01

With the emergence of online publishing, opportunities to maximize transparency of scientific research have grown considerably. However, these possibilities are still only marginally used. We argue for the implementation of (1) peer-reviewed peer review, (2) transparent editorial hierarchies, and (3) online data publication. First, peer-reviewed peer review entails a community-wide review system in which reviews are published online and rated by peers. This ensures accountability of reviewers, thereby increasing academic quality of reviews. Second, reviewers who write many highly regarded reviews may move to higher editorial positions. Third, online publication of data ensures the possibility of independent verification of inferential claims in published papers. This counters statistical errors and overly positive reporting of statistical results. We illustrate the benefits of these strategies by discussing an example in which the classical publication system has gone awry, namely controversial IQ research. We argue that this case would have likely been avoided using more transparent publication practices. We argue that the proposed system leads to better reviews, meritocratic editorial hierarchies, and a higher degree of replicability of statistical analyses. PMID:22536180

A scoping review of training and deployment policies for human resources for health for maternal, newborn, and child health in rural Africa.

PubMed

Murphy, Gail Tomblin; Goma, Fastone; MacKenzie, Adrian; Bradish, Stephanie; Price, Sheri; Nzala, Selestine; Rose, Annette Elliott; Rigby, Janet; Muzongwe, Chilweza; Chizuni, Nellisiwe; Carey, Amanda; Hamavhwa, Derrick

2014-12-16

Most African countries are facing a human resources for health (HRH) crisis, lacking the required workforce to deliver basic health care, including care for mothers and children. This is especially acute in rural areas and has limited countries' abilities to meet maternal, newborn, and child health (MNCH) targets outlined by Millennium Development Goals 4 and 5. To address the HRH challenges, evidence-based deployment and training policies are required. However, the resources available to country-level policy makers to create such policies are limited. To inform future HRH planning, a scoping review was conducted to identify the type, extent, and quality of evidence that exists on HRH policies for rural MNCH in Africa. Fourteen electronic health and health education databases were searched for peer-reviewed papers specific to training and deployment policies for doctors, nurses, and midwives for rural MNCH in African countries with English, Portuguese, or French as official languages. Non-peer reviewed literature and policy documents were also identified through systematic searches of selected international organizations and government websites. Documents were included based on pre-determined criteria. There was an overall paucity of information on training and deployment policies for HRH for MNCH in rural Africa; 37 articles met the inclusion criteria. Of these, the majority of primary research studies employed a variety of qualitative and quantitative methods. Doctors, nurses, and midwives were equally represented in the selected policy literature. Policies focusing exclusively on training or deployment were limited; most documents focused on both training and deployment or were broader with embedded implications for the management of HRH or MNCH. Relevant government websites varied in functionality and in the availability of policy documents. The lack of available documentation and an apparent bias towards HRH research in developed areas suggest a need for strengthened capacity for HRH policy research in Africa. This will result in enhanced potential for evidence uptake into policy. Enhanced alignment between policy-makers' information needs and the independent research agenda could further assist knowledge development and uptake. The results of this scoping review informed an in-depth analysis of relevant policies in a sub-set of African countries.

Identifying attributes of food literacy: a scoping review.

PubMed

Azevedo Perry, Elsie; Thomas, Heather; Samra, H Ruby; Edmonstone, Shannon; Davidson, Lyndsay; Faulkner, Amy; Petermann, Lisa; Manafò, Elizabeth; Kirkpatrick, Sharon I

2017-09-01

An absence of food literacy measurement tools makes it challenging for nutrition practitioners to assess the impact of food literacy on healthy diets and to evaluate the outcomes of food literacy interventions. The objective of the present scoping review was to identify the attributes of food literacy. A scoping review of peer-reviewed and grey literature was conducted and attributes of food literacy identified. Subjects included in the search were high-risk groups. Eligible articles were limited to research from Canada, USA, the UK, Australia and New Zealand. The search identified nineteen peer-reviewed and thirty grey literature sources. Fifteen identified food literacy attributes were organized into five categories. Food and Nutrition Knowledge informs decisions about intake and distinguishing between 'healthy' and 'unhealthy' foods. Food Skills focuses on techniques of food purchasing, preparation, handling and storage. Self-Efficacy and Confidence represent one's capacity to perform successfully in specific situations. Ecologic refers to beyond self and the interaction of macro- and microsystems with food decisions and behaviours. Food Decisions reflects the application of knowledge, information and skills to make food choices. These interdependent attributes are depicted in a proposed conceptual model. The lack of evaluated tools inhibits the ability to assess and monitor food literacy; tailor, target and evaluate programmes; identify gaps in programming; engage in advocacy; and allocate resources. The present scoping review provides the foundation for the development of a food literacy measurement tool to address these gaps.

Expanding capacity and promoting inclusion in introductory computer science: a focus on near-peer mentor preparation and code review

NASA Astrophysics Data System (ADS)

Pon-Barry, Heather; Packard, Becky Wai-Ling; St. John, Audrey

2017-01-01

A dilemma within computer science departments is developing sustainable ways to expand capacity within introductory computer science courses while remaining committed to inclusive practices. Training near-peer mentors for peer code review is one solution. This paper describes the preparation of near-peer mentors for their role, with a focus on regular, consistent feedback via peer code review and inclusive pedagogy. Introductory computer science students provided consistently high ratings of the peer mentors' knowledge, approachability, and flexibility, and credited peer mentor meetings for their strengthened self-efficacy and understanding. Peer mentors noted the value of videotaped simulations with reflection, discussions of inclusion, and the cohort's weekly practicum for improving practice. Adaptations of peer mentoring for different types of institutions are discussed. Computer science educators, with hopes of improving the recruitment and retention of underrepresented groups, can benefit from expanding their peer support infrastructure and improving the quality of peer mentor preparation.

Implementation and Validation of PACS Integrated Peer Review for Discrepancy Recording of Radiology Reporting.

PubMed

Olthof, A W; van Ooijen, P M A

2016-09-01

The purpose of this work is to demonstrate the possibility of implementation of a PACS-integrated peer review system based on RADPEER™ classification providing a step-wise implementation plan utilizing features already present in the standard PACS implementation and without the requirement of additional software development. Furthermore, we show the usage and effects of the system during the first 30 months of usage. To allow fast and easy implementation into the daily workflow the key-word feature of the PACS was used. This feature allows to add a key-word to an imaging examination for easy searching in the PACS database (e.g. by entering keywords for different kinds of pathology). For peer review we implemented a keyword structure including a code for each of the existing RADPEER™ scoring language terms and a keyword with the phrase "second reading" followed by the name of the individual radiologist. The use of the short-keys to enter the codes in relation to the peer review was a simple to use solution. During the study 599 reports were peer reviewed. The active participation in this study of the radiologists varies and ranges from 3 to 327 reviews per radiologist. The number of peer review is highest in CT and CR. There are no significant technical obstacles to implement a PACS-integrated RADPEER™ -system based on key-words allowing easy integration of peer review into the daily routine without the requirement of additional software. Peer review implemented in a non-random setting based on relevant priors could already help in increasing the quality of radiological reporting and serve as continuing education among peers. Decisiveness, tact and trust are needed to promote use of the system and collaborative discussion of the results by radiologist.

What's with all this peer-review stuff anyway?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Warner, J. S.

2010-01-01

The Journal of Physical Security was ostensibly started to deal with a perceived lack of peer-reviewed journals related to the field of physical security. In fact, concerns have been expressed that the field of physical security is scarcely a field at all. A typical, well-developed field might include the following: multiple peer-reviewed journals devoted to the subject, rigor and critical thinking, metrics, fundamental principles, models and theories, effective standards and guidelines, R and D conferences, professional societies, certifications, its own academic department (or at least numerous academic experts), widespread granting of degrees in the field from 4-year research universities, mechanismsmore » for easily spotting 'snake oil' products and services, and the practice of professionals organizing to police themselves, provide quality control, and determine best practices. Physical Security seems to come up short in a number of these areas. Many of these attributes are difficult to quantify. This paper seeks to focus on one area that is quantifiable: the number of peer-reviewed journals dedicated to the field of Physical Security. In addition, I want to examine the number of overall periodicals (peer-reviewed and non-peer-reviewed) dedicated to physical security, as well as the number of papers published each year about physical security. These are potentially useful analyses because one can often infer how healthy or active a given field is by its publishing activity. For example, there are 2,754 periodicals dedicated to the (very healthy and active) field of physics. This paper concentrates on trade journal versus peer-reviewed journals. Trade journals typically focus on practice-related topics. A paper appropriate for a trade journal is usually based more on practical experience than rigorous studies or research. Models, theories, or rigorous experimental research results will usually not be included. A trade journal typically targets a specific market in an industry or trade. Such journals are often considered to be news magazines and may contain industry specific advertisements and/or job ads. A peer-reviewed journal, a.k.a 'referred journal', in contrast, contains peer-reviewed papers. A peer-reviewed paper is one that has been vetted by the peer review process. In this process, the paper is typically sent to independent experts for review and consideration. A peer-reviewed paper might cover experimental results, and/or a rigorous study, analyses, research efforts, theory, models, or one of many other scholarly endeavors.« less

Review and Synthesize Completed Research Through Systematic Review.

PubMed

Hopp, Lisa; Rittenmeyer, Leslie

2015-10-01

The evidence-based health care movement has generated new opportunity for scholars to generate synthesized sources of evidence. Systematic reviews are rigorous forms of synthesized evidence that scholars can conduct if they have requisite skills, time, and access to excellent library resources. Systematic reviews play an important role in synthesizing what is known and unknown about a particular health issue. Thus, they have a synergistic relationship with primary research. They can both inform clinical decisions when the evidence is adequate and identify gaps in knowledge to inform research priorities. Systematic reviews can be conducted of quantitative and qualitative evidence to answer many types of questions. They all share characteristics of rigor that arise from a priori protocol development, transparency, exhaustive searching, dual independent reviewers who critically appraise studies using standardized tools, rigor in synthesis, and peer review at multiple stages in the conduct and reporting of the systematic review. © The Author(s) 2015.

Resource utilisation and costs in predementia and dementia: a systematic review protocol

PubMed Central

Landeiro, Filipa; Wace, Helena; Ghinai, Isaac; Nye, Elsbeth; Mughal, Seher; Walsh, Katie; Roberts, Nia; Lecomte, Pascal; Wittenberg, Raphael; Wolstenholme, Jane; Handels, Ron; Roncancio-Diaz, Emilse; Potashman, Michele H; Tockhorn-Heidenreich, Antje; Gray, Alastair M

2018-01-01

Introduction Dementia is the fastest growing major cause of disability globally with a mounting social and financial impact for patients and their families but also to health and social care systems. This review aims to systematically synthesise evidence on the utilisation of resources and costs incurred by patients and their caregivers and by health and social care services across the full spectrum of dementia, from its preceding preclinical stage to end of life. The main drivers of resources used and costs will also be identified. Methods and analysis A systematic literature review was conducted in MEDLINE, EMBASE, CDSR, CENTRAL, DARE, EconLit, CEA Registry, TRIP, NHS EED, SCI, RePEc and OpenGrey between January 2000 and beginning of May 2017. Two reviewers will independently assess each study for inclusion and disagreements will be resolved by a third reviewer. Data will be extracted using a predefined data extraction form following best practice. Study quality will be assessed with the Effective Public Health Practice Project quality assessment tool. The reporting of costing methodology will be assessed using the British Medical Journal checklist. A narrative synthesis of all studies will be presented for resources used and costs incurred, by level of disease severity when available. If feasible, the data will be synthesised using appropriate statistical techniques. Ethics and dissemination Included articles will be reviewed for an ethics statement. The findings of the review will be disseminated in a related peer-reviewed journal and presented at conferences. They will also contribute to the work developed in the Real World Outcomes across the Alzheimer’s disease spectrum for better care: multi-modal data access platform (ROADMAP). Trial registration number CRD42017071413. PMID:29362261

Resource utilisation and costs in predementia and dementia: a systematic review protocol.

PubMed

Landeiro, Filipa; Wace, Helena; Ghinai, Isaac; Nye, Elsbeth; Mughal, Seher; Walsh, Katie; Roberts, Nia; Lecomte, Pascal; Wittenberg, Raphael; Wolstenholme, Jane; Handels, Ron; Roncancio-Diaz, Emilse; Potashman, Michele H; Tockhorn-Heidenreich, Antje; Gray, Alastair M

2018-01-23

Dementia is the fastest growing major cause of disability globally with a mounting social and financial impact for patients and their families but also to health and social care systems. This review aims to systematically synthesise evidence on the utilisation of resources and costs incurred by patients and their caregivers and by health and social care services across the full spectrum of dementia, from its preceding preclinical stage to end of life. The main drivers of resources used and costs will also be identified. A systematic literature review was conducted in MEDLINE, EMBASE, CDSR, CENTRAL, DARE, EconLit, CEA Registry, TRIP, NHS EED, SCI, RePEc and OpenGrey between January 2000 and beginning of May 2017. Two reviewers will independently assess each study for inclusion and disagreements will be resolved by a third reviewer. Data will be extracted using a predefined data extraction form following best practice. Study quality will be assessed with the Effective Public Health Practice Project quality assessment tool. The reporting of costing methodology will be assessed using the British Medical Journal checklist. A narrative synthesis of all studies will be presented for resources used and costs incurred, by level of disease severity when available. If feasible, the data will be synthesised using appropriate statistical techniques. Included articles will be reviewed for an ethics statement. The findings of the review will be disseminated in a related peer-reviewed journal and presented at conferences. They will also contribute to the work developed in the Real World Outcomes across the Alzheimer's disease spectrum for better care: multi-modal data access platform (ROADMAP). CRD42017071413. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Barriers and attitudes influencing non-engagement in a peer feedback model to inform evidence for GP appraisal

PubMed Central

2012-01-01

Background The UK general practitioner (GP) appraisal system is deemed to be an inadequate source of performance evidence to inform a future medical revalidation process. A long-running voluntary model of external peer review in the west of Scotland provides feedback by trained peers on the standard of GP colleagues' core appraisal activities and may 'add value' in strengthening the robustness of the current system in support of revalidation. A significant minority of GPs has participated in the peer feedback model, but a clear majority has yet to engage with it. We aimed to explore the views of non-participants to identify barriers to engagement and attitudes to external peer review as a means to inform the current appraisal system. Methods We conducted semi-structured interviews with a sample of west of Scotland GPs who had yet to participate in the peer review model. A thematic analysis of the interview transcriptions was conducted using a constant comparative approach. Results 13 GPs were interviewed of whom nine were males. Four core themes were identified in relation to the perceived and experienced 'value' placed on the topics discussed and their relevance to routine clinical practice and professional appraisal: 1. Value of the appraisal improvement activity. 2. Value of external peer review. 3. Value of the external peer review model and host organisation and 4. Attitudes to external peer review. Conclusions GPs in this study questioned the 'value' of participation in the external peer review model and the national appraisal system over the standard of internal feedback received from immediate work colleagues. There was a limited understanding of the concept, context and purpose of external peer review and some distrust of the host educational provider. Future engagement with the model by these GPs is likely to be influenced by policy to improve the standard of appraisal and contractual related activities, rather than a self-directed recognition of learning needs. PMID:22443714

Barriers and attitudes influencing non-engagement in a peer feedback model to inform evidence for GP appraisal.

PubMed

Curnock, Esther; Bowie, Paul; Pope, Lindsey; McKay, John

2012-03-23

The UK general practitioner (GP) appraisal system is deemed to be an inadequate source of performance evidence to inform a future medical revalidation process. A long-running voluntary model of external peer review in the west of Scotland provides feedback by trained peers on the standard of GP colleagues' core appraisal activities and may 'add value' in strengthening the robustness of the current system in support of revalidation. A significant minority of GPs has participated in the peer feedback model, but a clear majority has yet to engage with it. We aimed to explore the views of non-participants to identify barriers to engagement and attitudes to external peer review as a means to inform the current appraisal system. We conducted semi-structured interviews with a sample of west of Scotland GPs who had yet to participate in the peer review model. A thematic analysis of the interview transcriptions was conducted using a constant comparative approach. 13 GPs were interviewed of whom nine were males. Four core themes were identified in relation to the perceived and experienced 'value' placed on the topics discussed and their relevance to routine clinical practice and professional appraisal: 1. Value of the appraisal improvement activity. 2. Value of external peer review. 3. Value of the external peer review model and host organisation and 4. Attitudes to external peer review. GPs in this study questioned the 'value' of participation in the external peer review model and the national appraisal system over the standard of internal feedback received from immediate work colleagues. There was a limited understanding of the concept, context and purpose of external peer review and some distrust of the host educational provider. Future engagement with the model by these GPs is likely to be influenced by policy to improve the standard of appraisal and contractual related activities, rather than a self-directed recognition of learning needs.

search.bioPreprint: a discovery tool for cutting edge, preprint biomedical research articles

PubMed Central

Iwema, Carrie L.; LaDue, John; Zack, Angela; Chattopadhyay, Ansuman

2016-01-01

The time it takes for a completed manuscript to be published traditionally can be extremely lengthy. Article publication delay, which occurs in part due to constraints associated with peer review, can prevent the timely dissemination of critical and actionable data associated with new information on rare diseases or developing health concerns such as Zika virus. Preprint servers are open access online repositories housing preprint research articles that enable authors (1) to make their research immediately and freely available and (2) to receive commentary and peer review prior to journal submission. There is a growing movement of preprint advocates aiming to change the current journal publication and peer review system, proposing that preprints catalyze biomedical discovery, support career advancement, and improve scientific communication. While the number of articles submitted to and hosted by preprint servers are gradually increasing, there has been no simple way to identify biomedical research published in a preprint format, as they are not typically indexed and are only discoverable by directly searching the specific preprint server websites. To address this issue, we created a search engine that quickly compiles preprints from disparate host repositories and provides a one-stop search solution. Additionally, we developed a web application that bolsters the discovery of preprints by enabling each and every word or phrase appearing on any web site to be integrated with articles from preprint servers. This tool, search.bioPreprint, is publicly available at http://www.hsls.pitt.edu/resources/preprint. PMID:27508060

Use of wildlife webcams - Literature review and annotated bibliography

USGS Publications Warehouse

Ratz, Joan M.; Conk, Shannon J.

2010-01-01

The U.S. Fish and Wildlife Service National Conservation Training Center requested a literature review product that would serve as a resource to natural resource professionals interested in using webcams to connect people with nature. The literature review focused on the effects on the public of viewing wildlife through webcams and on information regarding installation and use of webcams. We searched the peer reviewed, published literature for three topics: wildlife cameras, virtual tourism, and technological nature. Very few publications directly addressed the effect of viewing wildlife webcams. The review of information on installation and use of cameras yielded information about many aspects of the use of remote photography, but not much specifically regarding webcams. Aspects of wildlife camera use covered in the literature review include: camera options, image retrieval, system maintenance and monitoring, time to assemble, power source, light source, camera mount, frequency of image recording, consequences for animals, and equipment security. Webcam technology is relatively new and more publication regarding the use of the technology is needed. Future research should specifically study the effect that viewing wildlife through webcams has on the viewers' conservation attitudes, behaviors, and sense of connectedness to nature.

Online Peer-to-Peer Support for Young People With Mental Health Problems: A Systematic Review.

PubMed

Ali, Kathina; Farrer, Louise; Gulliver, Amelia; Griffiths, Kathleen M

2015-01-01

Adolescence and early adulthood are critical periods for the development of mental disorders. Online peer-to-peer communication is popular among young people and may improve mental health by providing social support. Previous systematic reviews have targeted Internet support groups for adults with mental health problems, including depression. However, there have been no systematic reviews examining the effectiveness of online peer-to-peer support in improving the mental health of adolescents and young adults. The aim of this review was to systematically identify available evidence for the effectiveness of online peer-to peer support for young people with mental health problems. The PubMed, PsycInfo, and Cochrane databases were searched using keywords and Medical Subject Headings (MeSH) terms. Retrieved abstracts (n=3934) were double screened and coded. Studies were included if they (1) investigated an online peer-to-peer interaction, (2) the interaction discussed topics related to mental health, (3) the age range of the sample was between 12 to 25 years, and (4) the study evaluated the effectiveness of the peer-to-peer interaction. Six studies satisfied the inclusion criteria for the current review. The studies targeted a range of mental health problems including depression and anxiety (n=2), general psychological problems (n=1), eating disorders (n=1), and substance use (tobacco) (n=2). The majority of studies investigated Internet support groups (n=4), and the remaining studies focused on virtual reality chat sessions (n=2). In almost all studies (n=5), the peer support intervention was moderated by health professionals, researchers or consumers. Studies employed a range of study designs including randomized controlled trials (n=3), pre-post studies (n=2) and one randomized trial. Overall, two of the randomized controlled trials were associated with a significant positive outcome in comparison to the control group at post-intervention. In the remaining four studies, peer-to-peer support was not found to be effective. This systematic review identified an overall lack of high-quality studies examining online peer-to-peer support for young people. Given that peer support is frequently used as an adjunct to Internet interventions for a variety of mental health conditions, there is an urgent need to determine the effectiveness of peer support alone as an active intervention.

28 CFR 34.101 - Exceptions to applicability.

Code of Federal Regulations, 2010 CFR

2010-07-01

... Section 34.101 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.101 Exceptions to applicability. The assistance and procurement contract situations... outside the scope of the section 262(d) peer review requirement as set forth in this subpart. ...

The "peer" in "peer review"

USGS Publications Warehouse

Perry, Gad; Bertoluci, Jaime; Bury, R. Bruce; Hansen, Robert W.; Jehle, Robert; Measey, John; Moon, Brad R.; Muths, Erin L.; Zuffi, Marco A.L.

2011-01-01

Peer review is the best available mechanism for assessing and improving the quality of scientific work. As herpetology broadens its disciplinary and geographic boundaries, high-quality external review is ever more essential. We are writing this editorial jointly because the review process has become increasingly difficult. The resulting delays slow publication times, negatively affect performance reviews, tenure, promotions, and grant proposal success. It harms authors, agencies, and institutions (Ware 2011).

A Descriptive Study of Nursing Peer-Review Programs in US Magnet® Hospitals.

PubMed

Roberts, Holli; Cronin, Sherill Nones

2017-04-01

The goal of this study was to assess the types of nursing peer review (NPR) programs in US Magnet® organizations. The 2 most predominant models of NPR programs in the literature are performance evaluation and clinical peer review. The literature on clinical peer review is primarily descriptive, outlining structures and anecdotal outcomes. Participants from hospitals holding Magnet recognition were selected using a stratified random-sampling method. A survey developed by the researchers assessed the presence of NPR. If clinical NPR was in place, program design, evaluation measurements, and barriers were explored. Findings suggest wide variability in NPR models. More than one-third of the respondents conduct peer evaluation as the only mechanism of NPR. Most hospitals with a clinical peer-review program reported a case review structure and process measurements not supported by data. The variations noted in this study suggest more research is needed to measure the effectiveness of NPR models and associated outcomes.

Timely deposition of macromolecular structures is necessary for peer review

DOE Office of Scientific and Technical Information (OSTI.GOV)

Joosten, Robbie P.; Soueidan, Hayssam; Wessels, Lodewyk F. A.

2013-12-01

Deposition of crystallographic structures should be concurrent with or prior to manuscript submission for peer review, enabling validation and increasing reliability of the PDB. Most of the macromolecular structures in the Protein Data Bank (PDB), which are used daily by thousands of educators and scientists alike, are determined by X-ray crystallography. It was examined whether the crystallographic models and data were deposited to the PDB at the same time as the publications that describe them were submitted for peer review. This condition is necessary to ensure pre-publication validation and the quality of the PDB public archive. It was found thatmore » a significant proportion of PDB entries were submitted to the PDB after peer review of the corresponding publication started, and many were only submitted after peer review had ended. It is argued that clear description of journal policies and effective policing is important for pre-publication validation, which is key in ensuring the quality of the PDB and of peer-reviewed literature.« less

Peer Review and Surgical Innovation: Robotic Surgery and Its Hurdles.

PubMed

Vyas, Dinesh; Cronin, Sean

2015-12-01

The peer review processes as outlined in the Health Care Quality Improvement Act (HCQIA) is meant ensure quality standard of care through a self-policing mechanism by the medical community. This process grants immunity for people filing a peer review, which is meant to protect whistleblowers. However, it also creates a loophole that can be used maliciously to hinder competition. This is accentuated when surgeons are integrating new technologies, such as robotic surgery, into their practice. With more than 2000 da Vinci robots in use and more than 300 new units being shipped each year, robotic surgery has become a mainstay in the surgical field. The applications for robots continue to expand as surgeons discover their expanding capability. We need a better peer review process. That ensures the peer review is void of competitive bias. Peer reviewers need to be familiar with the procedure and the technology. The current process could stymie innovation in the name of competition.

Quality Control and Peer Review of Data Sets: Mapping Data Archiving Processes to Data Publication Requirements

NASA Astrophysics Data System (ADS)

Mayernik, M. S.; Daniels, M.; Eaker, C.; Strand, G.; Williams, S. F.; Worley, S. J.

2012-12-01

Data sets exist within scientific research and knowledge networks as both technical and non-technical entities. Establishing the quality of data sets is a multi-faceted task that encompasses many automated and manual processes. Data sets have always been essential for science research, but now need to be more visible as first-class scholarly objects at national, international, and local levels. Many initiatives are establishing procedures to publish and curate data sets, as well as to promote professional rewards for researchers that collect, create, manage, and preserve data sets. Traditionally, research quality has been assessed by peer review of textual publications, e.g. journal articles, conference proceedings, and books. Citation indices then provide standard measures of productivity used to reward individuals for their peer-reviewed work. Whether a similar peer review process is appropriate for assessing and ensuring the quality of data sets remains as an open question. How does the traditional process of peer review apply to data sets? This presentation will describe current work being done at the National Center for Atmospheric Research (NCAR) in the context of the Peer REview for Publication & Accreditation of Research Data in the Earth sciences (PREPARDE) project. PREPARDE is assessing practices and processes for data peer review, with the goal of developing recommendations. NCAR data management teams perform various kinds of quality assessment and review of data sets prior to making them publicly available. The poster will investigate how notions of peer review relate to the types of data review already in place at NCAR. We highlight the data set characteristics and management/archiving processes that challenge the traditional peer review processes by using a number of questions as probes, including: Who is qualified to review data sets? What formal and informal documentation is necessary to allow someone outside of a research team to review a data set? What data set review can be done pre-publication, and what must be done post-publication? What components of the data sets review processes can be automated, and what components will always require human expertise and evaluation?

Tardive Dyskinesia

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Hemicrania Continua

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Benign Essential Blepharospasm

MedlinePlus

... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ... Supplements Peer Review Process Review Committees Application Support Library Clinical Research Next Steps Pre-Funding: After Review Terms of ...

Modeling and analysis needs and resources for small metropolitan area transportation planning : report on a peer exchange.

DOT National Transportation Integrated Search

2012-09-01

A peer exchange on Modeling and Analysis Needs and Resources for Small Metropolitan Area Transportation Planning was convened on August 28 and 29, 2011, to explore the state of transportation modeling and analysis practice in communities with populat...

Maintaining live discussion in two-stage open peer review.

PubMed

Sandewall, Erik

2012-01-01

Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome.

Maintaining Live Discussion in Two-Stage Open Peer Review

PubMed Central

Sandewall, Erik

2011-01-01

Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome. PMID:22363282

Doing a Good Deed or Confounding the Problem? Peer Review and Sociology Textbooks.

ERIC Educational Resources Information Center

Kendall, Diana

1999-01-01

Examines how the peer review process influences the writing and publication of sociology textbooks and the teaching of sociology. States that the peer review process may influence the final textbook in five ways: (1) degree of innovation; (2) length; (3) reading level; (4) cloning ancillaries and accessories; and (5) using reviewers as marketing…

Applying Peer Reviews in Software Engineering Education: An Experiment and Lessons Learned

ERIC Educational Resources Information Center

Garousi, V.

2010-01-01

Based on the demonstrated value of peer reviews in the engineering industry, numerous industry experts have listed it at the top of the list of desirable development practices. Experience has shown that problems (defects) are eliminated earlier if a development process incorporates peer reviews and that these reviews are as effective as or even…

Who benefits from peer review? An analysis of the outcome of 100 requests for review by Plastic and Reconstructive Surgery.

PubMed

Loonen, Martijn P J; Hage, J Joris; Kon, Moshe

2005-10-01

Little is known of what is done with the comments on submitted manuscripts provided by peer reviewers or to what extent these comments benefit the editor in deciding to accept or reject the manuscript, the author(s) in revising their manuscript, or the readership at large. Furthermore, nothing is known of any possible benefits of the process to the peer reviewer. Finally, the peer-review process may even be maleficent because of its implicit delay of publication and a possible bias against manuscripts originating from non-Anglo-American countries. The authors evaluated the benefits of the peer-review process to authors, editor, readers, and reviewers by a bibliometric analysis of the outcome of 100 requests for review made by the editor of Plastic and Reconstructive Surgery from 1992 through 2003. The publication delay and potential geographical bias were evaluated as potential disadvantages. The authors' reviewer advised acceptance of 56 percent of the manuscripts, and the editor mostly agreed with his advice. This suggests that the editor benefited from the review. The authors addressed 48 to 81 percent of the reviewer's constructive suggestions, and this suggests that they and the readers benefited also. Readers of Plastic and Reconstructive Surgery may further benefit because manuscripts rejected by Plastic and Reconstructive Surgery end up in less prestigious journals. The implicit delay of publication is limited, and the authors found no bias against non-Anglo-American submissions. The cost-effectiveness of the process for the peer reviewer remains unclear. The peer-review system of Plastic and Reconstructive Surgery, in general, is beneficial.

Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency

PubMed Central

Frampton, Geoff K.; Pickett, Karen; Wyatt, Jeremy C.

2018-01-01

Objective To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. Methods A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review ‘innovations’. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. Results A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. Conclusions There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality. PMID:29750807

Organised Governmental Learning: Vocational Education and Training Practices between Peer Review and Peer Learning

ERIC Educational Resources Information Center

Speer, Sandra

2011-01-01

Peer learning has already existed for a long time, as an informal as well as a formal practice between people from the same professional area. However, peer learning systems on the macro level are relatively newer concepts. Policy learning can be fostered by various types of organised activities, ranging from peer review frameworks, which often…

Peering into peer-review at GigaScience.

PubMed

Edmunds, Scott C

2013-01-24

Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process.

Two decades of external peer review of cancer care in general hospitals; the Dutch experience.

PubMed

Kilsdonk, Melvin J; Siesling, Sabine; Otter, Rene; van Harten, Wim H

2016-03-01

External peer review was introduced in general hospitals in the Netherlands in 1994 to assess and improve the multidisciplinary team approach in cancer care. This paper aims to explore the value, perceived impact, and (future) role of external peer review in cancer care. Semistructured interviews were held with clinicians, oncology nurses, and managers from fifteen general hospitals that participated in three rounds of peer review over a period of 16 years. Interviewees reflected on the goals and expectations, experiences, perceived impact, and future role of external peer review. Transcriptions of the interviews were coded to discover recurrent themes. Improving clinical care and organization were the main motives for participation. Positive impact was perceived on multiple aspects of care such as shared responsibilities, internal prioritization of cancer care, improved communication, and a clear structure and position of cancer care within general hospitals. Establishing a direct relationship between the external peer review and organizational or clinical impact proved to be difficult. Criticism was raised on the content of the program being too theoretical and organization-focussed after three rounds. According to most stakeholders, external peer review can improve multidisciplinary team work in cancer care; however, the acceptance is threatened by a perceived disbalance between effort and visible clinical impact. Leaner and more clinically focused programs are needed to keep repeated peer reviews challenging and worthwhile. © 2015 The Authors. Cancer Medicine published by John Wiley & Sons Ltd.

Information Quality in Regulatory Decision Making: Peer Review versus Good Laboratory Practice.

PubMed

McCarty, Lynn S; Borgert, Christopher J; Mihaich, Ellen M

2012-07-01

There is an ongoing discussion on the provenance of toxicity testing data regarding how best to ensure its validity and credibility. A central argument is whether journal peer-review procedures are superior to Good Laboratory Practice (GLP) standards employed for compliance with regulatory mandates. We sought to evaluate the rationale for regulatory decision making based on peer-review procedures versus GLP standards. We examined pertinent published literature regarding how scientific data quality and validity are evaluated for peer review, GLP compliance, and development of regulations. Some contend that peer review is a coherent, consistent evaluative procedure providing quality control for experimental data generation, analysis, and reporting sufficient to reliably establish relative merit, whereas GLP is seen as merely a tracking process designed to thwart investigator corruption. This view is not supported by published analyses pointing to subjectivity and variability in peer-review processes. Although GLP is not designed to establish relative merit, it is an internationally accepted quality assurance, quality control method for documenting experimental conduct and data. Neither process is completely sufficient for establishing relative scientific soundness. However, changes occurring both in peer-review processes and in regulatory guidance resulting in clearer, more transparent communication of scientific information point to an emerging convergence in ensuring information quality. The solution to determining relative merit lies in developing a well-documented, generally accepted weight-of-evidence scheme to evaluate both peer-reviewed and GLP information used in regulatory decision making where both merit and specific relevance inform the process.

Appendix G: Peer review nondisclosure agreement

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

This peer review nondisclosure agreement should be signed by each reviewer prior to the program sending review materials if sensitive or proprietary information will be provided reviewers or discussed during the review, and to everyone attending a review.

A Review of Peer Social Development in Early Childhood.

ERIC Educational Resources Information Center

Goin, Robin P.

1998-01-01

Reviews the literature on young children's peer social development. Addresses implications of social learning theory and empirical research. Discusses recurring themes, including child/peer versus child/adult interactions, incorporation of toys and games, influence of mothers, and gender peer preferences. Considers areas lacking empirical support…

Peer Observation of Teaching: Reflections of an Early Career Academic

ERIC Educational Resources Information Center

Eri, Rajaraman

2014-01-01

Peer observation of teaching (POT) is a reciprocal process where a peer observes another's teaching (classroom, virtual, on-line or even teaching resource such as unit outlines, assignments). Peers then provide constructive feedbacks that would enable teaching professional development through the mirror of critical reflection by both the observer…

Do peers matter? A review of peer and/or friends' influence on physical activity among American adolescents.

PubMed

Fitzgerald, Amanda; Fitzgerald, Noelle; Aherne, Cian

2012-08-01

This systematic review investigated the relationship between peer and/or friend variables and physical activity among adolescents by synthesising cross-sectional, longitudinal, and experimental research conducted in the US. Seven electronic databases were searched to identify related articles published within the last 10 years and the articles reviewed included adolescents between 10 and 18 years. Studies reporting a measure of physical activity for adolescents and at least one potential peer and/or friend variable were included. Research demonstrated that peers and friends have an important role to play in the physical activity behavior of adolescents. Six processes were identified through which peers and/or friends may have an influence on physical activity including: peer and/or friend support, presence of peers and friends, peer norms, friendship quality and acceptance, peer crowds, and peer victimization. The theoretical significance of these results is assessed and the development of peer-related physical activity programs for adolescents is discussed. Copyright © 2012 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

[Improving patient safety through voluntary peer review].

PubMed

Kluge, S; Bause, H

2015-01-01

The intensive care unit (ICU) is one area of the hospital in which processes and communication are of primary importance. Errors in intensive care units can lead to serious adverse events with significant consequences for patients. Therefore quality and risk-management are important measures when treating critically ill patients. A pragmatic approach to support quality and safety in intensive care is peer review. This approach has gained significant acceptance over the past years. It consists of mutual visits by colleagues who conduct standardised peer reviews. These reviews focus on the systematic evaluation of the quality of an ICU's structure, its processes and outcome. Together with different associations, the State Chambers of Physicians and the German Medical Association have developed peer review as a standardized tool for quality improvement. The common goal of all stakeholders is the continuous and sustainable improvement in intensive care with peer reviews significantly increasing and improving communication between professions and disciplines. Peer reviews secure the sustainability of planned change processes and consequently lead the way to an improved culture of quality and safety.

A Comprehensive Tool for Exploring the Availability, Scalability and Growth Potential of Conventional and Renewable Energy Sources and Technologies

NASA Astrophysics Data System (ADS)

Jack-Scott, E.; Arnott, J. C.; Katzenberger, J.; Davis, S. J.; Delman, E.

2015-12-01

It has been a generational challenge to simultaneously meet the world's energy requirements, while remaining within the bounds of acceptable cost and environmental impact. To this end, substantial research has explored various energy futures on a global scale, leaving decision-makers and the public overwhelmed by information on energy options. In response, this interactive energy table was developed as a comprehensive resource through which users can explore the availability, scalability, and growth potentials of all energy technologies currently in use or development. Extensive research from peer-reviewed papers and reports was compiled and summarized, detailing technology costs, technical considerations, imminent breakthroughs, and obstacles to integration, as well as political, social, and environmental considerations. Energy technologies fall within categories of coal, oil, natural gas, nuclear, solar, wind, hydropower, ocean, geothermal and biomass. In addition to 360 expandable cells of cited data, the interactive table also features educational windows with background information on each energy technology. The table seeks not to advocate for specific energy futures, but to succinctly and accurately centralize peer-reviewed research and information in an interactive, accessible resource. With this tool, decision-makers, researchers and the public alike can explore various combinations of energy technologies and their quantitative and qualitative attributes that can satisfy the world's total primary energy supply (TPES) while making progress towards a near zero carbon future.

Elimination of Mother-To-Child Transmission of HIV Infection: The Drug Resource Enhancement against AIDS and Malnutrition Model

PubMed Central

Liotta, Giuseppe; Marazzi, Maria Cristina; Mothibi, Khethimipilo E.; Zimba, Ines; Amangoua, Evelyne E.; Bonje, Esther K.; Bossiky, Bernard N. B.; Robinson, Precious A.; Scarcella, Paola; Musokotwane, Kebby; Palombi, Leonardo; Germano, Paola; Narciso, Pasquale; de Luca, Andrea; Alumando, Elard; Mamary, Sangare H.; Magid, Nurja A.; Guidotti, Giovanni; Mancinelli, Sandro; Orlando, Stefano; Peroni, Marco; Buonomo, Ersilia; Nielsen-Saines, Karin

2015-01-01

The Drug Resource Enhancement against AIDS and Malnutrition Program (DREAM) gathered professionals in the field of Elimination of HIV-Mother-To-Child Transmission (EMTCT) in Maputo in 2013 to discuss obstacles and solutions for the elimination of HIV vertical transmission in sub-Saharan Africa. During this workshop, the benefits of administrating combined antiretroviral therapy (cART) to HIV positive women from pregnancy throughout breastfeeding were reviewed. cART is capable of reducing vertical transmission to less than 5% at 24 months of age, as well as maternal mortality and infant mortality in both HIV infected and exposed populations to levels similar to those of uninfected individuals. The challenge for programs targeting eMTCT in developing countries is retention in care and treatment adherence. Both are intrinsically related to the model of care. The drop-out from eMTCT programs before cART initiation ranges from 33%–88% while retention rates at 18–24 months are less than 50%. Comprehensive strategies including peer-to-peer education, social support and laboratory monitoring can reduce refusals to less than 5% and attain retention rates approaching 90%. Several components of the model of care for reduction of HIV-1 MTCT are feasible and implementable in scale-up strategies. A review of this model of care for HIV eMTCT is provided. PMID:26506365

7 CFR 3411.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

...) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE NATIONAL RESEARCH INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411.10 Establishment and operation of peer review groups. Subject to § 3411.5, the Administrator shall adopt procedures...

7 CFR 3400.10 - Establishment and operation of peer review groups.

Code of Federal Regulations, 2010 CFR

2010-01-01

...) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.10 Establishment and operation of peer review groups. Subject to § 3400.5, the Administrator will adopt procedures for the...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2014 CFR

2014-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2013 CFR

2013-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

42 CFR 52h.5 - Conflict of interest.

Code of Federal Regulations, 2012 CFR

2012-10-01

... Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES GRANTS SCIENTIFIC PEER REVIEW OF...) This section applies only to conflicts of interest involving members of peer review groups. This... Executive Order 11222, as amended. For those federal employees serving on peer review groups, in accordance...

Agriculture Emergencies: A Primer for First Responders

PubMed Central

Carabin, Hélène; Regens, James L.; Burden, Ray W.

2009-01-01

Over the past several years, the primary focus of emergency preparedness has been on terrorism, and how a CBRNE event would directly affect human health. Limited emphasis has been placed on the direct (eg, zoonotic infections) and indirect (eg, mental health, financial loss) effects that an agricultural emergency event can have on human health outcomes, and how they relate to emergency preparedness. We critically reviewed the resources and information readily accessible to our target audience, emergency responders; the resources included military and civilian books, personal communications, internet sites, GAO reports, and peer-reviewed journals. Among more than 2,000 bioterrorism-related articles, we found 51 that addressed either agroterrorism and/or veterinary public health: 2 cross-sectional studies, 28 review papers, and 21 commentary papers. In order to properly respond to future agriculture emergencies, emergency response professionals need to understand the nature and implications of the event as well as their roles and responsibilities, but the availability of educational and training opportunities is limited. The results of our review are consistent with the hypothesis that more resources, education, and training opportunities should be available to responders as well as to producers, importers and shippers, international travelers, and the general public. Increased education and training will raise awareness among these groups of the relationship between animal and human health. PMID:19635003

[Online publishing in the Internet age].

PubMed

Dørup, J G; Gylstorff, N H; Lous, J

2000-10-16

The availability of full text medical journal articles is rapidly increasing with the increased availability of the Internet. The potentials of the new technology present researchers, publishers, and librarians with new problems and challenges. Some resources are made available free of charge, whereas others are distributed as parts of large licences negotiated between publishers and consortia of research libraries. How can researchers maintain an overview of the constantly changing resources? How can libraries cope with tasks rapidly redefined by the technology? And how can publishers survive when production and distribution of literature information, including the handling of peer reviewing, might just as well be performed by the researchers themselves or their organisations? The present paper presents some of the resources available and discusses both national and international projects and activities that deal with these questions.

Systematic review of qualitative literature on occupational health and safety legislation and regulatory enforcement planning and implementation.

PubMed

MacEachen, Ellen; Kosny, Agnieszka; Ståhl, Christian; O'Hagan, Fergal; Redgrift, Lisa; Sanford, Sarah; Carrasco, Christine; Tompa, Emile; Mahood, Quenby

2016-01-01

The ability of occupational health and safety (OHS) legislation and regulatory enforcement to prevent workplace injuries and illnesses is contingent on political, economic, and organizational conditions. This systematic review of qualitative research articles considers how OHS legislation and regulatory enforcement are planned and implemented. A comprehensive search of peer-reviewed, English-language articles published between 1990 and 2013 yielded 11 947 articles. We identified 34 qualitative articles as relevant, 18 of which passed our quality assessment and proceeded to meta-ethnographic synthesis. The synthesis yielded four main themes: OHS regulation formation, regulation challenges, inspector organization, and worker representation in OHS. It illuminates how OHS legislation can be based on normative suppositions about worker and employer behavior and shaped by economic and political resources of parties. It also shows how implementation of OHS legislation is affected by "general duty" law, agency coordination, resourcing of inspectorates, and ability of workers to participate in the system. The review identifies methodological gaps and identifies promising areas for further research in "grey" zones of legislation implementation.

Can editors save peer review from peer reviewers?

PubMed

D'Andrea, Rafael; O'Dwyer, James P

2017-01-01

Peer review is the gold standard for scientific communication, but its ability to guarantee the quality of published research remains difficult to verify. Recent modeling studies suggest that peer review is sensitive to reviewer misbehavior, and it has been claimed that referees who sabotage work they perceive as competition may severely undermine the quality of publications. Here we examine which aspects of suboptimal reviewing practices most strongly impact quality, and test different mitigating strategies that editors may employ to counter them. We find that the biggest hazard to the quality of published literature is not selfish rejection of high-quality manuscripts but indifferent acceptance of low-quality ones. Bypassing or blacklisting bad reviewers and consulting additional reviewers to settle disagreements can reduce but not eliminate the impact. The other editorial strategies we tested do not significantly improve quality, but pairing manuscripts to reviewers unlikely to selfishly reject them and allowing revision of rejected manuscripts minimize rejection of above-average manuscripts. In its current form, peer review offers few incentives for impartial reviewing efforts. Editors can help, but structural changes are more likely to have a stronger impact.

R.U. Ready?: Peer Education and Bystander Intervention Sexual Assault Programming

ERIC Educational Resources Information Center

Schweer, Jen Luettel; Heather, Katie; Kay, Kathryn; Stewart, K. Leigh; Kovach, Laura

2012-01-01

R.U. Ready? at Georgetown University is an annual sexual assault awareness event that incorporates peer education and resources with opportunities for students, staff, and faculty to dialogue about providing bystander intervention throughout the campus community. Beyond dialogue, participants learn about student activism and the resources and…

o'Peer: open peer review

NASA Astrophysics Data System (ADS)

Brewer, J. H.

2014-12-01

I have built a "demonstration" website at http://oPeer.org to illustrate how peer review and publication might be improved relative to the current model, which was designed and implemented in an era when scientific communication was either face-to-face or relied upon human delivery of ink marks on dead trees.

Voluntary peer review as innovative tool for quality improvement in the intensive care unit – a retrospective descriptive cohort study in German intensive care units

PubMed Central

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A.; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Introduction: Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Methods: Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs – representing over 300 patient beds – had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. Results: External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators. PMID:25587245

Voluntary peer review as innovative tool for quality improvement in the intensive care unit--a retrospective descriptive cohort study in German intensive care units.

PubMed

Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

2014-01-01

Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs - representing over 300 patient beds - had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators.

Three decades of disasters: a review of disaster-specific literature from 1977-2009.

PubMed

Smith, Erin; Wasiak, Jason; Sen, Ayan; Archer, Frank; Burkle, Frederick M

2009-01-01

The potential for disasters exists in all communities. To mitigate the potential catastrophes that confront humanity in the new millennium, an evidence-based approach to disaster management is required urgently. This study moves toward such an evidence-based approach by identifying peer-reviewed publications following a range of disasters and events over the past three decades. Peer-reviewed, event-specific literature was identified using a comprehensive search of the electronically indexed database, MEDLINE (1956-January 2009). An extended comprehensive search was conducted for one event to compare the event-specific literature indexed in MEDLINE to other electronic databases (EMBASE, CINAHL, AMED, CENTRAL, Psych Info, Maternity and Infant Care, EBM Reviews). Following 25 individual disasters or overwhelming crises, a total of 2,098 peer-reviewed, event-specific publications were published in 789 journals (652 publications following disasters/events caused by natural hazards, 966 following human-made/technological disasters/events, and 480 following conflict/complex humanitarian events).The event with the greatest number of peer-reviewed, event-specific publications was the 11 September 2001 terrorist attacks (686 publications). Prehospital and Disaster Medicine published the greatest number of peer-reviewed, event-specific publications (54), followed by Journal of Traumatic Stress (42), Military Medicine (40), and Psychiatric Services (40). The primary topics of event-specific publications were mental health, medical health, and response. When an extended, comprehensive search was conducted for one event, 75% of all peer-reviewed, event-specific publications were indexed in MEDLINE. A broad range of multi-disciplinary journals publish peer reviewed, event-specific publications. While the majority of peer-reviewed, event-specific literature is indexed in MEDLINE, comprehensive search strategies should include EMBASE to increase yield.

Reflections of a CHAMPUS-APA peer reviewer.

PubMed

Parlour, R R

1986-02-01

Peer review is a major professional response to the problems of health insurance coverage for psychiatric services. Standard insurance programs reimburse only services that are conventional and cost-effective. The system assumes that services are skillfully documented by providers. Experience as a peer reviewer helps clinicians acquire skill in documentation.

Marketing Academics' Perceptions of the Peer Review Process

ERIC Educational Resources Information Center

Bailey, Charles D.; Hair, Joe F.; Hermanson, Dana R.; Crittenden, Victoria L.

2012-01-01

Publication in refereed journals is critical to career success for most marketing faculty members, and the peer review process is the gatekeeper for a refereed journal. The study reported here examines marketing academics' perceptions of this peer review process. Based on responses from 653 marketing academics, we find favorable overall…

The Neuroscience Peer Review Consortium

PubMed Central

Saper, Clifford B; Maunsell, John HR

2009-01-01

As the Neuroscience Peer Review Consortium (NPRC) ends its first year, it is worth looking back to see how the experiment has worked. In order to encourage dissemination of the details outlined in this Editorial, it will also be published in other journals in the Neuroscience Peer Review Consortium. PMID:19284614

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 42 Public Health 1 2014-10-01 2014-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 42 Public Health 1 2012-10-01 2012-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 42 Public Health 1 2013-10-01 2013-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

42 CFR 24.5 - Peer review.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 42 Public Health 1 2011-10-01 2011-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC HEALTH SERVICE, DEPARTMENT OF HEALTH AND HUMAN SERVICES PERSONNEL SENIOR BIOMEDICAL RESEARCH SERVICE § 24.5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her...

78 FR 63795 - Endangered and Threatened Wildlife and Plants; Determination of Endangered Status for Chromolaena...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-10-24

... responses. The peer reviewers generally concurred with our methods and conclusions, and they provided... corallicola, and Harrisia aboriginum. The peer reviewers generally concurred with our methods and conclusions... discussion, below. (6) Comment: One peer reviewer provided research findings on the seed longevity and...

Peer Review Undergoing Revitalization

ERIC Educational Resources Information Center

Sawchuk, Stephen

2009-01-01

Established in the 142,000-student Montgomery County, Maryland, district in 1999, peer assistance and review (PAR)--or "peer review," as it is occasionally called--is actually an old idea. In 1981, the then-president of the Toledo Federation of Teachers, Dal Lawrence, helped create the first PAR program. Almost 30 years later, only a…

An integrative review of in-class activities that enable active learning in college science classroom settings

NASA Astrophysics Data System (ADS)

Arthurs, Leilani A.; Kreager, Bailey Zo

2017-10-01

Engaging students in active learning is linked to positive learning outcomes. This study aims to synthesise the peer-reviewed literature about 'active learning' in college science classroom settings. Using the methodology of an integrative literature review, 337 articles archived in the Educational Resources Information Center (ERIC) are examined. Four categories of in-class activities emerge: (i) individual non-polling activities, (ii) in-class polling activities, (iii) whole-class discussion or activities, and (iv) in-class group activities. Examining the collection of identified in-class activities through the lens of a theoretical framework informed by constructivism and social interdependence theory, we synthesise the reviewed literature to propose the active learning strategies (ALSs) model and the instructional decisions to enable active learning (IDEAL) theory. The ALS model characterises in-class activities in terms of the degrees to which they are designed to promote (i) peer interaction and (ii) social interdependence. The IDEAL theory includes the ALS model and provides a framework for conceptualising different levels of the general concept 'active learning' and how these levels connect to instructional decision-making about using in-class activities. The proposed ALS model and IDEAL theory can be utilised to inform instructional decision-making and future research about active learning in college science courses.

Peer-review: An IOP Publishing Perspective

NASA Astrophysics Data System (ADS)

Smith, Timothy

2015-03-01

Online publishing is challenging, and potentially changing, the role of publishers in both managing the peer-review process and disseminating the work that they publish in meeting contrasting needs from diverse groups of research communities. Recognizing the value of peer-review as a fundamental service to authors and the research community, the underlying principles of managing the process for journals published by IOP Publishing remain unchanged and yet the potential and demand for alternative models exists. This talk will discuss the traditional approach to peer-review placed in the context of this changing demand.

The objective impact of clinical peer review on hospital quality and safety.

PubMed

Edwards, Marc T

2011-01-01

Despite its importance, the objective impact of clinical peer review on the quality and safety of care has not been studied. Data from 296 acute care hospitals show that peer review program and related organizational factors can explain up to 18% of the variation in standardized measures of quality and patient safety. The majority of programs rely on an outmoded and dysfunctional process model. Adoption of best practices informed by the continuing study of peer review program effectiveness has the potential to significantly improve patient outcomes.

Identifying and Remediating Student Misconceptions in Introductory Biology via Writing-to-Learn Assignments and Peer Review.

PubMed

Halim, Audrey S; Finkenstaedt-Quinn, Solaire A; Olsen, Laura J; Gere, Anne Ruggles; Shultz, Ginger V

2018-06-01

Student misconceptions are an obstacle in science, technology, engineering, and mathematics courses and unless remediated may continue causing difficulties in learning as students advance in their studies. Writing-to-learn assignments (WTL) are characterized by their ability to promote in-depth conceptual learning by allowing students to explore their understanding of a topic. This study sought to determine whether and what types of misconceptions are elicited by WTL assignments and how the process of peer review and revision leads to remediation or propagation of misconceptions. We examined four WTL assignments in an introductory biology course in which students first wrote about content by applying it to a realistic scenario, then participated in a peer-review process before revising their work. Misconceptions were identified in all four assignments, with the greatest number pertaining to protein structure and function. Additionally, in certain contexts, students used scientific terminology incorrectly. Analysis of the drafts and peer-review comments generated six profiles by which misconceptions were addressed through the peer-review process. The prevalent mode of remediation arose through directed peer-review comments followed by correction during revision. It was also observed that additional misconceptions were elicited as students revised their writing in response to general peer-review suggestions.

Peering into peer-review at GigaScience

PubMed Central

2013-01-01

Fostering and promoting more open and transparent science is one of the goals of GigaScience. One of the ways we have been doing this is by throwing light on the peer-review process and carrying out open peer-review as standard. In this editorial, we provide our rationale for undertaking this policy, give examples of our positive experiences to date, and encourage others to open up the normally opaque publication process. PMID:23587291

Clinical Case Reporting in the Peer-Reviewed Physical Therapy Literature: Time to Move Toward Functioning.

PubMed

Davenport, Todd E

2015-12-01

Physical therapists increasingly are contributing clinical case reports to the health literature, which form the basis for higher quality evidence that has been incorporated into clinical practice guidelines. Yet, few resources exist to assist physical therapists with the basic mechanics and quality standards of producing a clinical case report. This situation is further complicated by the absence of uniform standards for quality in case reporting. The importance of including a concise yet comprehensive description of patient functioning in all physical therapy case reports suggest the potential appropriateness of basing quality guidelines on the World Health Organization's International Classification of Functioning Disability and Health (ICF) model. The purpose of this paper is to assist physical therapists in creating high-quality clinical case reports for the peer-reviewed literature using the ICF model as a guiding framework. Along these lines, current recommendations related to the basic mechanics of writing a successful clinical case report are reviewed, as well and a proposal for uniform clinical case reporting requirements is introduced with the aim to improve the quality and feasibility of clinical case reporting in physical therapy that are informed by the ICF model. Copyright © 2013 John Wiley & Sons, Ltd.

Private Peer-to-Peer Networks

NASA Astrophysics Data System (ADS)

Rogers, Michael; Bhatti, Saleem

This chapter offers a survey of the emerging field of private peer-to-peer networks, which can be defined as internet overlays in which the resources and infrastructure are provided by the users, and which new users may only join by personal invitation. The last few years have seen rapid developments in this field. We describe deployed systems, classify them architecturally, and identify some technical and social tradeoffs in the design of private peer-to-peer networks.

Peer-review for selection of oral presentations for conferences: Are we reliable?

PubMed

Deveugele, Myriam; Silverman, Jonathan

2017-11-01

Although peer-review for journal submission, grant-applications and conference submissions has been called 'a counter- stone of science', and even 'the gold standard for evaluating scientific merit', publications on this topic remain scares. Research that has investigated peer-review reveals several issues and criticisms concerning bias, poor quality review, unreliability and inefficiency. The most important weakness of the peer review process is the inconsistency between reviewers leading to inadequate inter-rater reliability. To report the reliability of ratings for a large international conference and to suggest possible solutions to overcome the problem. In 2016 during the International Conference on Communication in Healthcare, organized by EACH: International Association for Communication in Healthcare, a calibration exercise was proposed and feedback was reported back to the participants of the exercise. Most abstracts, as well as most peer-reviewers, receive and give scores around the median. Contrary to the general assumption that there are high and low scorers, in this group only 3 peer-reviewers could be identified with a high mean, while 7 has a low mean score. Only 2 reviewers gave only high ratings (4 and 5). Of the eight abstracts included in this exercise, only one abstract received a high mean score and one a low mean score. Nevertheless, both these abstracts received both low and high scores; all other abstracts received all possible scores. Peer-review of submissions for conferences are, in accordance with the literature, unreliable. New and creative methods will be needed to give the participants of a conference what they really deserve: a more reliable selection of the best abstracts. More raters per abstract improves the inter-rater reliability; training of reviewers could be helpful; providing feedback to reviewers can lead to less inter-rater disagreement; fostering negative peer-review (rejecting the inappropriate submissions) rather than a positive (accepting the best) could be fruitful for selecting abstracts for conferences. Copyright © 2017 Elsevier B.V. All rights reserved.

Data bank has operational impact. Proper peer review can protect hospitals from antitrust and defamation suits.

PubMed

Purtell, D L

1990-11-01

The Health Care Quality Improvement Act of 1986 can help protect medical professionals and healthcare facilities from antitrust and defamation claims and other forms of litigation arising from the peer review process. Some hospitals may need to make major changes in their peer review activity as a result of the act. The healthcare entity, not the physicians involved in peer review, has the burden of complying with the provisions of the act. Failure to comply with the act can lead to loss of immunity from damages, fines, and potential exclusion from the Medicare program. The potential for liability has sparked a need for hospitals to reexamine and possibly reorganize medical staff and update procedures and related governing documents. Healthcare entities may consider changes such as implementing a director of medical affairs function, choosing medical staff for multiple-year terms, and centralizing physician review files. In the 1980s many hospitals created quality assurance and risk management programs. Risk managers need to share data with quality assurance personnel, who must in turn share the information with medical staff involved with credentialing, peer review, and medical affairs management. Legal counsel will need to be familiar with the legalities of the act, as well as the hospital's peer review procedures and operations. General legal counsel should oversee coordination of hospital proceedings and assist in educating staff on the legalities of peer review.

The Validity of Online Patient Ratings of Physicians: Analysis of Physician Peer Reviews and Patient Ratings.

PubMed

McGrath, Robert J; Priestley, Jennifer Lewis; Zhou, Yiyun; Culligan, Patrick J

2018-04-09

Information from ratings sites are increasingly informing patient decisions related to health care and the selection of physicians. The current study sought to determine the validity of online patient ratings of physicians through comparison with physician peer review. We extracted 223,715 reviews of 41,104 physicians from 10 of the largest cities in the United States, including 1142 physicians listed as "America's Top Doctors" through physician peer review. Differences in mean online patient ratings were tested for physicians who were listed and those who were not. Overall, no differences were found between the online patient ratings based upon physician peer review status. However, statistical differences were found for four specialties (family medicine, allergists, internal medicine, and pediatrics), with online patient ratings significantly higher for those physicians listed as a peer-reviewed "Top Doctor" versus those who were not. The results of this large-scale study indicate that while online patient ratings are consistent with physician peer review for four nonsurgical, primarily in-office specializations, patient ratings were not consistent with physician peer review for specializations like anesthesiology. This result indicates that the validity of patient ratings varies by medical specialization. ©Robert J McGrath, Jennifer Lewis Priestley, Yiyun Zhou, Patrick J Culligan. Originally published in the Interactive Journal of Medical Research (http://www.i-jmr.org/), 09.04.2018.

A Critical Analysis of Anesthesiology Podcasts: Identifying Determinants of Success.

PubMed

Singh, Devin; Alam, Fahad; Matava, Clyde

2016-08-17

Audio and video podcasts have gained popularity in recent years. Increasingly, podcasts are being used in the field of medicine as a tool to disseminate information. This format has multiple advantages including highly accessible creation tools, low distribution costs, and portability for the user. However, despite its ongoing use in medical education, there are no data describing factors associated with the success or quality of podcasts. The goal of the study was to assess the landscape of anesthesia podcasts in Canada and develop a methodology for evaluating the quality of the podcast. To achieve our objective, we identified the scope of podcasts in anesthesia specifically, constructed an algorithmic model for measuring success, and identified factors linked to both successful podcasts and a peer-review process. Independent reviewers performed a systematic search of anesthesia-related podcasts on iTunes Canada. Data and metrics recorded for each podcast included podcast's authorship, number posted, podcast series duration, target audience, topics, and social media presence. Descriptive statistics summarized mined data, and univariate analysis was used to identify factors associated with podcast success and a peer-review process. Twenty-two podcasts related to anesthesia were included in the final analysis. Less than a third (6/22=27%) were still active. The median longevity of the podcasts' series was just 13 months (interquartile range: 1-39 months). Anesthesiologists were the target audience for 77% of podcast series with clinical topics being most commonly addressed. We defined a novel algorithm for measuring success: Podcast Success Index. Factors associated with a high Podcast Success Index included podcasts targeting fellows (Spearman R=0.434; P=.04), inclusion of professional topics (Spearman R=0.456-0.603; P=.01-.03), and the use of Twitter as a means of social media (Spearman R=0.453;P=.03). In addition, more than two-thirds (16/22=73%) of podcasts demonstrated evidence of peer review with podcasts targeting anesthesiologists most strongly associated with peer-reviewed podcasts (Spearman R=0.886; P=.004) CONCLUSIONS: We present the first report on the scope of anesthesia podcasts in Canada. We have developed a novel tool for assessing the success of an anesthesiology podcast series and identified factors linked to this success measure as well as evidence of a peer-review process for a given podcast. To enable advancement in this area of anesthesia e-resources, podcast creators and users should consider factors associated with success when creating podcasts. The lack of these aspects may be associated with the early demise of a podcast series.

A Critical Analysis of Anesthesiology Podcasts: Identifying Determinants of Success

PubMed Central

Singh, Devin; Matava, Clyde

2016-01-01

Background Audio and video podcasts have gained popularity in recent years. Increasingly, podcasts are being used in the field of medicine as a tool to disseminate information. This format has multiple advantages including highly accessible creation tools, low distribution costs, and portability for the user. However, despite its ongoing use in medical education, there are no data describing factors associated with the success or quality of podcasts. Objective The goal of the study was to assess the landscape of anesthesia podcasts in Canada and develop a methodology for evaluating the quality of the podcast. To achieve our objective, we identified the scope of podcasts in anesthesia specifically, constructed an algorithmic model for measuring success, and identified factors linked to both successful podcasts and a peer-review process. Methods Independent reviewers performed a systematic search of anesthesia-related podcasts on iTunes Canada. Data and metrics recorded for each podcast included podcast’s authorship, number posted, podcast series duration, target audience, topics, and social media presence. Descriptive statistics summarized mined data, and univariate analysis was used to identify factors associated with podcast success and a peer-review process. Results Twenty-two podcasts related to anesthesia were included in the final analysis. Less than a third (6/22=27%) were still active. The median longevity of the podcasts’ series was just 13 months (interquartile range: 1-39 months). Anesthesiologists were the target audience for 77% of podcast series with clinical topics being most commonly addressed. We defined a novel algorithm for measuring success: Podcast Success Index. Factors associated with a high Podcast Success Index included podcasts targeting fellows (Spearman R=0.434; P=.04), inclusion of professional topics (Spearman R=0.456-0.603; P=.01-.03), and the use of Twitter as a means of social media (Spearman R=0.453;P=.03). In addition, more than two-thirds (16/22=73%) of podcasts demonstrated evidence of peer review with podcasts targeting anesthesiologists most strongly associated with peer-reviewed podcasts (Spearman R=0.886; P=.004) Conclusions We present the first report on the scope of anesthesia podcasts in Canada. We have developed a novel tool for assessing the success of an anesthesiology podcast series and identified factors linked to this success measure as well as evidence of a peer-review process for a given podcast. To enable advancement in this area of anesthesia e-resources, podcast creators and users should consider factors associated with success when creating podcasts. The lack of these aspects may be associated with the early demise of a podcast series. PMID:27731857

Environment, Safety and Health Self-Assessment Report Fiscal Year 2010

DOE Office of Scientific and Technical Information (OSTI.GOV)

Robinson, Scott

2011-03-23

The Lawrence Berkeley National Laboratory (LBNL) Environment, Safety, and Health (ES&H) Self-Assessment Program was established to ensure that Integrated Safety Management (ISM) is implemented institutionally and by all divisions. The ES&H Self-Assessment Program, managed by the Office of Contractor Assurance (OCA), provides for an internal evaluation of all ES&H programs and systems at LBNL. The primary objective of the program is to ensure that work is conducted safely and with minimal negative impact to workers, the public, and the environment. Self-assessment follows the five core functions and guiding principles of ISM. Self-assessment is the mechanism used to promote the continuousmore » improvement of the Laboratory's ES&H programs. The process is described in the Environment, Safety, and Health Assurance Plan (PUB-5344) and is composed of three types of self-assessments: Division ES&H Self-Assessment, ES&H Technical Assurance Program Assessment, and Division ES&H Peer Review. The Division ES&H Self-Assessment Manual (PUB-3105) provides the framework by which divisions conduct formal ES&H self-assessments to systematically identify program deficiencies. Issue-specific assessments are designed and implemented by the divisions and focus on areas of interest to division management. They may be conducted by teams and involve advance planning to ensure that appropriate resources are available. The ES&H Technical Assurance Program Manual (PUB-913E) provides the framework for systematic reviews of ES&H programs and processes. The ES&H Technical Assurance Program Assessment is designed to evaluate whether ES&H programs and processes are compliant with guiding regulations, are effective, and are properly implemented by LBNL divisions. The Division ES&H Peer Review Manual provides the framework by which division ISM systems are evaluated and improved. Peer Reviews are conducted by teams under the direction of senior division management and focus on higher-level management issues. Peer Review teams are selected on the basis of members knowledge and experience in the issues of interest to the division director. LBNL periodically requests in-depth independent assessments of selected ES&H programs. Such assessments augment LBNL's established assessment processes and provide an objective view of ES&H program effectiveness. Institutional Findings, Observations, and Noteworthy Practices identified during independent assessments are specifically intended to help LBNL identify opportunities for program improvement. This report includes the results of the Division ES&H Self-Assessment, ES&H Technical Assurance Program Assessment, and Division ES&H Peer Review, respectively.« less

Clinical peer review program self-evaluation for US hospitals.

PubMed

Edwards, Marc T

2010-01-01

Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.

Peer support of complex health behaviors in prevention and disease management with special reference to diabetes: systematic reviews.

PubMed

Fisher, Edwin B; Boothroyd, Renée I; Elstad, Emily A; Hays, Laura; Henes, Amy; Maslow, Gary R; Velicer, Clayton

2017-01-01

Examine Peer Support (PS) for complex, sustained health behaviors in prevention or disease management with emphasis on diabetes prevention and management. PS was defined as emotional, motivational and practical assistance provided by nonprofessionals for complex health behaviors. Initial review examined 65 studies drawn from 1442 abstracts identified through PubMed, published 1/1/2000-7/15/2011. From this search, 24 reviews were also identified. Extension of the search in diabetes identified 30 studies published 1/1/2000-12/31/2015. In initial review, 54 of all 65 studies (83.1%) reported significant impacts of PS, 40 (61.5%) reporting between-group differences and another 14 (21.5%) reporting significant within-group changes. Across 19 of 24 reviews providing quantifiable findings, a median of 64.5% of studies reviewed reported significant effects of PS. In extended review of diabetes, 26 of all 30 studies (86.7%) reported significant impacts of PS, 17 (56.7%) reporting between-group differences and another nine (30.0%) reporting significant within-group changes. Among 19 of these 30 reporting HbA1c data, average reduction was 0.76 points. Studies that did not find effects of PS included other sources of support, implementation or methodological problems, lack of acceptance of interventions, poor fit to recipient needs, and possible harm of unmoderated PS. Across diverse settings, including under-resourced countries and health care systems, PS is effective in improving complex health behaviors in disease prevention and management including in diabetes.

78 FR 78493 - National Rural Transportation Assistance Program: Solicitation for Proposals

Federal Register 2010, 2011, 2012, 2013, 2014

2013-12-26

... 5. Task 5: RTAP Rural Resource Center 6. Task 6: Peer-to-Peer Networking 7. Task 7: Research and... for networking with State RTAP managers while establishing communication for information dissemination... Community Edition (DNN) version 05.06.02 (144). 6. Task 6: Peer-to-Peer Networking The recipient will...

The Relationship of Previous Training and Experience of Journal Peer Reviewers to Subsequent Review Quality

PubMed Central

Callaham, Michael L; Tercier, John

2007-01-01

Background Peer review is considered crucial to the selection and publication of quality science, but very little is known about the previous experiences and training that might identify high-quality peer reviewers. The reviewer selection processes of most journals, and thus the qualifications of their reviewers, are ill defined. More objective selection of peer reviewers might improve the journal peer review process and thus the quality of published science. Methods and Findings 306 experienced reviewers (71% of all those associated with a specialty journal) completed a survey of past training and experiences postulated to improve peer review skills. Reviewers performed 2,856 reviews of 1,484 separate manuscripts during a four-year study period, all prospectively rated on a standardized quality scale by editors. Multivariable analysis revealed that most variables, including academic rank, formal training in critical appraisal or statistics, or status as principal investigator of a grant, failed to predict performance of higher-quality reviews. The only significant predictors of quality were working in a university-operated hospital versus other teaching environment and relative youth (under ten years of experience after finishing training). Being on an editorial board and doing formal grant (study section) review were each predictors for only one of our two comparisons. However, the predictive power of all variables was weak. Conclusions Our study confirms that there are no easily identifiable types of formal training or experience that predict reviewer performance. Skill in scientific peer review may be as ill defined and hard to impart as is “common sense.” Without a better understanding of those skills, it seems unlikely journals and editors will be successful in systematically improving their selection of reviewers. This inability to predict performance makes it imperative that all but the smallest journals implement routine review ratings systems to routinely monitor the quality of their reviews (and thus the quality of the science they publish). PMID:17411314

Directly Improving the Quality of Radiation Treatment Through Peer Review: A Cross-sectional Analysis of Cancer Centers Across a Provincial Cancer Program.

PubMed

Rouette, Julie; Gutierrez, Eric; O'Donnell, Jennifer; Reddeman, Lindsay; Hart, Margaret; Foxcroft, Sophie; Mitera, Gunita; Warde, Padraig; Brundage, Michael D

2017-07-01

To describe the outcomes of peer review across all 14 cancer centers in Ontario. We identified all peer-reviewed, curative treatment plans delivered in Ontario within a 3-month study period from 2013 to 2014 using a provincial cancer treatment database and collected additional data on the peer-review outcomes. Considerable variation was found in the proportion of peer-reviewed plans across the centers (average 70.2%, range 40.8%-99.2%). During the study period, 5561 curative plans underwent peer review. Of those, 184 plans (3.3%) had changes recommended. Of the 184 plans, the changes were major (defined as requiring repeat planning or having a major effect on planning or clinical outcomes, or both) in 40.2% and minor in 47.8%. For the remaining 12.0%, data were missing. The proportions of recommended changes varied among disease sites (0.0%-7.0%). The disease sites with the most recommended changes to treatment plans after peer review and with the greatest potential for benefit were the esophagus (7.0%), uterus (6.7%), upper limb (6.3%), cervix and lower limb (both 6.0%), head and neck and bilateral lung (both 5.9%), right supraclavicular lymph nodes (5.7%), rectum (5.3%), and spine (5.0%). Although the heart is an organ at risk in left-sided breast treatment plans, the proportions of recommended changes did not significantly differ between the left breast treatment plans (3.0%, 95% confidence interval 2.0%-4.5%) and right breast treatment plans (2.4%, 95% confidence interval 1.5%-3.8%). The recommended changes were more frequently made when peer review occurred before radiation therapy (3.8%) than during treatment (1.4%-2.8%; P=.0048). The proportion of plans with recommended changes was not significantly associated with patient volume (P=.23), peer-review performance (P=.36), or center academic status (P=.75). Peer review of treatment plans directly affects the quality of care by identifying important clinical and planning changes. Provincial strategies are underway to optimize its conduct in radiation oncology. Copyright © 2016. Published by Elsevier Inc.

Pilot Mental Health, Negative Life Events, and Improving Safety with Peer Support and a Just Culture.

PubMed

Mulder, Sanne; de Rooy, Diederik

2018-01-01

In the last 35 yr, 17 commercial aviation accidents and incidents, with 576 fatalities, could likely have been attributed to mental disease of a pilot. Screening tools for mental health risks in airline pilots are needed. There is growing interest in pilot peer-support programs and how to incorporate them in a just culture, meaning that pilots can report mental health complaints without a risk of job or income loss. We combined findings from aviation accidents and incidents with a search of scientific literature to provide data-based recommendations for screening, peer-support, and a just culture approach to mental health problems. Commercial aviation accidents and incidents in which a mental disorder of a pilot was thought to play a role were reviewed. Subsequently, PubMed and PsychInfo literature searches were performed on peer-support programs, just culture human resource management, and the risk of negative life events on developing suicidal ideation and behavior in comparable professional groups. Lethal accidents were mostly related to impaired coping with negative life events. Negative life events are clearly related to suicidal thoughts, attempts, and completed suicide. A protective effect of peer-support programs on mental health problems has not been established, although peer-support programs are generally appreciated by those involved. We did not find relevant literature on just culture. Negative life events are likely a useful screening tool for mental health risks. There is still a lack of evidence on how peer-support groups should be designed and how management of mental health risks can be implemented in a just culture.Mulder S, de Rooy D. Pilot mental health, negative life events, and improving safety with peer support and a just culture. Aerosp Med Hum Perform. 2018; 89(1):41-51.

Alternatives to Peer Review: Novel Approaches for Research Evaluation

PubMed Central

Birukou, Aliaksandr; Wakeling, Joseph Rushton; Bartolini, Claudio; Casati, Fabio; Marchese, Maurizio; Mirylenka, Katsiaryna; Osman, Nardine; Ragone, Azzurra; Sierra, Carles; Wassef, Aalam

2011-01-01

In this paper we review several novel approaches for research evaluation. We start with a brief overview of the peer review, its controversies, and metrics for assessing efficiency and overall quality of the peer review. We then discuss five approaches, including reputation-based ones, that come out of the research carried out by the LiquidPub project and research groups collaborated with LiquidPub. Those approaches are alternative or complementary to traditional peer review. We discuss pros and cons of the proposed approaches and conclude with a vision for the future of the research evaluation, arguing that no single system can suit all stakeholders in various communities. PMID:22174702

IRIS Toxicological Review of Libby Amphibole Asbestos ...

EPA Pesticide Factsheets

On August 25, 2011, the draft Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers were released for external peer review and public comment. The Toxicological Review and charge were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process (May 2009), introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the IRIS Toxicological Review of Libby Amphibole Asbestos and the charge to external peer reviewers are posted on this site. The project supports OSWER and Region 8 site clean-up and related risk management initiatives at this Superfund site. As with all IRIS assessments, the draft document will undergo agency review, OMB/interagency review and independent external peer review before being included on the IRIS data base.

Successful peer review of courses: a case study.

PubMed

Horowitz, S; Van Eyck, S; Albanese, M

1998-03-01

The authors describe their school's system of peer review for courses, established in 1988 to facilitate faculty evaluation and continual course and curriculum improvement. (The system has been temporarily suspended while the school's new curriculum becomes established.) They explain how the system was created and then report how faculty reviews of courses over the five-year operation of the system compared with students' reviews of the same courses. The faculty and students' ratings were in agreement 75% of the time. When not in agreement, the students' ratings tended to upgrade courses that were not very demanding, had easy grading, and emphasized clinical details, often at the expense of basic concepts and the big picture. The authors then document how the work of the peer review system favorably influenced the transformation of the school's curriculum. They also provide guidelines for the creation and operation of a course review process that uses faculty peers. The authors maintain that the peer review system worked because it was run by a committee of experienced and respected teachers who had been selected by their peers, the other faculty. Additional reasons for its success were that the school's faculty supported and respected the committee and its work, that course directors helped evaluate their courses, and that peer reviewers took their work seriously despite having no remuneration, and the clearly positive impact of the review system on faculty interaction, faculty-student interaction, and the reform of the curriculum.

Enhancing the role of case-oriented peer review to improve quality and safety in radiation oncology: Executive summary

PubMed Central

Marks, Lawrence B.; Adams, Robert D.; Pawlicki, Todd; Blumberg, Albert L.; Hoopes, David; Brundage, Michael D.; Fraass, Benedick A.

2013-01-01

This report is part of a series of white papers commissioned for the American Society for Radiation Oncology (ASTRO) Board of Directors as part of ASTRO's Target Safely Campaign, focusing on the role of peer review as an important component of a broad safety/quality assurance (QA) program. Peer review is one of the most effective means for assuring the quality of qualitative, and potentially controversial, patient-specific decisions in radiation oncology. This report summarizes many of the areas throughout radiation therapy that may benefit from the application of peer review. Each radiation oncology facility should evaluate the issues raised and develop improved ways to apply the concept of peer review to its individual process and workflow. This might consist of a daily multidisciplinary (eg, physicians, dosimetrists, physicists, therapists) meeting to review patients being considered for, or undergoing planning for, radiation therapy (eg, intention to treat and target delineation), as well as meetings to review patients already under treatment (eg, adequacy of image guidance). This report is intended to clarify and broaden the understanding of radiation oncology professionals regarding the meaning, roles, benefits, and targets for peer review as a routine quality assurance tool. It is hoped that this work will be a catalyst for further investigation, development, and study of the efficacy of peer review techniques and how these efforts can help improve the safety and quality of our treatments. PMID:24175002

Peer Victimization among Schoolchildren: Correlations, Causes, Consequences, and Considerations in Assessment and Intervention

ERIC Educational Resources Information Center

Card, Noel A.; Hodges, Ernest V. E.

2008-01-01

Peer victimization among schoolchildren is a common problem that predicts serious maladjustment. In this article, the authors define peer victimization, provide a brief overview of the history of research on the topic, and review prevalence rates, common measurement approaches, and the correlates of peer victimization. This review leads to…

Making Teaching Community Property: A Menu for Peer Collaboration and Peer Review. AAHE Teaching Initiative.

ERIC Educational Resources Information Center

Hutchings, Pat

A collection of program descriptions and case studies in college faculty peer collaboration and peer review includes: "Setting a Scholarly Tone: Teaching Circles in the History Department at Kent State University"; "Fostering Collective Responsibility for Student Learning: Teaching Seminars in the University of North Carolina at Charlotte…

Research management peer exchange hosted by the Oregon Department of Transportation Research Group, August 20-24, 2001. Summary report.

DOT National Transportation Integrated Search

2001-05-01

The team began this peer exchange with a review of the first Oregon Peer Exchange conducted in may, 1998. The review included a summary of recommendations made and the changes made as a result of the 1998 Peer Exchange Report. : The primary focus of ...

Peering into peer review: Galileo, ESP, Dr Scott Reuben, and advancing our professional evolution.

PubMed

Biddle, Chuck

2011-10-01

The fundamental purpose of peer review is quality control that facilitates the introduction of information into our discipline; information that is essential to the care of patients who require anesthesia services. While the AANA Journal relies heavily on this process to maintain the overall quality of our scholarly literature, it may fail that objective under certain conditions. This editorial serves to inform readers of the nature and goals of the peer review process.

2017 Building Technologies Office Peer Review Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

The 2017 Building Technologies Office Peer Review Report summarizes the feedback submitted by reviewers for the 109 Building Technologies Office (BTO) projects presented at the 2017 BTO Peer Review. The report presents an overview of the goals and activities under each technology program area, a summary of project scores for each program, and a brief analysis of general evaluation trends within each program area or its constituent subprograms.

Peer Review of Submissions to the Annual American Evaluation Association Conference by the Graduate Student & New Evaluators Topical Interest Group

ERIC Educational Resources Information Center

Schroter, Daniela C.; Coryn, Chris L. S.; Montrosse, Bianca E.

2008-01-01

Peer review is an umbrella term that refers to a class of selection and oversight practices, including the familiar mechanisms of the review of proposals submitted for funding, of manuscripts for scholarly publications, and of personnel qualifications and portfolios for selection and promotion. Peer review has long been a cornerstone of modern…

What do we know about grant peer review in the health sciences?

PubMed

Guthrie, Susan; Ghiga, Ioana; Wooding, Steven

2017-01-01

 Peer review decisions award >95% of academic medical research funding, so it is crucial to understand how well they work and if they could be improved.  This paper summarises evidence from 105 relevant papers identified through a literature search on the effectiveness and burden of peer review for grant funding.  There is a remarkable paucity of evidence about the overall efficiency of peer review for funding allocation, given its centrality to the modern system of science. From the available evidence, we can identify some conclusions around the effectiveness and burden of peer review. The strongest evidence around effectiveness indicates a bias against innovative research. There is also fairly clear evidence that peer review is, at best, a weak predictor of future research performance, and that ratings vary considerably between reviewers. There is some evidence of age bias and cronyism. Good evidence shows that the burden of peer review is high and that around 75% of it falls on applicants. By contrast, many of the efforts to reduce burden are focused on funders and reviewers/panel members.  We suggest funders should acknowledge, assess and analyse the uncertainty around peer review, even using reviewers' uncertainty as an input to funding decisions. Funders could consider a lottery element in some parts of their funding allocation process, to reduce both burden and bias, and allow better evaluation of decision processes. Alternatively, the distribution of scores from different reviewers could be better utilised as a possible way to identify novel, innovative research. Above all, there is a need for open, transparent experimentation and evaluation of different ways to fund research. This also requires more openness across the wider scientific community to support such investigations, acknowledging the lack of evidence about the primacy of the current system and the impossibility of achieving perfection.

Writing throughout the biochemistry curriculum: Synergistic inquiry-based writing projects for biochemistry students.

PubMed

Mertz, Pamela; Streu, Craig

2015-01-01

This article describes a synergistic two-semester writing sequence for biochemistry courses. In the first semester, students select a putative protein and are tasked with researching their protein largely through bioinformatics resources. In the second semester, students develop original ideas and present them in the form of a research grant proposal. Both projects involve multiple drafts and peer review. The complementarity of the projects increases student exposure to bioinformatics and literature resources, fosters higher-order thinking skills, and develops teamwork and communication skills. Student feedback and responses on perception surveys demonstrated that the students viewed both projects as favorable learning experiences. © 2015 The International Union of Biochemistry and Molecular Biology.

Peer Review: Structured, Informal, Confidential, Helpful!

ERIC Educational Resources Information Center

Cassidy, Alice; Lee, Jack

2011-01-01

This paper describes an introductory workshop, Preparing to be a Peer Reviewer, presented at the University of British Columbia (UBC) to give hands-on practice to faculty members and others in order to provide formative peer review upon request. This workshop, which was designed at the request of a faculty member, is complemented by an Advanced…

Preparing English Learners for Effective Peer Review in the Writers' Workshop

ERIC Educational Resources Information Center

Kim, Soo Hyon

2015-01-01

English Language Learners (ELLs) often face challenges when participating in peer review activities in writers' workshops. This article identifies some of the potential difficulties that ELL writers may experience, and provides teachers with strategies to address these problems. The author describes a simple three-step peer review training model…

Using Peer Review to Improve Student Writing in Business Courses

ERIC Educational Resources Information Center

Rieber, Lloyd J.

2006-01-01

Student peer review has proven an effective technique for improving student writing in both English and business communication classes, yet the technique is not widely used in business courses other than business communication. In this article, the author discusses using student peer review in business classes to improve students' final written…

Peer Review of Teaching: Best Practices for a Non-Programmatic Approach

ERIC Educational Resources Information Center

Alabi, Jaena; Weare, William H., Jr.

2014-01-01

Many academic librarians who provide library instruction have never received formal training in educational theory and methods. To bridge this gap and improve the teaching skills of instruction librarians, some academic libraries have established peer review of teaching programs. Despite the recognized benefits of peer review, it may not be…

The Great Fossil Fiasco: Teaching about Peer Review.

ERIC Educational Resources Information Center

Gift, Nancy; Krasny, Marianne

2003-01-01

Describes a lesson that engages middle school students in learning about peer review. Uses the article "Archaeoraptor Fossil Trail," which was published in the November, 1999 issue of "National Geographic" as an example of a real life story of how peer review forces scientists to critically re-examine a fossil discovery. (SOE)

Influence of Peer Effects on Learning Outcomes: A Review of the Literature.

ERIC Educational Resources Information Center

Wilkinson, Ian A. G.; Hattie, John A.; Parr, Judy M.; Townsend, Michael A. R.; Fung, Irene; Ussher, Charlotte; Thrupp, Martin; Lauder, Hugh; Robinson, Tony

This report presents a literature review and conceptual model summarizing the influence of peer effects on learning outcomes. The report describes the approach to the review and provides a theoretical account of the environments, mechanisms, and processes that mediate learning among peers. It then summarizes the literature on compositional effects…

77 FR 58802 - Notice of Intent To Seek OMB Approval To Collect Information: Forms Pertaining to the Peer Review...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-09-24

... Collect Information: Forms Pertaining to the Peer Review of ARS Research Projects AGENCY: Agricultural Research Service (ARS), USDA. ACTION: Notice and request for comments. SUMMARY: The proposed information... allow the ARS to efficiently manage data associated with the peer review of agricultural research. All...

Original Research and Peer Review Using Web-Based Collaborative Tools by College Students

ERIC Educational Resources Information Center

Cakir, Mustafa; Carlsen, William S.

2007-01-01

The Environmental Inquiry program supports inquiry based, student-centered science teaching on selected topics in the environmental sciences. Many teachers are unfamiliar with both the underlying science of toxicology, and the process and importance of peer review in scientific method. The protocol and peer review process was tested with college…

DOE Hydrogen Program: 2010 Annual Merit Review and Peer Evaluation Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

This document summarizes the comments provided by peer reviewers on hydrogen and fuel cell projects presented at the FY 2010 U.S. Department of Energy (DOE) Hydrogen Program and Vehicle Technologies Program Annual Merit Review and Peer Evaluation Meeting (AMR), held June 7-11, 2010 in Washington, D.C.

Peer Review of Report Modeling the Relationship Between Lead in Drinking Water and Blood Lead Levels in Children

EPA Science Inventory

EPA is peer reviewing the Agency’s report modeling the relationship between lead in drinking water and blood lead levels in children utilizing the Integrated Exposure Uptake Biokinetic (IEUBK) model. The report being peer reviewed may be used to inform the derivation of a concent...

Peer Review: The CHAMPUS Program.

ERIC Educational Resources Information Center

Stricker, George

This paper examines the use of the peer review system in evaluating out-patient clinical services for a third-party payer seeking justification for payment of services. Peer review is defined as a process by which one professional, in an official capacity, makes a judgment about a co-professional in a matter involving professional functioning. The…

Systematic review of peer education intervention programmes among individuals with type 2 diabetes.

PubMed

Gatlin, Tricia K; Serafica, Reimund; Johnson, Michael

2017-12-01

To systematically review published randomised controlled trials of peer education interventions among adults with type 2 diabetes. Systematic reviews have shown mixed results for peer support interventions to improve diabetes self-management. Given the effectiveness of diabetes education by healthcare professionals, peer education interventions may be a useful alternative approach. This review addressed that gap. Systematic review. A systematic search of published randomised controlled trials between 2006-2016 was conducted using the keywords diabetes, type 2 diabetes, randomised controlled trials, self-management, peer education and peer support. The methodological quality of each study was assessed using the Jadad scale. Seven studies were included in the final review, and the Jadad scores ranged from 8-10 of a possible 13 points. There was no consistent design, setting, or outcome measurement among the studies. There were two types of peer education interventions compared to traditional diabetes education: face-to-face or a combination of face-to-face and telephone/texting. The most common clinical outcome measure was HbA1c. Two of six studies showed statistically significant improvement in HbA1c between intervention and control groups. An increase in diabetes knowledge was also statistically significant in two of five studies. Peer education could be successful in improving clinical outcomes. No evidence was found indicating that healthcare provider education was superior in regard to clinical knowledge or behavioural or psychological outcome measures than peer education. HbA1c was statistically significantly lower in some peer education groups compared to control groups. There is evidence that peer education can be useful in achieving positive clinical outcomes such as decreasing HbA1c levels and increasing diabetes knowledge. A certified diabetes educator or a trained healthcare professional should not be overlooked though when using peer educators. © 2017 John Wiley & Sons Ltd.

Substance use capital: Social resources enhancing youth substance use.

PubMed

Baggio, S; Mohler-Kuo, M; Dupuis, M; Henchoz, Y; Studer, J; N'Goran, A A; Gmel, G

2016-09-01

Social capital is described as a protective factor against youth substance use, but it may also be associated with behaviours that do not enhance health. The present study hypothesized that 'substance use capital', i.e. resources favourable to substance use, is a risk factor for substance use and misuse. We used baseline data from the ongoing Cohort Study on Substance Use Risk Factors (C-SURF) that included a representative sample of young Swiss men (n=5623). Substance use (alcohol, cannabis, 15 illicit drugs, lifetime use, hazardous use and dependence), substance use capital (parental and peer attitudes towards substance use, parental and peer drug use, perceived norms of substance use) and aspects of social capital (relationships with parents and peers) were assessed. Logistic regressions were used to examine the associations between substance-related resources and social resources, and substance use. Results showed that substance-related resources were associated with an increased risk of substance use (OR between 1.25 and 4.67), whereas social resources' associations with substance use were commonly protective but weaker than substance-related resources. Thus, a drug-friendly environment facilitated substance use and misuse. Moreover, the results showed that peer environments were more drug-friendly than familial environments. In conclusion, this study highlighted a concept of 'substance use capital', which may be useful for advancing both theoretical and applied knowledge of substance use. Indeed, substance use is not only associated with a lack of social resources, but also with specific drug-friendly social resources coming from environment and background. Copyright © 2016 Elsevier Masson SAS. All rights reserved.

Transformation of Adolescent Peer Relations in the Social Media Context: Part 2-Application to Peer Group Processes and Future Directions for Research.

PubMed

Nesi, Jacqueline; Choukas-Bradley, Sophia; Prinstein, Mitchell J

2018-04-07

As social media use becomes increasingly widespread among adolescents, research in this area has accumulated rapidly. Researchers have shown a growing interest in the impact of social media on adolescents' peer experiences, including the ways that the social media context shapes a variety of peer relations constructs. This paper represents Part 2 of a two-part theoretical review. In this review, we offer a new model for understanding the transformative role of social media in adolescents' peer experiences, with the goal of stimulating future empirical work that is grounded in theory. The transformation framework suggests that the features of the social media context transform adolescents' peer experiences by changing their frequency or immediacy, amplifying demands, altering their qualitative nature, and/or offering new opportunities for compensatory or novel behaviors. In the current paper, we consider the ways that social media may transform peer relations constructs that often occur at the group level. Our review focuses on three key constructs: peer victimization, peer status, and peer influence. We selectively review and highlight existing evidence for the transformation of these domains through social media. In addition, we discuss methodological considerations and key conceptual principles for future work. The current framework offers a new theoretical perspective through which peer relations researchers may consider adolescent social media use.

Peer review of human studies run amok: a break in the fiduciary relation between scientists and the public.

PubMed

Feldstein Ewing, Sarah W; Saitz, Richard

2015-02-01

Peer review aims to ensure the quality and credibility of research reporting. Conducted by volunteer scientists who receive no guidance or direction, peer review widely varies from fast and facilitative, to unclear and obstructive. Poor quality is an issue because most science research is publicly funded, whereby scientists must make an effort to quickly disseminate their findings back to the public. An unfortunately not uncommon barrier in this process is ineffective peer review. Most scientists agree that when done well, editors and reviewers drive and maintain the high standards of science. At the same time, ineffective peer review can cause great delay with no introduced improvement in final product. These delays and requests interfere with the path of communication between scientist and public, at a great cost to editors, reviewers, authors and those who stand to benefit from application of the results of the studies. We offer a series of concrete recommendations to improve this process.

IRIS Toxicological Review of Inorganic Arsenic (Cancer) ...

EPA Pesticide Factsheets

On February 19, 2010, the draft IRIS Toxicological Review of Inorganic Arsenic (Cancer) external review draft document and the charge to external peer reviewers were released for public review and comment. The draft document and the charge to external peer reviewers were reviewed internally by EPA and by other federal agencies and White House Offices before public release. In the new IRIS process, introduced by the EPA Administrator, all written comments on IRIS assessments submitted by other federal agencies and White House Offices will be made publicly available. Accordingly, interagency comments and the interagency science consultation draft of the Toxicological Review of Inorganic Arsenic and the charge to external peer reviewers are posted on this site. This draft IRIS health assessment addresses only cancer human health effects that may result from chronic exposure to this chemical. An assessment of noncancer health effects of inorganic arsenic will be released for external peer review and public comment at a later date.

Impact of peer review on reports of randomised trials published in open peer review journals: retrospective before and after study

PubMed Central

Collins, Gary S; Boutron, Isabelle; Yu, Ly-Mee; Cook, Jonathan; Shanyinde, Milensu; Wharton, Rose; Shamseer, Larissa; Altman, Douglas G

2014-01-01

Objective To investigate the effectiveness of open peer review as a mechanism to improve the reporting of randomised trials published in biomedical journals. Design Retrospective before and after study. Setting BioMed Central series medical journals. Sample 93 primary reports of randomised trials published in BMC-series medical journals in 2012. Main outcome measures Changes to the reporting of methodological aspects of randomised trials in manuscripts after peer review, based on the CONSORT checklist, corresponding peer reviewer reports, the type of changes requested, and the extent to which authors adhered to these requests. Results Of the 93 trial reports, 38% (n=35) did not describe the method of random sequence generation, 54% (n=50) concealment of allocation sequence, 50% (n=46) whether the study was blinded, 34% (n=32) the sample size calculation, 35% (n=33) specification of primary and secondary outcomes, 55% (n=51) results for the primary outcome, and 90% (n=84) details of the trial protocol. The number of changes between manuscript versions was relatively small; most involved adding new information or altering existing information. Most changes requested by peer reviewers had a positive impact on the reporting of the final manuscript—for example, adding or clarifying randomisation and blinding (n=27), sample size (n=15), primary and secondary outcomes (n=16), results for primary or secondary outcomes (n=14), and toning down conclusions to reflect the results (n=27). Some changes requested by peer reviewers, however, had a negative impact, such as adding additional unplanned analyses (n=15). Conclusion Peer reviewers fail to detect important deficiencies in reporting of the methods and results of randomised trials. The number of these changes requested by peer reviewers was relatively small. Although most had a positive impact, some were inappropriate and could have a negative impact on reporting in the final publication. PMID:24986891

Analyzing learning during Peer Instruction dialogues: A resource activation framework

NASA Astrophysics Data System (ADS)

Wood, Anna K.; Galloway, Ross K.; Hardy, Judy; Sinclair, Christine M.

2014-12-01

Peer Instruction (PI) is an evidence based pedagogy commonly used in undergraduate physics instruction. When asked questions designed to test conceptual understanding, it has been observed that the proportion of students choosing the correct answer increases following peer discussion; however, relatively little is known about what takes place during these discussions or how they are beneficial to the processes of learning physics [M. C. James and S. Willoughby, Am. J. Phys. 79, 123 (2011)]. In this paper a framework for analyzing PI discussions developed through the lens of the "resources model" [D. Hammer, Am. J. Phys. 64, 1316 (1996); D. Hammer et al., Information Age Publishing (2005)] is proposed. A central hypothesis for this framework is that the dialogue with peers plays a crucial role in activating appropriate cognitive resources, enabling the students to see the problem differently, and therefore to answer the questions correctly. This framework is used to gain greater insights into the PI discussions of first year undergraduate physics students at the University of Edinburgh, UK, which were recorded using Livescribe Smartpens. Analysis of the dialogues revealed three different types of resource activation corresponding to increasing cognitive grain size. These were activation of knowledge elements, activation of linkages between knowledge elements, and activation of control structures (epistemic games and epistemological frames). Three case studies are examined to illustrate the role that peer dialogue plays in the activation of these cognitive resources in a PI session. The implications for pedagogical practice are discussed.

Mitigation of Disagreement in Peer Review among L2 Learners and Native Speakers in a College Writing Class (Mitigación del Impacto de las Opiniones de Desacuerdo en el Proceso de Revisión por Pares entre Estudiantes de una Segunda Lengua y Hablantes Nativos en una Clase de Escritura a Nivel Universitario)

ERIC Educational Resources Information Center

Christoffersen, Katherine O'Donnell

2015-01-01

Peer review is now a commonplace practice in process-oriented writing instruction. A crucial aspect of peer review is assessing another classmate's work, which encompasses the act of disagreement. Given its prevalence in the classroom, it is necessary to analyze how L2 learners mitigate disagreement in the context of peer review with other L2…