Skip to main content
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian
  • Log in
  • My Cart

Main menu

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Home
Home

Advanced Search

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses

New Research In

Physical Sciences

Featured Portals

  • Physics
  • Chemistry
  • Sustainability Science

Articles by Topic

  • Applied Mathematics
  • Applied Physical Sciences
  • Astronomy
  • Computer Sciences
  • Earth, Atmospheric, and Planetary Sciences
  • Engineering
  • Environmental Sciences
  • Mathematics
  • Statistics

Social Sciences

Featured Portals

  • Anthropology
  • Sustainability Science

Articles by Topic

  • Economic Sciences
  • Environmental Sciences
  • Political Sciences
  • Psychological and Cognitive Sciences
  • Social Sciences

Biological Sciences

Featured Portals

  • Sustainability Science

Articles by Topic

  • Agricultural Sciences
  • Anthropology
  • Applied Biological Sciences
  • Biochemistry
  • Biophysics and Computational Biology
  • Cell Biology
  • Developmental Biology
  • Ecology
  • Environmental Sciences
  • Evolution
  • Genetics
  • Immunology and Inflammation
  • Medical Sciences
  • Microbiology
  • Neuroscience
  • Pharmacology
  • Physiology
  • Plant Biology
  • Population Biology
  • Psychological and Cognitive Sciences
  • Sustainability Science
  • Systems Biology
Research Article

Measuring the effectiveness of scientific gatekeeping

Kyle Siler, Kirby Lee, and Lisa Bero
PNAS January 13, 2015 112 (2) 360-365; first published December 22, 2014; https://doi.org/10.1073/pnas.1418218112
Kyle Siler
aDepartment of Strategic Management, Rotman School of Management, University of Toronto, Toronto, ON, Canada M5S 3E6;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: ksiler@gmail.com
Kirby Lee
bDepartment of Clinical Pharmacy, University of California, San Francisco, CA 94143; and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lisa Bero
cFaculty of Pharmacy and Charles Perkins Centre, University of Sydney, Sydney, NSW 2006, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  1. Edited by Susan T. Fiske, Princeton University, Princeton, NJ, and approved November 18, 2014 (received for review September 21, 2014)

This article has a Letter. Please see:

  • Mistake index as a surrogate of quality in scientific manuscripts - March 10, 2015

See related content:

  • Science should prevent mistakes, not corrections
    - Mar 10, 2015
  • Article
  • Figures & SI
  • Info & Metrics
  • PDF
Loading

Article Figures & SI

Figures

  • Tables
  • Fig. 1.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Fig. 1.

    Citation distribution of rejected articles (peer reviewed vs. desk-rejected).

  • Fig. 2.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Fig. 2.

    Citation distribution of accepted and rejected articles.

  • Fig. 3.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Fig. 3.

    Citation distribution of rejected articles by time to publication.

Tables

  • Figures
    • View popup
    Table 1.

    Most common justifications for article rejection among top 15-cited cases

    Justificationn
    Lacking novelty7
    Methodological problems4
    Magnitude of results too small4
    No reason given3
    Insufficient data/evidence2
    Speculative results/questionable validity2
    • View popup
    Table 2.

    Impact factor comparisons of submitted versus published journals, 14 most highly cited articles

    Citation rankImpact factor ratio of submitted to published journalPublication journal outcome
    10.85Higher
    2 (first rejection)0.18Higher
    2 (second rejection)0.46Higher
    30.85Higher
    41.41Lower
    51.39Lower
    63.02Lower
    71.11Lower
    80.96Higher
    92.92Lower
    1012.14Lower
    111.49Lower
    126.96Lower
    132.57Lower
    146.79Lower

Data supplements

  • Podcast

    Files in this Data Supplement:

    • Download Podcast Interview (MP3)
  • Supporting Information

    Files in this Data Supplement:

    • Download Supporting Information (PDF)
    • Download Appendix (DOCX)
    • Download Appendix (DOCX)
PreviousNext
Back to top
Article Alerts
Email Article

Thank you for your interest in spreading the word on PNAS.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Measuring the effectiveness of scientific gatekeeping
(Your Name) has sent you a message from PNAS
(Your Name) thought you would like to see the PNAS web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Measuring the effectiveness of peer review
Kyle Siler, Kirby Lee, Lisa Bero
Proceedings of the National Academy of Sciences Jan 2015, 112 (2) 360-365; DOI: 10.1073/pnas.1418218112

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Request Permissions
Share
Measuring the effectiveness of peer review
Kyle Siler, Kirby Lee, Lisa Bero
Proceedings of the National Academy of Sciences Jan 2015, 112 (2) 360-365; DOI: 10.1073/pnas.1418218112
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Mendeley logo Mendeley
Proceedings of the National Academy of Sciences: 112 (2)
Table of Contents

Submit

Sign up for Article Alerts

Article Classifications

  • Social Sciences
  • Social Sciences

Jump to section

  • Article
    • Abstract
    • Materials and Methods
    • Results
    • Discussion
    • Acknowledgments
    • Footnotes
    • References
  • Figures & SI
  • Info & Metrics
  • PDF

You May Also be Interested in

Surgeons hands during surgery
Inner Workings: Advances in infectious disease treatment promise to expand the pool of donor organs
Despite myriad challenges, clinicians see room for progress.
Image credit: Shutterstock/David Tadevosian.
Setting sun over a sun-baked dirt landscape
Core Concept: Popular integrated assessment climate policy models have key caveats
Better explicating the strengths and shortcomings of these models will help refine projections and improve transparency in the years ahead.
Image credit: Witsawat.S.
Double helix
Journal Club: Noncoding DNA shown to underlie function, cause limb malformations
Using CRISPR, researchers showed that a region some used to label “junk DNA” has a major role in a rare genetic disorder.
Image credit: Nathan Devery.
Steamboat Geyser eruption.
Eruption of Steamboat Geyser
Mara Reed and Michael Manga explore why Yellowstone's Steamboat Geyser resumed erupting in 2018.
Listen
Past PodcastsSubscribe
Birds nestling on tree branches
Parent–offspring conflict in songbird fledging
Some songbird parents might improve their own fitness by manipulating their offspring into leaving the nest early, at the cost of fledgling survival, a study finds.
Image credit: Gil Eckrich (photographer).

Similar Articles

Site Logo
Powered by HighWire
  • Submit Manuscript
  • Twitter
  • Facebook
  • RSS Feeds
  • Email Alerts

Articles

  • Current Issue
  • Special Feature Articles – Most Recent
  • List of Issues

PNAS Portals

  • Anthropology
  • Chemistry
  • Classics
  • Front Matter
  • Physics
  • Sustainability Science
  • Teaching Resources

Information

  • Authors
  • Editorial Board
  • Reviewers
  • Librarians
  • Press
  • Site Map
  • PNAS Updates

Feedback    Privacy/Legal

Copyright © 2021 National Academy of Sciences. Online ISSN 1091-6490