Skip to main content
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian
  • Log in
  • My Cart

Main menu

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Home
Home

Advanced Search

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses

New Research In

Physical Sciences

Featured Portals

  • Physics
  • Chemistry
  • Sustainability Science

Articles by Topic

  • Applied Mathematics
  • Applied Physical Sciences
  • Astronomy
  • Computer Sciences
  • Earth, Atmospheric, and Planetary Sciences
  • Engineering
  • Environmental Sciences
  • Mathematics
  • Statistics

Social Sciences

Featured Portals

  • Anthropology
  • Sustainability Science

Articles by Topic

  • Economic Sciences
  • Environmental Sciences
  • Political Sciences
  • Psychological and Cognitive Sciences
  • Social Sciences

Biological Sciences

Featured Portals

  • Sustainability Science

Articles by Topic

  • Agricultural Sciences
  • Anthropology
  • Applied Biological Sciences
  • Biochemistry
  • Biophysics and Computational Biology
  • Cell Biology
  • Developmental Biology
  • Ecology
  • Environmental Sciences
  • Evolution
  • Genetics
  • Immunology and Inflammation
  • Medical Sciences
  • Microbiology
  • Neuroscience
  • Pharmacology
  • Physiology
  • Plant Biology
  • Population Biology
  • Psychological and Cognitive Sciences
  • Sustainability Science
  • Systems Biology
Letter

Standard analyses fail to show that US studies overestimate effect sizes in softer research

Michèle B. Nuijten, Marcel A. L. M. van Assen, Robbie C. M. van Aert, and Jelte M. Wicherts
PNAS February 18, 2014 111 (7) E712-E713; https://doi.org/10.1073/pnas.1322149111
Michèle B. Nuijten
Department of Methodology and Statistics, Tilburg School of Social and Behavioral Sciences, Tilburg University, 5000 LE Tilburg, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: m.b.nuijten@uvt.nl
Marcel A. L. M. van Assen
Department of Methodology and Statistics, Tilburg School of Social and Behavioral Sciences, Tilburg University, 5000 LE Tilburg, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robbie C. M. van Aert
Department of Methodology and Statistics, Tilburg School of Social and Behavioral Sciences, Tilburg University, 5000 LE Tilburg, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jelte M. Wicherts
Department of Methodology and Statistics, Tilburg School of Social and Behavioral Sciences, Tilburg University, 5000 LE Tilburg, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site

This Letter has a Reply and related content. Please see:

  • US studies may overestimate effect sizes in softer research - August 26, 2013
  • Reply to Nuijten et al.: Reanalyses actually confirm that US studies overestimate effects in softer research - February 04, 2014
  • Article
  • Figures & SI
  • Info & Metrics
  • PDF
Loading

Online Impact

 

Article Information

vol. 111 no. 7 E712-E713
DOI: 
https://doi.org/10.1073/pnas.1322149111
PubMed: 
24497511

Published By: 
National Academy of Sciences
Print ISSN: 
0027-8424
Online ISSN: 
1091-6490
History: 
  • Published in issue February 18, 2014.
  • Published first February 4, 2014.


Author Information

  1. Michèle B. Nuijten1,
  2. Marcel A. L. M. van Assen,
  3. Robbie C. M. van Aert, and
  4. Jelte M. Wicherts
  1. Department of Methodology and Statistics, Tilburg School of Social and Behavioral Sciences, Tilburg University, 5000 LE Tilburg, The Netherlands

Footnotes

  • ↵1To whom correspondence should be addressed. E-mail: m.b.nuijten{at}uvt.nl.
  • Author contributions: M.A.L.M.v.A. and J.M.W. designed research; M.B.N. and R.C.M.v.A. performed research; M.B.N. and R.C.M.v.A. analyzed data; and M.B.N., M.A.L.M.v.A., and J.M.W. wrote the paper.

  • The authors declare no conflict of interest.

Cited By...

  • 5 Citations
  • 5 Citations
  • Google Scholar

This article has been cited by the following articles in journals that are participating in Crossref Cited-by Linking.

  • Questionable research practices among italian research psychologists
    Franca Agnoli, Jelte M. Wicherts, Coosje L. S. Veldkamp, Paolo Albiero, Roberto Cubelli, Jakob Pietschnig
    PLOS ONE 2017 12 3
  • The Replication Paradox: Combining Studies can Decrease Accuracy of Effect Size Estimates
    Michèle B. Nuijten, Marcel A. L. M. van Assen, Coosje L. S. Veldkamp, Jelte M. Wicherts
    Review of General Psychology 2015 19 2
  • A surge ofp-values between 0.041 and 0.049 in recent decades (but negative results are increasing rapidly too)
    Joost CF de Winter, Dimitra Dodou
    PeerJ 2015 3
  • Reply to Nuijten et al.: Reanalyses actually confirm that US studies overestimate effects in softer research
    D. Fanelli, J. P. A. Ioannidis
    Proceedings of the National Academy of Sciences 2014 111 7
  • Effect Sizes, Power, and Biases in Intelligence Research: A Meta-Meta-Analysis
    Michèle B. Nuijten, Marcel A. L. M. van Assen, Hilde E. M. Augusteijn, Elise A. V. Crompvoets, Jelte M. Wicherts
    Journal of Intelligence 2020 8 4

Article usage

Article usage: January 2014 to February 2021

AbstractFullPdf
Jan 2014004
Feb 20144548351331
Mar 20145063026
Apr 20141391815
May 201493188
Jun 201495119
Jul 20147697
Aug 201468139
Sep 2014602713
Oct 2014572511
Nov 2014451712
Dec 2014541213
Total 20145741531458
Jan 20153065
Feb 201529105
Mar 201535126
Apr 20151959
May 20153285
Jun 20152345
Jul 201529113
Aug 201526107
Sep 20153688
Oct 20152395
Nov 201528105
Dec 20153388
Total 201534310171
Jan 2016261310
Feb 20161222
Mar 20161620
Apr 20162523
May 20161652
Jun 201625103
Jul 2016933
Aug 20162034
Sep 20161224
Oct 20161841
Nov 20162885
Dec 20161501
Total 20162225438
Jan 20171814
Feb 20171773
Mar 201723117
Apr 20171231
May 20171871
Jun 2017830
Jul 20171442
Aug 20172178
Sep 20171232
Oct 20171313
Nov 2017921
Dec 2017700
Total 20171724932
Jan 2018943
Feb 201811123
Mar 2018675
Apr 201815153
May 2018191814
Jun 201829257
Jul 201813151
Aug 201816152
Sep 201821223
Oct 20180132
Nov 20183212
Dec 20182117
Total 201814417852
Jan 2019082
Feb 2019573
Mar 20191135
Apr 20193166
May 20192214
Jun 20190152
Jul 20195157
Aug 2019163
Sep 2019184
Oct 2019262
Nov 2019053
Dec 20190142
Total 20192013443
Jan 20201111
Feb 20200126
Mar 2020052
Apr 2020243
May 2020192
Jun 2020253
Jul 2020061
Aug 2020167
Sep 20203187
Oct 20202107
Nov 2020181
Dec 2020588
Total 20201810248
Jan 2021042
Feb 2021045
Total 2021087
Total66601157749
PreviousNext
Back to top
Article Alerts
Email Article

Thank you for your interest in spreading the word on PNAS.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Standard analyses fail to show that US studies overestimate effect sizes in softer research
(Your Name) has sent you a message from PNAS
(Your Name) thought you would like to see the PNAS web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Reanalysis of Fanelli & Ioannidis (2013)
Michèle B. Nuijten, Marcel A. L. M. van Assen, Robbie C. M. van Aert, Jelte M. Wicherts
Proceedings of the National Academy of Sciences Feb 2014, 111 (7) E712-E713; DOI: 10.1073/pnas.1322149111

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Request Permissions
Share
Reanalysis of Fanelli & Ioannidis (2013)
Michèle B. Nuijten, Marcel A. L. M. van Assen, Robbie C. M. van Aert, Jelte M. Wicherts
Proceedings of the National Academy of Sciences Feb 2014, 111 (7) E712-E713; DOI: 10.1073/pnas.1322149111
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Mendeley logo Mendeley
Proceedings of the National Academy of Sciences: 111 (7)
Table of Contents

Submit

Sign up for Article Alerts

Article Classifications

  • Biological Sciences
  • Medical Sciences

Jump to section

  • Article
    • Acknowledgments
    • Footnotes
    • References
  • Figures & SI
  • Info & Metrics
  • PDF

You May Also be Interested in

Surgeons hands during surgery
Inner Workings: Advances in infectious disease treatment promise to expand the pool of donor organs
Despite myriad challenges, clinicians see room for progress.
Image credit: Shutterstock/David Tadevosian.
Setting sun over a sun-baked dirt landscape
Core Concept: Popular integrated assessment climate policy models have key caveats
Better explicating the strengths and shortcomings of these models will help refine projections and improve transparency in the years ahead.
Image credit: Witsawat.S.
Double helix
Journal Club: Noncoding DNA shown to underlie function, cause limb malformations
Using CRISPR, researchers showed that a region some used to label “junk DNA” has a major role in a rare genetic disorder.
Image credit: Nathan Devery.
Steamboat Geyser eruption.
Eruption of Steamboat Geyser
Mara Reed and Michael Manga explore why Yellowstone's Steamboat Geyser resumed erupting in 2018.
Listen
Past PodcastsSubscribe
Multi-color molecular model
Enzymatic breakdown of PET plastic
A study demonstrates how two enzymes—MHETase and PETase—work synergistically to depolymerize the plastic pollutant PET.
Image credit: Aaron McGeehan (artist).

Similar Articles

Site Logo
Powered by HighWire
  • Submit Manuscript
  • Twitter
  • Facebook
  • RSS Feeds
  • Email Alerts

Articles

  • Current Issue
  • Special Feature Articles – Most Recent
  • List of Issues

PNAS Portals

  • Anthropology
  • Chemistry
  • Classics
  • Front Matter
  • Physics
  • Sustainability Science
  • Teaching Resources

Information

  • Authors
  • Editorial Board
  • Reviewers
  • Librarians
  • Press
  • Site Map
  • PNAS Updates

Feedback    Privacy/Legal

Copyright © 2021 National Academy of Sciences. Online ISSN 1091-6490