Skip to main content

Main menu

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
    • Front Matter Portal
    • Journal Club
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Home
Home
  • Log in
  • My Cart

Advanced Search

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
    • Front Matter Portal
    • Journal Club
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
Reply

Reply to Mislavsky et al.: Sometimes people really are averse to experiments

Michelle N. Meyer, View ORCID ProfilePatrick R. Heck, Geoffrey S. Holtzman, Stephen M. Anderson, William Cai, View ORCID ProfileDuncan J. Watts, and Christopher F. Chabris
  1. aCenter for Translational Bioethics and Health Care Policy, Geisinger Health System, Danville, PA 17821;
  2. bAutism and Developmental Medicine Institute, Geisinger Health System, Lewisburg, PA 17837;
  3. cDepartment of Psychology, Franklin & Marshall College, Lancaster, PA 17603;
  4. dDepartment of Psychology, The Pennsylvania State University, University Park, PA 16802;
  5. eDepartment of Management Science and Engineering, Stanford University, Stanford, CA 94305;
  6. fDepartment of Computer and Information Science, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104;
  7. gAnnenberg School for Communication, University of Pennsylvania, Philadelphia, PA 19104;
  8. hDepartment of Operations, Information and Decisions, Wharton School, University of Pennsylvania, Philadelphia, PA 19104

See allHide authors and affiliations

PNAS November 26, 2019 116 (48) 23885-23886; first published November 12, 2019; https://doi.org/10.1073/pnas.1914509116
Michelle N. Meyer
aCenter for Translational Bioethics and Health Care Policy, Geisinger Health System, Danville, PA 17821;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: michellenmeyer@gmail.com
Patrick R. Heck
aCenter for Translational Bioethics and Health Care Policy, Geisinger Health System, Danville, PA 17821;
bAutism and Developmental Medicine Institute, Geisinger Health System, Lewisburg, PA 17837;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Patrick R. Heck
Geoffrey S. Holtzman
cDepartment of Psychology, Franklin & Marshall College, Lancaster, PA 17603;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stephen M. Anderson
dDepartment of Psychology, The Pennsylvania State University, University Park, PA 16802;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
William Cai
eDepartment of Management Science and Engineering, Stanford University, Stanford, CA 94305;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Duncan J. Watts
fDepartment of Computer and Information Science, School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104;
gAnnenberg School for Communication, University of Pennsylvania, Philadelphia, PA 19104;
hDepartment of Operations, Information and Decisions, Wharton School, University of Pennsylvania, Philadelphia, PA 19104
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Duncan J. Watts
Christopher F. Chabris
bAutism and Developmental Medicine Institute, Geisinger Health System, Lewisburg, PA 17837;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & SI
  • Info & Metrics
  • PDF
Loading

Article Figures & SI

Figures

  • Fig. 1.
    • Download figure
    • Open in new tab
    • Download powerpoint
    Fig. 1.

    Simulation run using Mislavsky et al.’s R code. We modified their simulation—which they used to claim that there was no evidence for experiment aversion—by replacing the 3 weakest studies (“Basic Income,” “Health Worker Recruitment,” and “Teacher Well-being”) with 3 studies that found a large A/B effect (“Safety Checklist,” “Walk-In Clinic,” and “Best Drug”). We used the same input correlation (r = 0.33) that Mislavsky et al. obtained from 99 Amazon Mechanical Turk participants. The overall comparison (Far Right) now produces evidence of an A/B effect, where the mean of the worst arm (M = 3.61) is greater than (and outside the 95% CI limits of) the mean of the experiment (M = 3.31).

PreviousNext
Back to top
Article Alerts
Email Article

Thank you for your interest in spreading the word on PNAS.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Reply to Mislavsky et al.: Sometimes people really are averse to experiments
(Your Name) has sent you a message from PNAS
(Your Name) thought you would like to see the PNAS web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Reply to Mislavsky et al.: Sometimes people really are averse to experiments
Michelle N. Meyer, Patrick R. Heck, Geoffrey S. Holtzman, Stephen M. Anderson, William Cai, Duncan J. Watts, Christopher F. Chabris
Proceedings of the National Academy of Sciences Nov 2019, 116 (48) 23885-23886; DOI: 10.1073/pnas.1914509116

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Request Permissions
Share
Reply to Mislavsky et al.: Sometimes people really are averse to experiments
Michelle N. Meyer, Patrick R. Heck, Geoffrey S. Holtzman, Stephen M. Anderson, William Cai, Duncan J. Watts, Christopher F. Chabris
Proceedings of the National Academy of Sciences Nov 2019, 116 (48) 23885-23886; DOI: 10.1073/pnas.1914509116
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Mendeley logo Mendeley

Article Classifications

  • Social Sciences
  • Psychological and Cognitive Sciences

This article has a Letter. Please see:

  • Relationship between Letter and Reply - November 06, 2019

See related content:

  • Objecting to experiments that compare two unobjectionable policies or treatments
    - May 09, 2019
Proceedings of the National Academy of Sciences: 116 (48)
Table of Contents

Submit

Sign up for Article Alerts

Jump to section

  • Article
    • Footnotes
    • References
  • Figures & SI
  • Info & Metrics
  • PDF

You May Also be Interested in

Water from a faucet fills a glass.
News Feature: How “forever chemicals” might impair the immune system
Researchers are exploring whether these ubiquitous fluorinated molecules might worsen infections or hamper vaccine effectiveness.
Image credit: Shutterstock/Dmitry Naumov.
Reflection of clouds in the still waters of Mono Lake in California.
Inner Workings: Making headway with the mysteries of life’s origins
Recent experiments and simulations are starting to answer some fundamental questions about how life came to be.
Image credit: Shutterstock/Radoslaw Lecyk.
Cave in coastal Kenya with tree growing in the middle.
Journal Club: Small, sharp blades mark shift from Middle to Later Stone Age in coastal Kenya
Archaeologists have long tried to define the transition between the two time periods.
Image credit: Ceri Shipton.
Mouse fibroblast cells. Electron bifurcation reactions keep mammalian cells alive.
Exploring electron bifurcation
Jonathon Yuly, David Beratan, and Peng Zhang investigate how electron bifurcation reactions work.
Listen
Past PodcastsSubscribe
Panda bear hanging in a tree
How horse manure helps giant pandas tolerate cold
A study finds that giant pandas roll in horse manure to increase their cold tolerance.
Image credit: Fuwen Wei.

Similar Articles

Site Logo
Powered by HighWire
  • Submit Manuscript
  • Twitter
  • Facebook
  • RSS Feeds
  • Email Alerts

Articles

  • Current Issue
  • Special Feature Articles – Most Recent
  • List of Issues

PNAS Portals

  • Anthropology
  • Chemistry
  • Classics
  • Front Matter
  • Physics
  • Sustainability Science
  • Teaching Resources

Information

  • Authors
  • Editorial Board
  • Reviewers
  • Subscribers
  • Librarians
  • Press
  • Cozzarelli Prize
  • Site Map
  • PNAS Updates
  • FAQs
  • Accessibility Statement
  • Rights & Permissions
  • About
  • Contact

Feedback    Privacy/Legal

Copyright © 2021 National Academy of Sciences. Online ISSN 1091-6490