Skip to main content
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian
  • Log in
  • My Cart

Main menu

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Home
Home

Advanced Search

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses

New Research In

Physical Sciences

Featured Portals

  • Physics
  • Chemistry
  • Sustainability Science

Articles by Topic

  • Applied Mathematics
  • Applied Physical Sciences
  • Astronomy
  • Computer Sciences
  • Earth, Atmospheric, and Planetary Sciences
  • Engineering
  • Environmental Sciences
  • Mathematics
  • Statistics

Social Sciences

Featured Portals

  • Anthropology
  • Sustainability Science

Articles by Topic

  • Economic Sciences
  • Environmental Sciences
  • Political Sciences
  • Psychological and Cognitive Sciences
  • Social Sciences

Biological Sciences

Featured Portals

  • Sustainability Science

Articles by Topic

  • Agricultural Sciences
  • Anthropology
  • Applied Biological Sciences
  • Biochemistry
  • Biophysics and Computational Biology
  • Cell Biology
  • Developmental Biology
  • Ecology
  • Environmental Sciences
  • Evolution
  • Genetics
  • Immunology and Inflammation
  • Medical Sciences
  • Microbiology
  • Neuroscience
  • Pharmacology
  • Physiology
  • Plant Biology
  • Population Biology
  • Psychological and Cognitive Sciences
  • Sustainability Science
  • Systems Biology
Letter

The problem with delineating narrow criteria for citizen science

View ORCID ProfileJeremy Auerbach, Erika L. Barthelmess, Darlene Cavalier, Caren B. Cooper, Heather Fenyk, Mordechai Haklay, Joseph M. Hulbert, Christopher C. M. Kyba, Lincoln R. Larson, Eva Lewandowski, and Lea Shanley
PNAS July 30, 2019 116 (31) 15336-15337; https://doi.org/10.1073/pnas.1909278116
Jeremy Auerbach
aDepartment of Environmental and Radiological Health Sciences, Colorado State University, Fort Collins, CO 80523;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jeremy Auerbach
  • For correspondence: jeremy.auerbach@colostate.edu
Erika L. Barthelmess
bBiology Department, St. Lawrence University, Canton, NY 13617;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Darlene Cavalier
cSchool for the Future of Innovation, Arizona State University, Tempe, AZ 85287;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Caren B. Cooper
dDepartment of Forestry and Environmental Resources, North Carolina State University, Raleigh, NC 27695;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Heather Fenyk
eLower Raritan Watershed Partnership, New Brunswick, NJ 08901;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mordechai Haklay
fDepartment of Civil, Environmental and Geomatic Engineering, University College London, London WC1E 6BT, United Kingdom;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Joseph M. Hulbert
gForestry and Agricultural Biotechnology Institute, University of Pretoria, Pretoria 0002, South Africa;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christopher C. M. Kyba
hRemote Sensing and Geoinformatics, Deutsches GeoForschungsZentrum Potsdam, 14473 Potsdam, Germany;
iEcohydrology Department, Leibniz-Institute of Freshwater Ecology and Inland Fisheries, 12587 Berlin, Germany;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lincoln R. Larson
jDepartment of Parks, Recreation and Tourism Management, North Carolina State University, Raleigh, NC 27695;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eva Lewandowski
kWisconsin Department of Natural Resources, Madison, WI 53707;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lea Shanley
lNelson Institute for Environmental Studies, University of Wisconsin–Madison, Madison, WI 53706
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site

This Letter has a Reply and related content. Please see:

  • Reply to Auerbach et al.: How our Opinion piece invites collaboration - July 30, 2019
  • Opinion: Toward an international definition of citizen science - April 23, 2019
  • Article
  • Info & Metrics
  • PDF
Loading

Heigl et al. (1) propose an international definition of citizen science based on quality criteria for projects. As an international group of scholars with extensive background in the theory and practice of citizen science, we find the Opinion by Heigl et al. (1) antithetical to the creativity, innovation, and bottom-up pathways to knowledge generation that are embodied by citizen science. The minimum quality standards Heigl et al. (1) propose do not represent the interdisciplinary consensus of the international citizen science community*, and we fear that such a definition would confine rather than define the field.

Many citizen science professionals, including some of the authors of this letter, have attempted to define citizen science in the past, only to discover later that their definition does not fully encompass the field (2). We also strongly believe that it is both unproductive and fraught to narrowly define citizen science based on a set of quality criteria for individual projects. In addition, we note that, practically speaking, a classification system for citizen science projects based on quality criteria is not equivalent to a definition.

Such an approach also excludes several types of citizen science. For example, Heigl et al. (1) restrict their concept of citizen science to include only projects in which groups of citizens gather data for a predefined scientific purpose, generally reflecting contributory-style projects that represent only one component of the larger citizen science landscape. As a result, many long-standing examples of citizen science are not included in their definition, such as amateur astronomers who independently make systematic observations of our universe (3).

Heigl et al. (1) propose criteria that they claim will “help the field flourish, and … encourage policymakers to take [citizen science] project data and results seriously.” While defining criteria for inclusion is entirely reasonable for many purposes (e.g., project funding), those criteria will depend strongly on the situation. For example, some existing agencies have already developed definitions that meet their needs (4), and as with other scientific data citizen science data, should of course be evaluated as to its fitness for purpose. It is important to recognize, however, that citizen science also extends well beyond development and testing of research hypotheses, including activities such as environmental monitoring, producing training data for supervised machine learning, data visualization and interpretation, and complex problem solving.

We argue that Heigl et al.’s (1) specified minimum quality criteria should not be used as “the basis for an international declaration” because any exclusionary approach will necessarily fail to address the “challenge of accommodating considerable heterogeneity” within the field of citizen science. Instead of focusing on specific criteria, we advocate for collaboration among all engaged actors to emphasize informed consent about project design features and transparency in data collection and handling practices (to indicate data quality and fitness for purpose). We encourage the citizen science community and associated collaborators (such as funding agencies) to determine the best design specifications for their own unique contexts, enabling citizen science to achieve its full potential.

Footnotes

  • ↵1To whom correspondence may be addressed. Email: jeremy.auerbach{at}colostate.edu.
  • Author contributions: J.A., E.L.B., D.C., C.B.C., H.F., M.H., J.M.H., C.C.M.K., L.R.L., E.L., and L.S. wrote the paper.

  • The authors declare no conflict of interest.

  • ↵*See https://www.researchgate.net/publication/333530451 for signatories of this letter.

Published under the PNAS license.

View Abstract

References

  1. ↵
    1. F. Heigl,
    2. B. Kieslinger,
    3. K. T. Paul,
    4. J. Uhlik,
    5. D. Dörler
    , Opinion: Toward an international definition of citizen science. Proc. Natl. Acad. Sci. U.S.A. 116, 8089–8092 (2019).
    OpenUrlFREE Full Text
  2. ↵
    1. P. Schrögel,
    2. A. Kolleck
    , The many faces of participation in science: Literature review and proposal for a three dimensional framework. Sci. Technol. Stud. 32, doi:10.23987/sts.59519 (2018).
    OpenUrlCrossRef
  3. ↵
    1. D. Castelvecchi
    , Amateur astronomer catches first glimpses of birth of a supernova Nature (2018). https://www.nature.com/articles/d41586-018-02331-4. Accessed 28 May 2019.
  4. ↵
    1. L. Shanley,
    2. J. Hulbert,
    3. J. Auerbach
    , “Definitions of citizen science.” CitiSciDefinitions (2019). https://github.com/lshanley/CitSciDefinitions. Accessed 28 May 2019.
PreviousNext
Back to top
Article Alerts
Email Article

Thank you for your interest in spreading the word on PNAS.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
The problem with delineating narrow criteria for citizen science
(Your Name) has sent you a message from PNAS
(Your Name) thought you would like to see the PNAS web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
The problem with delineating narrow criteria for citizen science
Jeremy Auerbach, Erika L. Barthelmess, Darlene Cavalier, Caren B. Cooper, Heather Fenyk, Mordechai Haklay, Joseph M. Hulbert, Christopher C. M. Kyba, Lincoln R. Larson, Eva Lewandowski, Lea Shanley
Proceedings of the National Academy of Sciences Jul 2019, 116 (31) 15336-15337; DOI: 10.1073/pnas.1909278116

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Request Permissions
Share
The problem with delineating narrow criteria for citizen science
Jeremy Auerbach, Erika L. Barthelmess, Darlene Cavalier, Caren B. Cooper, Heather Fenyk, Mordechai Haklay, Joseph M. Hulbert, Christopher C. M. Kyba, Lincoln R. Larson, Eva Lewandowski, Lea Shanley
Proceedings of the National Academy of Sciences Jul 2019, 116 (31) 15336-15337; DOI: 10.1073/pnas.1909278116
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Mendeley logo Mendeley
Proceedings of the National Academy of Sciences: 116 (31)
Table of Contents

Submit

Sign up for Article Alerts

Article Classifications

  • Biological Sciences
  • Ecology
  • Social Sciences
  • Social Sciences

Jump to section

  • Article
    • Footnotes
    • References
  • Info & Metrics
  • PDF

You May Also be Interested in

Abstract depiction of a guitar and musical note
Science & Culture: At the nexus of music and medicine, some see disease treatments
Although the evidence is still limited, a growing body of research suggests music may have beneficial effects for diseases such as Parkinson’s.
Image credit: Shutterstock/agsandrew.
Scientist looking at an electronic tablet
Opinion: Standardizing gene product nomenclature—a call to action
Biomedical communities and journals need to standardize nomenclature of gene products to enhance accuracy in scientific and public communication.
Image credit: Shutterstock/greenbutterfly.
One red and one yellow modeled protein structures
Journal Club: Study reveals evolutionary origins of fold-switching protein
Shapeshifting designs could have wide-ranging pharmaceutical and biomedical applications in coming years.
Image credit: Acacia Dishman/Medical College of Wisconsin.
White and blue bird
Hazards of ozone pollution to birds
Amanda Rodewald, Ivan Rudik, and Catherine Kling talk about the hazards of ozone pollution to birds.
Listen
Past PodcastsSubscribe
Goats standing in a pin
Transplantation of sperm-producing stem cells
CRISPR-Cas9 gene editing can improve the effectiveness of spermatogonial stem cell transplantation in mice and livestock, a study finds.
Image credit: Jon M. Oatley.

Similar Articles

Site Logo
Powered by HighWire
  • Submit Manuscript
  • Twitter
  • Facebook
  • RSS Feeds
  • Email Alerts

Articles

  • Current Issue
  • Latest Articles
  • Archive

PNAS Portals

  • Anthropology
  • Chemistry
  • Classics
  • Front Matter
  • Physics
  • Sustainability Science
  • Teaching Resources

Information

  • Authors
  • Editorial Board
  • Reviewers
  • Librarians
  • Press
  • Site Map
  • PNAS Updates

Feedback    Privacy/Legal

Copyright © 2021 National Academy of Sciences. Online ISSN 1091-6490