Skip to main content
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian
  • Log in
  • My Cart

Main menu

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Home
Home

Advanced Search

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses

New Research In

Physical Sciences

Featured Portals

  • Physics
  • Chemistry
  • Sustainability Science

Articles by Topic

  • Applied Mathematics
  • Applied Physical Sciences
  • Astronomy
  • Computer Sciences
  • Earth, Atmospheric, and Planetary Sciences
  • Engineering
  • Environmental Sciences
  • Mathematics
  • Statistics

Social Sciences

Featured Portals

  • Anthropology
  • Sustainability Science

Articles by Topic

  • Economic Sciences
  • Environmental Sciences
  • Political Sciences
  • Psychological and Cognitive Sciences
  • Social Sciences

Biological Sciences

Featured Portals

  • Sustainability Science

Articles by Topic

  • Agricultural Sciences
  • Anthropology
  • Applied Biological Sciences
  • Biochemistry
  • Biophysics and Computational Biology
  • Cell Biology
  • Developmental Biology
  • Ecology
  • Environmental Sciences
  • Evolution
  • Genetics
  • Immunology and Inflammation
  • Medical Sciences
  • Microbiology
  • Neuroscience
  • Pharmacology
  • Physiology
  • Plant Biology
  • Population Biology
  • Psychological and Cognitive Sciences
  • Sustainability Science
  • Systems Biology
Research Article

Distinct neural ensemble response statistics are associated with recognition and discrimination of natural sound textures

Xiu Zhai, Fatemeh Khatami, Mina Sadeghi, Fengrong He, Heather L. Read, View ORCID ProfileIan H. Stevenson, and View ORCID ProfileMonty A. Escabí
PNAS December 8, 2020 117 (49) 31482-31493; first published November 20, 2020; https://doi.org/10.1073/pnas.2005644117
Xiu Zhai
aElectrical and Computer Engineering, University of Connecticut, Storrs, CT 06269;
bBiomedical Engineering, University of Connecticut, Storrs, CT 06269;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fatemeh Khatami
bBiomedical Engineering, University of Connecticut, Storrs, CT 06269;
cBioengineering Department, School of Engineering, University of the Pacific, Stockton, CA 95211;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mina Sadeghi
aElectrical and Computer Engineering, University of Connecticut, Storrs, CT 06269;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fengrong He
bBiomedical Engineering, University of Connecticut, Storrs, CT 06269;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Heather L. Read
bBiomedical Engineering, University of Connecticut, Storrs, CT 06269;
dPsychological Sciences, University of Connecticut, Storrs, CT 06269;
eConnecticut Institute for Brain and Cognitive Sciences, University of Connecticut, Storrs, CT 06269
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ian H. Stevenson
bBiomedical Engineering, University of Connecticut, Storrs, CT 06269;
dPsychological Sciences, University of Connecticut, Storrs, CT 06269;
eConnecticut Institute for Brain and Cognitive Sciences, University of Connecticut, Storrs, CT 06269
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ian H. Stevenson
Monty A. Escabí
aElectrical and Computer Engineering, University of Connecticut, Storrs, CT 06269;
bBiomedical Engineering, University of Connecticut, Storrs, CT 06269;
dPsychological Sciences, University of Connecticut, Storrs, CT 06269;
eConnecticut Institute for Brain and Cognitive Sciences, University of Connecticut, Storrs, CT 06269
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Monty A. Escabí
  • For correspondence: escabi@engr.uconn.edu
  1. Edited by Robert J. Zatorre, Montreal Neurological Institute, McGill University, Montreal, QC, Canada, and accepted by Editorial Board Member Thomas D. Albright August 21, 2020 (received for review March 25, 2020)

  • Article
  • Figures & SI
  • Info & Metrics
  • PDF
Loading

Significance

Being able to recognize and discriminate natural sounds, such as from a running stream, a crowd clapping, or ruffling leaves, is a critical task of the normal functioning auditory system. Humans can easily perform such tasks, yet they can be particularly difficult for the hearing impaired and they challenge our most sophisticated computer algorithms. This difficulty is attributed to the complex physical structure of such natural sounds and the fact they are not unique: they vary randomly in a statistically defined manner from one excerpt to the other. Here we provide evidence that the central auditory system is able to encode and utilize statistical sound cues for natural sound recognition and discrimination behaviors.

Abstract

The perception of sound textures, a class of natural sounds defined by statistical sound structure such as fire, wind, and rain, has been proposed to arise through the integration of time-averaged summary statistics. Where and how the auditory system might encode these summary statistics to create internal representations of these stationary sounds, however, is unknown. Here, using natural textures and synthetic variants with reduced statistics, we show that summary statistics modulate the correlations between frequency organized neuron ensembles in the awake rabbit inferior colliculus (IC). These neural ensemble correlation statistics capture high-order sound structure and allow for accurate neural decoding in a single trial recognition task with evidence accumulation times approaching 1 s. In contrast, the average activity across the neural ensemble (neural spectrum) provides a fast (tens of milliseconds) and salient signal that contributes primarily to texture discrimination. Intriguingly, perceptual studies in human listeners reveal analogous trends: the sound spectrum is integrated quickly and serves as a salient discrimination cue while high-order sound statistics are integrated slowly and contribute substantially more toward recognition. The findings suggest statistical sound cues such as the sound spectrum and correlation structure are represented by distinct response statistics in auditory midbrain ensembles, and that these neural response statistics may have dissociable roles and time scales for the recognition and discrimination of natural sounds.

  • natural sounds
  • auditory textures
  • sound statistics
  • neural coding
  • perception

Footnotes

  • ↵1F.K. and M.S. contributed equally to this work.

  • ↵2To whom correspondence may be addressed. Email: escabi{at}engr.uconn.edu.
  • Author contributions: X.Z., M.S., H.L.R., I.H.S., and M.A.E. designed research; X.Z., F.K., M.S., F.H., and M.A.E. performed research; X.Z., F.K., M.S., I.H.S., and M.A.E. analyzed data; X.Z., I.H.S., and M.A.E. wrote the paper; and F.H. assisted with neural data acquisition.

  • Competing interest statement: H.L.R. has ownership interest in Elemind Technologies, Inc. and this private company did not sponsor this research.

  • This article is a PNAS Direct Submission. R.J.Z. is a guest editor invited by the Editorial Board.

  • This article contains supporting information online at https://www.pnas.org/lookup/suppl/doi:10.1073/pnas.2005644117/-/DCSupplemental.

Data Availability.

All study data are included in the article and supporting information.

Published under the PNAS license.

View Full Text

References

  1. ↵
    1. J. H. McDermott,
    2. E. P. Simoncelli
    , Sound texture perception via statistics of the auditory periphery: Evidence from sound synthesis. Neuron 71, 926–940 (2011).
    OpenUrlCrossRefPubMed
  2. ↵
    1. M. N. Geffen,
    2. J. Gervain,
    3. J. F. Werker,
    4. M. O. Magnasco
    , Auditory perception of self-similarity in water sounds. Front. Integr. Nuerosci. 5, 15 (2011).
    OpenUrl
  3. ↵
    1. R. McWalter,
    2. T. Dau
    , Cascaded amplitude modulations in sound texture perception. Front. Neurosci. 11, 485 (2017).
    OpenUrl
  4. ↵
    1. M. Sadeghi,
    2. X. Zhai,
    3. I. H. Stevenson,
    4. M. A. Escabí
    , A neural ensemble correlation code for sound category identification. PLoS Biol. 17, e3000449 (2019).
    OpenUrlCrossRef
  5. ↵
    1. F. A. Rodríguez,
    2. C. Chen,
    3. H. L. Read,
    4. M. A. Escabí
    , Neural modulation tuning characteristics scale to efficiently encode natural sound statistics. J. Neurosci. 30, 15969–15980 (2010).
    OpenUrlAbstract/FREE Full Text
  6. ↵
    1. M. A. Escabí,
    2. L. M. Miller,
    3. H. L. Read,
    4. C. E. Schreiner
    , Naturalistic auditory contrast improves spectrotemporal coding in the cat inferior colliculus. J. Neurosci. 23, 11489–11504 (2003).
    OpenUrlAbstract/FREE Full Text
  7. ↵
    1. M. A. Escabi,
    2. C. E. Schreiner
    , Nonlinear spectrotemporal sound analysis by neurons in the auditory midbrain. J. Neurosci. 22, 4114–4131 (2002).
    OpenUrlAbstract/FREE Full Text
  8. ↵
    1. D. L. Barbour,
    2. X. Wang
    , Contrast tuning in auditory cortex. Science 299, 1073–1075 (2003).
    OpenUrlAbstract/FREE Full Text
  9. ↵
    1. N. C. Rabinowitz,
    2. B. D. Willmore,
    3. J. W. Schnupp,
    4. A. J. King
    , Contrast gain control in auditory cortex. Neuron 70, 1178–1191 (2011).
    OpenUrlCrossRefPubMed
  10. ↵
    1. H. Attias,
    2. C. Schreiner
    , Coding of naturalistic stimuli by auditory midbrain neurons. Adv. Neural Inf. Process. Syst. 10, 103–109 (1998).
    OpenUrl
  11. ↵
    1. I. Nelken,
    2. Y. Rotman,
    3. O. Bar Yosef
    , Responses of auditory-cortex neurons to structural features of natural sounds. Nature 397, 154–157 (1999).
    OpenUrlCrossRefPubMed
  12. ↵
    1. S. M. Woolley,
    2. T. E. Fremouw,
    3. A. Hsu,
    4. F. E. Theunissen
    , Tuning for spectro-temporal modulations as a mechanism for auditory discrimination of natural sounds. Nat. Neurosci. 8, 1371–1379 (2005).
    OpenUrlCrossRefPubMed
  13. ↵
    1. S. Shamma,
    2. D. Klein
    , The case of the missing pitch templates: How harmonic templates emerge in the early auditory system. J. Acoust. Soc. Am. 107, 2631–2644 (2000).
    OpenUrlCrossRefPubMed
  14. ↵
    1. L. A. Jeffress
    , A place theory of sound localization. J. Comp. Physiol. Psychol. 41, 35–39 (1948).
    OpenUrlCrossRefPubMed
  15. ↵
    1. C. Chen,
    2. H. L. Read,
    3. M. A. Escabí
    , Precise feature based time scales and frequency decorrelation lead to a sparse auditory code. J. Neurosci. 32, 8454–8468 (2012).
    OpenUrlAbstract/FREE Full Text
  16. ↵
    1. J. H. McDermott,
    2. M. Schemitsch,
    3. E. P. Simoncelli
    , Summary statistics in auditory perception. Nat. Neurosci. 16, 493–498 (2013).
    OpenUrlCrossRefPubMed
  17. ↵
    1. C. E. Schreiner,
    2. G. Langner
    , Periodicity coding in the inferior colliculus of the cat. II. Topographical organization. J. Neurophysiol. 60, 1823–1840 (1988).
    OpenUrlCrossRefPubMed
  18. ↵
    1. G. Chechik et al
    ., Reduction of information redundancy in the ascending auditory pathway. Neuron 51, 359–368 (2006).
    OpenUrlCrossRefPubMed
  19. ↵
    1. M. Braun
    , Auditory midbrain laminar structure appears adapted to f0 extraction: Further evidence and implications of the double critical bandwidth. Hear. Res. 129, 71–82 (1999).
    OpenUrlCrossRefPubMed
  20. ↵
    1. J. Portilla,
    2. E. P. Simoncelli
    , A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vis. 40, 49–70 (2000).
    OpenUrlCrossRef
  21. ↵
    1. G. Okazawa,
    2. S. Tajima,
    3. H. Komatsu
    , Image statistics underlying natural texture selectivity of neurons in macaque V4. Proc. Natl. Acad. Sci. U.S.A. 112, E351–E360 (2015).
    OpenUrlAbstract/FREE Full Text
  22. ↵
    1. C. M. Ziemba,
    2. J. Freeman,
    3. J. A. Movshon,
    4. E. P. Simoncelli
    , Selectivity and tolerance for visual texture in macaque V2. Proc. Natl. Acad. Sci. U.S.A. 113, E3140–E3149 (2016).
    OpenUrlAbstract/FREE Full Text
  23. ↵
    1. M. Bányai et al
    ., Stimulus complexity shapes response correlations in primary visual cortex. Proc. Natl. Acad. Sci. U.S.A. 116, 2723–2732 (2019).
    OpenUrlAbstract/FREE Full Text
  24. ↵
    1. D. W. Dong,
    2. J. J. Atick
    , Statistics of natural time-varying images. Network 6, 345–358 (1995).
    OpenUrlCrossRef
  25. ↵
    1. P. X. Joris,
    2. C. E. Schreiner,
    3. A. Rees
    , Neural processing of amplitude-modulated sounds. Physiol. Rev. 84, 541–577 (2004).
    OpenUrlCrossRefPubMed
  26. ↵
    1. B. C. J. Moore
    , An Introduction to the Psychology of Hearing (Academic Press, 1997).
  27. ↵
    1. B. J. Balas
    , Texture synthesis and perception: Using computational models to study texture representations in the human visual system. Vision Res. 46, 299–309 (2006).
    OpenUrlCrossRefPubMed
  28. ↵
    1. J. W. Schnupp,
    2. J. A. Garcia-Lazaro,
    3. N. A. Lesica
    , Periodotopy in the gerbil inferior colliculus: Local clustering rather than a gradient map. Front. Neural Circuits 9, 37 (2015).
    OpenUrlCrossRefPubMed

Log in using your username and password

Forgot your user name or password?

Log in through your institution

You may be able to gain access using your login credentials for your institution. Contact your library if you do not have a username and password.
If your organization uses OpenAthens, you can log in using your OpenAthens username and password. To check if your institution is supported, please see this list. Contact your library for more details.

Purchase access

You may purchase access to this article. This will require you to create an account if you don't already have one.

Subscribers, for more details, please visit our Subscriptions FAQ.

Please click here to log into the PNAS submission website.

PreviousNext
Back to top
Article Alerts
Email Article

Thank you for your interest in spreading the word on PNAS.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Distinct neural ensemble response statistics are associated with recognition and discrimination of natural sound textures
(Your Name) has sent you a message from PNAS
(Your Name) thought you would like to see the PNAS web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Distinct neural ensemble response statistics are associated with recognition and discrimination of natural sound textures
Xiu Zhai, Fatemeh Khatami, Mina Sadeghi, Fengrong He, Heather L. Read, Ian H. Stevenson, Monty A. Escabí
Proceedings of the National Academy of Sciences Dec 2020, 117 (49) 31482-31493; DOI: 10.1073/pnas.2005644117

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Request Permissions
Share
Distinct neural ensemble response statistics are associated with recognition and discrimination of natural sound textures
Xiu Zhai, Fatemeh Khatami, Mina Sadeghi, Fengrong He, Heather L. Read, Ian H. Stevenson, Monty A. Escabí
Proceedings of the National Academy of Sciences Dec 2020, 117 (49) 31482-31493; DOI: 10.1073/pnas.2005644117
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Mendeley logo Mendeley
Proceedings of the National Academy of Sciences: 117 (49)
Table of Contents

Submit

Sign up for Article Alerts

Article Classifications

  • Biological Sciences
  • Neuroscience

Jump to section

  • Article
    • Abstract
    • Results
    • Discussion
    • Methods
    • Data Availability.
    • Acknowledgments
    • Footnotes
    • References
  • Figures & SI
  • Info & Metrics
  • PDF

You May Also be Interested in

Abstract depiction of a guitar and musical note
Science & Culture: At the nexus of music and medicine, some see disease treatments
Although the evidence is still limited, a growing body of research suggests music may have beneficial effects for diseases such as Parkinson’s.
Image credit: Shutterstock/agsandrew.
Scientist looking at an electronic tablet
Opinion: Standardizing gene product nomenclature—a call to action
Biomedical communities and journals need to standardize nomenclature of gene products to enhance accuracy in scientific and public communication.
Image credit: Shutterstock/greenbutterfly.
One red and one yellow modeled protein structures
Journal Club: Study reveals evolutionary origins of fold-switching protein
Shapeshifting designs could have wide-ranging pharmaceutical and biomedical applications in coming years.
Image credit: Acacia Dishman/Medical College of Wisconsin.
White and blue bird
Hazards of ozone pollution to birds
Amanda Rodewald, Ivan Rudik, and Catherine Kling talk about the hazards of ozone pollution to birds.
Listen
Past PodcastsSubscribe
Goats standing in a pin
Transplantation of sperm-producing stem cells
CRISPR-Cas9 gene editing can improve the effectiveness of spermatogonial stem cell transplantation in mice and livestock, a study finds.
Image credit: Jon M. Oatley.

Similar Articles

Site Logo
Powered by HighWire
  • Submit Manuscript
  • Twitter
  • Facebook
  • RSS Feeds
  • Email Alerts

Articles

  • Current Issue
  • Latest Articles
  • Archive

PNAS Portals

  • Anthropology
  • Chemistry
  • Classics
  • Front Matter
  • Physics
  • Sustainability Science
  • Teaching Resources

Information

  • Authors
  • Editorial Board
  • Reviewers
  • Librarians
  • Press
  • Site Map
  • PNAS Updates

Feedback    Privacy/Legal

Copyright © 2021 National Academy of Sciences. Online ISSN 1091-6490