Skip to main content

Main menu

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Home
Home
  • Log in
  • My Cart

Advanced Search

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
Research Article

Discovering multiscale and self-similar structure with data-driven wavelets

View ORCID ProfileDaniel Floryan and View ORCID ProfileMichael D. Graham
  1. aDepartment of Chemical and Biological Engineering, University of Wisconsin–Madison, Madison, WI 53706

See allHide authors and affiliations

PNAS January 5, 2021 118 (1) e2021299118; https://doi.org/10.1073/pnas.2021299118
Daniel Floryan
aDepartment of Chemical and Biological Engineering, University of Wisconsin–Madison, Madison, WI 53706
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Daniel Floryan
Michael D. Graham
aDepartment of Chemical and Biological Engineering, University of Wisconsin–Madison, Madison, WI 53706
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Michael D. Graham
  • For correspondence: mdgraham@wisc.edu
  1. Edited by David A. Weitz, Harvard University, Cambridge, MA, and approved November 21, 2020 (received for review October 12, 2020)

  • Article
  • Figures & SI
  • Info & Metrics
  • PDF
Loading

Significance

Multiscale structure is all around us: in biological tissues, active matter, oceans, networks, and images. Identifying the multiscale features of these systems is crucial to our understanding and control of them. We introduce a method that rationally extracts localized multiscale features from data, which may be thought of as the building blocks of the underlying phenomena.

Abstract

Many materials, processes, and structures in science and engineering have important features at multiple scales of time and/or space; examples include biological tissues, active matter, oceans, networks, and images. Explicitly extracting, describing, and defining such features are difficult tasks, at least in part because each system has a unique set of features. Here, we introduce an analysis method that, given a set of observations, discovers an energetic hierarchy of structures localized in scale and space. We call the resulting basis vectors a “data-driven wavelet decomposition.” We show that this decomposition reflects the inherent structure of the dataset it acts on, whether it has no structure, structure dominated by a single scale, or structure on a hierarchy of scales. In particular, when applied to turbulence—a high-dimensional, nonlinear, multiscale process—the method reveals self-similar structure over a wide range of spatial scales, providing direct, model-free evidence for a century-old phenomenological picture of turbulence. This approach is a starting point for the characterization of localized hierarchical structures in multiscale systems, which we may think of as the building blocks of these systems.

  • wavelet
  • multiscale
  • data-driven decomposition
  • machine learning
  • turbulence

Footnotes

  • ↵1To whom correspondence may be addressed. Email: mdgraham{at}wisc.edu.
  • Author contributions: D.F. and M.D.G. designed research, performed research, analyzed data, and wrote the paper.

  • The authors declare no competing interest.

  • This article is a PNAS Direct Submission.

  • This article contains supporting information online at https://www.pnas.org/lookup/suppl/doi:10.1073/pnas.2021299118/-/DCSupplemental.

Data Availability.

Simulation data and code have been deposited in GitHub, available at https://github.com/dfloryan/DDWD.

Published under the PNAS license.

View Full Text

References

  1. ↵
    1. W. K. M. Lau,
    2. D. E. Waliser
    , Intraseasonal Variability in the Atmosphere-Ocean Climate System (Springer Science & Business Media, 2011).
  2. ↵
    1. P. F. J. Lermusiaux et al.
    , Multiscale modeling of coastal, shelf, and global ocean dynamics. Ocean Dyn. 63, 1341–1344 (2013).
    OpenUrl
  3. ↵
    1. Y. Y. Ahn,
    2. J. P. Bagrow,
    3. S. Lehmann
    , Link communities reveal multiscale complexity in networks. Nature 466, 761–764 (2010).
    OpenUrlCrossRefPubMed
  4. ↵
    1. S. Bradshaw,
    2. P. N. Howard
    , “Challenging truth and trust: A global inventory of organized social media manipulation” (Computational Propaganda Research Project, University of Oxford, Oxford, 2018).
  5. ↵
    1. I. Marusic,
    2. J. P. Monty
    , Attached eddy model of wall turbulence. Annu. Rev. Fluid Mech. 51, 49–74 (2019).
    OpenUrl
  6. ↵
    1. P. Sagaut,
    2. C. Cambon
    , Homogeneous Turbulence Dynamics (Springer International Publishing, Cham, Switzerland, 2018).
  7. ↵
    1. E. Perlman,
    2. R. Burns,
    3. Y. Li,
    4. C. Meneveau
    , “Data exploration of turbulence simulations using a database cluster” in Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (ACM, 2007), pp. 1–11.
  8. ↵
    1. Y. Li et al.
    , A public turbulence database cluster and applications to study Lagrangian evolution of velocity increments in turbulence. J. Turbul. 9, N31 (2008).
    OpenUrl
  9. ↵
    1. P. K. Yeung,
    2. D. A. Donzis,
    3. K. R. Sreenivasan
    , Dissipation, enstrophy and pressure statistics in turbulence simulations at high Reynolds numbers. J. Fluid Mech. 700, 5–15 (2012).
    OpenUrl
  10. ↵
    1. P. K. Yeung, et al.
    , Forced isotropic turbulence dataset on 40963 grid. Johns Hopkins Turbulence Databases. https://doi.org/10.7281/T1DN4363. Accessed 8 July 2020.
  11. ↵
    1. M. Farge
    , Wavelet transforms and their applications to turbulence. Annu. Rev. Fluid Mech. 24, 395–458 (1992).
    OpenUrlCrossRef
  12. ↵
    1. P. Holmes,
    2. J. L. Lumley,
    3. G. Berkooz,
    4. C. W. Rowley
    , Turbulence, Coherent Structures, Dynamical Systems and Symmetry, (Cambridge University Press, Cambridge, UK, ed. 2, 2012).
  13. ↵
    1. K. Taira et al.
    , Modal analysis of fluid flows: An overview. AIAA J. 55, 4013–4041 (2017).
    OpenUrl
  14. ↵
    1. L. H. O. Hellström,
    2. I. Marusic,
    3. A. J. Smits
    , Self-similarity of the large-scale motions in turbulent pipe flow. J. Fluid Mech. 792, R1–R12 (2016).
    OpenUrl
  15. ↵
    1. G. Strang
    , Wavelets and dilation equations – A brief introduction. SIAM Rev. 31, 614–627 (1989).
    OpenUrl
  16. ↵
    1. I. Daubechies
    , Ten Lectures on Wavelets (SIAM, 1992).
  17. ↵
    1. Y. Meyer
    , Wavelets and Operators: Volume 1 (Cambridge University Press, 1992), vol. 37.
  18. ↵
    1. S. Mallat
    , A Wavelet Tour of Signal Processing (Elsevier, 1999).
  19. ↵
    1. M. W. Frazier
    , An Introduction to Wavelets Through Linear Algebra (Springer Science & Business Media, 2006).
  20. ↵
    1. F. Argoul et al.
    , Wavelet analysis of turbulence reveals the multifractal nature of the Richardson cascade. Nature 338, 51–53 (1989).
    OpenUrlCrossRef
  21. ↵
    1. R. Everson,
    2. L. Sirovich,
    3. K. R. Sreenivasan
    , Wavelet analysis of the turbulent jet. Phys. Lett. 145, 314–322 (1990).
    OpenUrlCrossRef
  22. ↵
    1. M. Farge,
    2. G. Pellegrino,
    3. K. Schneider
    , Coherent vortex extraction in 3D turbulent flows using orthogonal wavelets. Phys. Rev. Lett. 87, 054501 (2001).
    OpenUrlCrossRefPubMed
  23. ↵
    1. M. Farge,
    2. K. Schneider,
    3. G. Pellegrino,
    4. A. A. Wray,
    5. R. S. Rogallo
    , Coherent vortex extraction in three-dimensional homogeneous turbulence: Comparison between CVS-wavelet and POD-Fourier decompositions. Phys. Fluids 15, 2886–2896 (2003).
    OpenUrlCrossRef
  24. ↵
    1. N. Okamoto,
    2. K. Yoshimatsu,
    3. K. Schneider,
    4. M. Farge,
    5. Y. Kaneda
    , Coherent vortices in high resolution direct numerical simulation of homogeneous isotropic turbulence: A wavelet viewpoint. Phys. Fluids 19, 115109 (2007).
    OpenUrl
  25. ↵
    1. J. Ruppert-Felsot,
    2. M. Farge,
    3. P. Petitjeans
    , Wavelet tools to study intermittency: Application to vortex bursting. J. Fluid Mech. 636, 427–453 (2009).
    OpenUrl
  26. ↵
    1. M. Yamada,
    2. K. Ohkitani
    , An identification of energy cascade in turbulence by orthonormal wavelet analysis. Prog. Theor. Phys. 86, 799–815 (1991).
    OpenUrlCrossRef
  27. ↵
    1. C. Meneveau
    , Analysis of turbulence in the orthonormal wavelet representation. J. Fluid Mech. 232, 469–520 (1991).
    OpenUrl
  28. ↵
    1. J. Gilles
    , Empirical wavelet transform. IEEE Trans. Signal Process. 61, 3999–4010 (2013).
    OpenUrlCrossRef
  29. ↵
    1. R. A. Gopinath,
    2. J. E. Odegard,
    3. C. S. Burrus
    , Optimal wavelet representation of signals and the wavelet sampling theorem. IEEE Trans. Circuit. Syst. II Analog Digit. Signal Process. 41, 262–277 (1994).
    OpenUrl
  30. ↵
    1. U. Grasemann,
    2. R. Miikkulainen
    , Evolving wavelets using a coevolutionary genetic algorithm and lifting. Lect. Notes Comput. Sci. 3103, 969–980 (2004).
    OpenUrl
  31. ↵
    1. M. A. Mendez,
    2. M. Balabane,
    3. J. M. Buchlin
    , Multi-scale proper orthogonal decomposition of complex fluid flows. J. Fluid Mech. 870, 988–1036 (2019).
    OpenUrl
  32. ↵
    1. B. Ophir,
    2. M. Lustig,
    3. M. Elad
    , Multi-scale dictionary learning using wavelets. IEEE J. Select. Topics Signal Process. 5, 1014–1024 (2011).
    OpenUrl
  33. ↵
    1. D. Recoskie,
    2. R. Mann
    , Learning sparse wavelet representations. arXiv:1802.02961 (8 February 2018).
  34. ↵
    1. D. Recoskie,
    2. R. Mann
    , “Learning filters for the 2D wavelet transform” in 2018 15th Conference on Computer and Robot Vision (CRV) (IEEE, 2018), pp. 198–205.
  35. ↵
    1. D. Recoskie,
    2. R. Mann
    , Gradient-based filter design for the dual-tree wavelet transform. arXiv:1806.01793 (4 June 2018).
  36. ↵
    1. A. Søgaard
    , Learning optimal wavelet bases using a neural network approach. arXiv:1706.03041 (25 March 2017).
  37. ↵
    1. A. H. Tewfik,
    2. D. Sinha,
    3. P. Jorgensen
    , On the optimal choice of a wavelet for signal representation. IEEE Trans. Inf. Theor. 38, 747–765 (1992).
    OpenUrl
  38. ↵
    1. H. H. Szu
    1. Y. Zhuang,
    2. J. S. Baras
    , “Optimal wavelet basis selection for signal representation” in Wavelet Applications, H. H. Szu, Ed. (International Society for Optics and Photonics, 1994), vol. 2242, pp. 200–211.
    OpenUrl
  39. ↵
    1. I. Goodfellow,
    2. Y. Bengio,
    3. A. Courville
    , Deep Learning (MIT Press, 2016).
  40. ↵
    1. Y. Hwang
    , Statistical structure of self-sustaining attached eddies in turbulent channel flow. J. Fluid Mech. 767, 254–289 (2015).
    OpenUrl
  41. ↵
    1. D. K. Hammond,
    2. P. Vandergheynst,
    3. R. Gribonval
    , Wavelets on graphs via spectral graph theory. Appl. Comput. Harmon. Anal. 30, 129–150 (2011).
    OpenUrl

Log in using your username and password

Forgot your user name or password?

Log in through your institution

You may be able to gain access using your login credentials for your institution. Contact your library if you do not have a username and password.
If your organization uses OpenAthens, you can log in using your OpenAthens username and password. To check if your institution is supported, please see this list. Contact your library for more details.

Purchase access

You may purchase access to this article. This will require you to create an account if you don't already have one.

Subscribers, for more details, please visit our Subscriptions FAQ.

Please click here to log into the PNAS submission website.

PreviousNext
Back to top
Article Alerts
Email Article

Thank you for your interest in spreading the word on PNAS.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Discovering multiscale and self-similar structure with data-driven wavelets
(Your Name) has sent you a message from PNAS
(Your Name) thought you would like to see the PNAS web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Discovering multiscale and self-similar structure with data-driven wavelets
Daniel Floryan, Michael D. Graham
Proceedings of the National Academy of Sciences Jan 2021, 118 (1) e2021299118; DOI: 10.1073/pnas.2021299118

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Request Permissions
Share
Discovering multiscale and self-similar structure with data-driven wavelets
Daniel Floryan, Michael D. Graham
Proceedings of the National Academy of Sciences Jan 2021, 118 (1) e2021299118; DOI: 10.1073/pnas.2021299118
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Mendeley logo Mendeley

Article Classifications

  • Physical Sciences
  • Applied Physical Sciences
Proceedings of the National Academy of Sciences: 118 (1)
Table of Contents

Submit

Sign up for Article Alerts

Jump to section

  • Article
    • Abstract
    • Formulation
    • Results
    • Conclusions
    • Data Availability.
    • Acknowledgments
    • Footnotes
    • References
  • Figures & SI
  • Info & Metrics
  • PDF

You May Also be Interested in

Surgeons hands during surgery
Inner Workings: Advances in infectious disease treatment promise to expand the pool of donor organs
Despite myriad challenges, clinicians see room for progress.
Image credit: Shutterstock/David Tadevosian.
Setting sun over a sun-baked dirt landscape
Core Concept: Popular integrated assessment climate policy models have key caveats
Better explicating the strengths and shortcomings of these models will help refine projections and improve transparency in the years ahead.
Image credit: Witsawat.S.
Double helix
Journal Club: Noncoding DNA shown to underlie function, cause limb malformations
Using CRISPR, researchers showed that a region some used to label “junk DNA” has a major role in a rare genetic disorder.
Image credit: Nathan Devery.
Steamboat Geyser eruption.
Eruption of Steamboat Geyser
Mara Reed and Michael Manga explore why Yellowstone's Steamboat Geyser resumed erupting in 2018.
Listen
Past PodcastsSubscribe
Birds nestling on tree branches
Parent–offspring conflict in songbird fledging
Some songbird parents might improve their own fitness by manipulating their offspring into leaving the nest early, at the cost of fledgling survival, a study finds.
Image credit: Gil Eckrich (photographer).

Similar Articles

Site Logo
Powered by HighWire
  • Submit Manuscript
  • Twitter
  • Facebook
  • RSS Feeds
  • Email Alerts

Articles

  • Current Issue
  • Special Feature Articles – Most Recent
  • List of Issues

PNAS Portals

  • Anthropology
  • Chemistry
  • Classics
  • Front Matter
  • Physics
  • Sustainability Science
  • Teaching Resources

Information

  • Authors
  • Editorial Board
  • Reviewers
  • Librarians
  • Press
  • Site Map
  • PNAS Updates

Feedback    Privacy/Legal

Copyright © 2021 National Academy of Sciences. Online ISSN 1091-6490