Skip to main content
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian
  • Log in
  • My Cart

Main menu

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Home
Home

Advanced Search

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses

New Research In

Physical Sciences

Featured Portals

  • Physics
  • Chemistry
  • Sustainability Science

Articles by Topic

  • Applied Mathematics
  • Applied Physical Sciences
  • Astronomy
  • Computer Sciences
  • Earth, Atmospheric, and Planetary Sciences
  • Engineering
  • Environmental Sciences
  • Mathematics
  • Statistics

Social Sciences

Featured Portals

  • Anthropology
  • Sustainability Science

Articles by Topic

  • Economic Sciences
  • Environmental Sciences
  • Political Sciences
  • Psychological and Cognitive Sciences
  • Social Sciences

Biological Sciences

Featured Portals

  • Sustainability Science

Articles by Topic

  • Agricultural Sciences
  • Anthropology
  • Applied Biological Sciences
  • Biochemistry
  • Biophysics and Computational Biology
  • Cell Biology
  • Developmental Biology
  • Ecology
  • Environmental Sciences
  • Evolution
  • Genetics
  • Immunology and Inflammation
  • Medical Sciences
  • Microbiology
  • Neuroscience
  • Pharmacology
  • Physiology
  • Plant Biology
  • Population Biology
  • Psychological and Cognitive Sciences
  • Sustainability Science
  • Systems Biology
Brief Report

Evidence from internet search data shows information-seeking responses to news of local COVID-19 cases

View ORCID ProfileAna I. Bento, View ORCID ProfileThuy Nguyen, Coady Wing, View ORCID ProfileFelipe Lozano-Rojas, View ORCID ProfileYong-Yeol Ahn, and Kosali Simon
PNAS May 26, 2020 117 (21) 11220-11222; first published May 4, 2020; https://doi.org/10.1073/pnas.2005335117
Ana I. Bento
aSchool of Public Health, Indiana University, Bloomington, IN 47405;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ana I. Bento
  • For correspondence: abento@iu.edu simonkos@iu.edu
Thuy Nguyen
bO’Neill School of Public and Environmental Affairs, Indiana University, Bloomington, IN 47405;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Thuy Nguyen
Coady Wing
bO’Neill School of Public and Environmental Affairs, Indiana University, Bloomington, IN 47405;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Felipe Lozano-Rojas
bO’Neill School of Public and Environmental Affairs, Indiana University, Bloomington, IN 47405;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Felipe Lozano-Rojas
Yong-Yeol Ahn
cLuddy School of Informatics, Computing and Engineering, Indiana University, Bloomington, IN 47408
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Yong-Yeol Ahn
Kosali Simon
bO’Neill School of Public and Environmental Affairs, Indiana University, Bloomington, IN 47405;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: abento@iu.edu simonkos@iu.edu
  1. Edited by Paul R. Milgrom, Stanford University, Stanford, CA, and approved April 24, 2020 (received for review March 23, 2020)

  • Article
  • Figures & SI
  • Info & Metrics
  • PDF
Loading

Abstract

The COVID-19 outbreak is a global pandemic with community circulation in many countries, including the United States, with confirmed cases in all states. The course of this pandemic will be shaped by how governments enact timely policies and disseminate information and by how the public reacts to policies and information. Here, we examine information-seeking responses to the first COVID-19 case public announcement in a state. Using an event study framework for all US states, we show that such news increases collective attention to the crisis right away. However, the elevated level of attention is short-lived, even though the initial announcements are followed by increasingly strong policy measures. Specifically, searches for “coronavirus” increased by about 36% (95% CI: 27 to 44%) on the day immediately after the first case announcement but decreased back to the baseline level in less than a week or two. We find that people respond to the first report of COVID-19 in their state by immediately seeking information about COVID-19, as measured by searches for coronavirus, coronavirus symptoms, and hand sanitizer. On the other hand, searches for information regarding community-level policies (e.g., quarantine, school closures, testing) or personal health strategies (e.g., masks, grocery delivery, over-the-counter medications) do not appear to be immediately triggered by first reports. These results are representative of the study period being relatively early in the epidemic, and more-elaborate policy responses were not yet part of the public discourse. Further analysis should track evolving patterns of responses to subsequent flows of public information.

  • COVID-19
  • Google Trends
  • information

The first confirmed case of novel coronavirus disease 2019 (COVID-19) in the United States occurred in Washington State on January 21, 2020. Since then, the virus has spread across the country (1, 2). There are confirmed cases in every state, and the vast majority are not connected to international travel (3), indicating that the virus had been circulating for several weeks before the first positive test (4, 5). Slowing the transmission of the virus will help reduce the burden of the disease, save lives, and reduce strain on the health care system (4, 6). In the absence of a vaccine, the main strategies for reducing transmission involve sanitation and handwashing, disciplined social distancing, quarantines, and school and workplace closures (6). These nonpharmaceutical interventions (NPIs) are effective and powerful ways to control transmission (7), as shown by earlier epidemics (8) and the steady decline of COVID-19 cases in China (2). To be successful, NPIs require people to undertake behavioral changes that may be personally costly. This is particularly true in countries with deeply rooted norms about personal freedom and reluctance to impose mandatory policies.

In settings where restrictions on the free movement of residents are less strictly enforced, it is especially critical for public officials to know whether and for how long statements from leaders motivate individuals to efficiently seek and absorb information, as officials put their communication strategies in place. Such coordinated actions are needed at the first signs of community spreading and cannot be guided through traditional polling methods, which take too long. Because the extent of the epidemic is likely to be underestimated at this stage, it is crucial to know how much the early case announcements induce heightened collective attention and information-seeking behavior.

To provide rapid evidence to inform policy making, we use internet search data in an event study design to examine how collective attention and information-seeking behaviors respond to state government announcements of first COVID-19 cases. We highlight changes in search patterns occurring in the days leading up to and following first case announcements in a state (1, 2).

Results

Fig. 1 depicts the event study estimates of the effects of initial announcements on overall coronavirus search. Searches for “coronavirus” increased by about 36% (95% CI: 27 to 44%) on the day immediately after the announcement but quickly decreased back to the baseline level in less than a week or two (Fig. 1). There was no observable trend in the search behavior in the days leading up to the announcements, suggesting the first “local” case indeed heightened the collective attention to the pandemic. However, the increased level of information seeking faded within 2 wk, even though many announcements of school closures or other mitigation strategies followed, suggesting that increased attention is only short-lived. This is consistent with no observable trend in the sense of urgency prior to the local announcement.

Fig. 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 1.

Time-varying effects of announcements of the first COVID-19 case in a state on searches for coronavirus. The period prior to the treatment (first confirmed case) is set as a reference: gray vertical bar. In red are the estimated coefficients (95% CI, gray band) in the Poisson model (differences in log-expected counts of search relative to the period prior to the event). The average search frequency of this term is 97,023.9 per state per day.

Fig. 2 shows the event studies of internet search for 1) symptoms and treatments, 2) hand sanitizer and diagnostic tests, 3) coordinated responses, and 4) narratives that undermine public responses. News of the first COVID-19 case in a state leads to a 52% increase in searches for “coronavirus symptoms” but does not increase searches for coronavirus treatment options. The second row shows searches for “hand sanitizer” increasing 35% immediately after first case announcements, and, unlike in the previous two cases, the search activity remains high for the remainder of the observable period. However, the announcements do not induce searches for nearby coronavirus testing opportunities, at least in the period under study. The third row suggests that first case announcements do not induce search for community-level policies (quarantines, school closures, and coronavirus testing) or more-elaborate personal health strategies (face masks, grocery delivery, over-the-counter medications). The final row examines how first case reports affect searches about the credibility of the epidemic. There is no indication that government confirmation of the first case increases or reduces searches for coronavirus hoaxes and overreactions; one might have expected official news to reduce concerns about false news.

Fig. 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 2.

Time-varying effects of announcements of the first COVID-19 case in a state on searches for 1) symptoms and treatments (red), 2) hand sanitizer and diagnostic tests (green), 3) coordinated responses (orange), and 4) narratives that undermine public responses (blue). Point estimated coefficients are the dotted lines (95% CI, gray band) in the Poisson models (differences in log-expected counts of search relative to the period prior to the event). Average search frequency per state per day for the terms: coronavirus symptoms (8,522.6), coronavirus treatment (448.2), hand sanitizer (3,214.7), testing near me (381.6), quarantine (2,158.2), isolation (631.2), coronavirus conspiracy (205.1), and coronavirus hoax (123.0).

Robustness Checks.

To investigate information spillovers in which states respond to epidemics in other states, we examined augmented models that controlled for the timing of the announcements of Washington, Illinois, California, and Arizona, as well as for the timing of the earliest announcement among a state’s neighbor states [section A of additional results at https://github.com/anabento/GoogleBehaviorCovid (9)]. The results show that COVID-19 searches responded to Washington’s first case (Dataset S1, column 2), to first case announcements in other states that occurred in January (Dataset S1, column 3), and to announcements in neighboring states (Dataset S1, column 4). These results indicate some spillovers, but the main conclusions regarding the effect of a state’s own first case remains. Each state may experience different treatment effects of the first COVID-19 cases on online searches. Therefore, we present single-state time series of search volumes in figure B-2 in additional results available at https://github.com/anabento/GoogleBehaviorCovid (9), to descriptively depict the treatment effect heterogeneity. The results suggest that information-seeking responses were larger and faster in late states compared to the early states. We checked whether the findings were driven by accessed date of the data by rerunning the analysis using the latest search output from Google Trends, which we retrieved on April 18, 2020 and compared to the current results using the data retrieved on March 20, 2020 [https://github.com/anabento/GoogleBehaviorCovid (9)]. These core results were not sensitive to this replication.

Conclusion

Our results suggest that first state COVID-19 case announcements do lead to a widespread increase in the extent to which people seek out information about the epidemic. We find that announcements of first cases have the biggest effect on searches for basic information about the virus and its symptoms, suggesting that people attempt to educate themselves about COVID-19 and its effects. However, first case reports do not lead to a differential increase in searches involving large-scale NPIs (e.g., school and workplace closures) that will likely have important consequences for everyday life. This may be because first cases are reported relatively early in the epidemic when many of these more serious mitigation strategies are not yet part of public discourse. Finally, although one might expect official news to reduce concerns related to false messages, we do not find much indication that state announcements of first COVID-19 cases affect searches questioning whether the epidemic may be a hoax. Overall, our analysis of internet search data suggests that government information disclosure does help focus public attention on the crisis. Our evidence also indicates that people seem to mainly react by seeking information on what they can and should do in response to the epidemic. One conjecture is that policy makers may be able to take advantage of a brief period of active information seeking following focal events (first cases and first deaths) to provide clear advice regarding the actions people can undertake to avoid risk.

Materials and Methods

Samples.

Our analysis is based on a balanced daily panel of COVID-19−related search intensity data in 50 US states and Washington, DC between January 1, 2020 and March 18, 2020 (n = 51 regions × 78 d). We collected the data using a restricted-access Google Health Trends Application Program Interface (API) account (10).

Measures.

The outcome variables measure the daily share of all Google queries in a state that correspond to a particular term during our study period. We multiply the shares by 10 million and round to the nearest integer to make the measure more interpretable. We collected data on the timing of the first COVID-19 case announcements from media reports in each state; see Dataset S1. All states reported their first case by March 17, 2020.

Data Analysis.

We estimated Poisson models in an event study (11) framework to examine the effect of the first COVID-19 case announcements on searches. In the model we use, the expected number of searches per 10 million isyi,t= e(β0+  ∑k=[−41,31]βk Announcementi,k +  θi+ θt+ εit),

where Announcementi,k is an indicator variable set to 1 if the first case of state i was announced k days ago. The reference category was 1 d prior to the first case announcement, and we created single indicators Announcementi,31, for any k≥30, and Announcementi,−41, for any k≤−40. We controlled for state fixed effects to allow for time-invariant differences in search patterns by state, and for date fixed effects to account for national trends. SEs allowed for heteroskedasticity and clustering at the state level. Poisson coefficients and CIs are shown for the 40 d leading up to the first case announcement, and up to 20 d following it. The vertical axis measures the differential percentage change in search frequency as states approach the first case announcement (Figs. 1 and 2). We performed regression analysis using Stata, version 16.0 (StataCorp).

Data and Code Availability.

State news data and code are available at https://github.com/anabento/GoogleBehaviorCovid (9). The search data for this study are available from Google Trends but are restricted in use; researchers may apply to Google Trends API for access.

Limitations

Although the eventual failure of Google Flu Trends suggests that building and maintaining a complex model for a long period of time is difficult (12, 13), internet search volume has been shown to be a good proxy for many socioeconomic behavioral indicators, such as automobile sales (14) or dietary patterns (9). This study has, indeed, several limitations. First, our state-level data from Google Trends database do not allow us to adequately understand intrastate variation of search volumes following the announcements or to generalize conclusions about population search behavior (as Google Trends only captures the search behavior of a particular segment of information seekers). Second, the major issues with search query data—long-term drift and representation bias across geographic regions—does not come into play in our study because we focus on responses in a short time window surrounding the government announcements. The third limitation comes from potential confounding factors in our event study framework, including anticipatory behavior and unobservable local events (15). We mitigate these concerns by controlling for the timing of the announcements of Washington, Illinois, California, and Arizona as well as for the timing of the earliest announcement among a state’s neighbor states, in several sensitivity analyses.

Acknowledgments

We thank Raj Thakkar and Chrislin Priscilla for research assistance.

Footnotes

  • ↵1To whom correspondence may be addressed. Email: abento{at}iu.edu or simonkos{at}iu.edu.
  • Author contributions: A.I.B., C.W., Y.-Y.A., and K.S. designed research; A.I.B., F.L.-R., and K.S. collected data; A.I.B., T.N., and K.S. analyzed data; and A.I.B., C.W., Y.-Y.A., and K.S. wrote the paper.

  • The authors declare no competing interest.

  • Data deposition: State news data and code are available on GitHub at https://github.com/anabento/GoogleBehaviorCovid.

  • This article contains supporting information online at https://www.pnas.org/lookup/suppl/doi:10.1073/pnas.2005335117/-/DCSupplemental.

  • Copyright © 2020 the Author(s). Published by PNAS.

This open access article is distributed under Creative Commons Attribution License 4.0 (CC BY).

View Abstract

References

  1. ↵
    1. Centers for Disease Control
    , COVID-19. https://www.cdc.gov/coronavirus/2019-ncov/index.html. Accessed 17 March 2020.
  2. ↵
    1. E. Dong,
    2. H. Du,
    3. L. Gardner
    , An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect. Dis. 3099, 19–20 (2020).
    OpenUrl
  3. ↵
    1. M. Chinazzi et al
    ., The effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak. Science 368, 395–400 (2020).
    OpenUrlAbstract/FREE Full Text
  4. ↵
    1. N. Narea
    , Coronavirus is already here. Blocking travelers won’t prevent its spread. Vox (2020). https://www.vox.com/2020/3/12/21176669/travel-ban-trump-coronavirus-china-italy-europe. Accessed 19 April 2020.
  5. ↵
    1. T. Bedford
    , Nextstrain: Genomic epidemiology of novel coronavirus (hCoV-19). https://nextstrain.org/ncov. Accessed 18 April 2020.
  6. ↵
    1. M. J. Keeling,
    2. P. Rohani
    , Modeling Infectious Diseases in Humans and Animals (Princeton University Press, 2007).
  7. ↵
    1. N. M. Ferguson et al
    ., “Impact of non-pharmaceutical interventions (NPIs) to reduce COVID-19 mortality and healthcare demand” (WHO Rep. 9, World Health Organization, 2020).
  8. ↵
    1. R. J. Hatchett,
    2. C. E. Mecher,
    3. M. Lipsitch
    , Public health interventions and epidemic intensity during the 1918 influenza pandemic. Proc. Natl. Acad. Sci. U.S.A. 104, 7582–7587 (2007).
    OpenUrlAbstract/FREE Full Text
  9. ↵
    1. A. Bento,
    2. K. Simon,
    3. T. Nguyen
    , Covid-19 GoogleTrends Project. GitHub. https://github.com/anabento/GoogleBehaviorCovid. Deposited Deposited 20 April 2020.
  10. ↵
    1. V. Lampos,
    2. B. Zou,
    3. I. J. Cox
    , “Enhancing feature selection using word embeddings: The case of flu surveillance” in WWW 17: 26th International World Wide Web Conference (Association for Computing Machinery, 2017), pp. 695–704.
  11. ↵
    1. R. Ball,
    2. P. Brown
    , An empirical evaluation of accounting income numbers. J. Account. Res. 6, 159–178 (1968).
    OpenUrl
  12. ↵
    1. D. Lazer,
    2. R. Kennedy,
    3. G. King,
    4. A. Vespignani
    , The parable of Google Flu: Traps in big data analysis. Science 343, 1203–1205 (2014).
    OpenUrlAbstract/FREE Full Text
  13. ↵
    1. H. Choi,
    2. H. Varian
    , Predicting the present with Google Trends. Econ. Rec. 88, 2–9 (2012).
    OpenUrlCrossRef
  14. ↵
    1. R. West,
    2. R. W. White,
    3. E. Horvitz
    , “From cookies to cooks: Insights on dietary patterns via analysis of Web usage logs” in WWW ’13: 22nd International Conference on the World Wide Web (Association for Computing Machinery, 2013), pp. 1399–1409.
  15. ↵
    1. C. Wing,
    2. K. Simon,
    3. R. A. Bello-Gomez
    , Designing difference in difference studies: Best practices for public health policy research. Annu. Rev. Public Health 39, 453–469 (2018).
    OpenUrlCrossRefPubMed
PreviousNext
Back to top
Article Alerts
Email Article

Thank you for your interest in spreading the word on PNAS.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Evidence from internet search data shows information-seeking responses to news of local COVID-19 cases
(Your Name) has sent you a message from PNAS
(Your Name) thought you would like to see the PNAS web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Evidence from internet search data shows information-seeking responses to news of local COVID-19 cases
Ana I. Bento, Thuy Nguyen, Coady Wing, Felipe Lozano-Rojas, Yong-Yeol Ahn, Kosali Simon
Proceedings of the National Academy of Sciences May 2020, 117 (21) 11220-11222; DOI: 10.1073/pnas.2005335117

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Request Permissions
Share
Evidence from internet search data shows information-seeking responses to news of local COVID-19 cases
Ana I. Bento, Thuy Nguyen, Coady Wing, Felipe Lozano-Rojas, Yong-Yeol Ahn, Kosali Simon
Proceedings of the National Academy of Sciences May 2020, 117 (21) 11220-11222; DOI: 10.1073/pnas.2005335117
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Mendeley logo Mendeley
Proceedings of the National Academy of Sciences: 117 (21)
Table of Contents

Submit

Sign up for Article Alerts

Article Classifications

  • Social Sciences
  • Economic Sciences

Jump to section

  • Article
    • Abstract
    • Results
    • Conclusion
    • Materials and Methods
    • Limitations
    • Acknowledgments
    • Footnotes
    • References
  • Figures & SI
  • Info & Metrics
  • PDF

You May Also be Interested in

Abstract depiction of a guitar and musical note
Science & Culture: At the nexus of music and medicine, some see disease treatments
Although the evidence is still limited, a growing body of research suggests music may have beneficial effects for diseases such as Parkinson’s.
Image credit: Shutterstock/agsandrew.
Large piece of gold
News Feature: Tracing gold's cosmic origins
Astronomers thought they’d finally figured out where gold and other heavy elements in the universe came from. In light of recent results, they’re not so sure.
Image credit: Science Source/Tom McHugh.
Dancers in red dresses
Journal Club: Friends appear to share patterns of brain activity
Researchers are still trying to understand what causes this strong correlation between neural and social networks.
Image credit: Shutterstock/Yeongsik Im.
White and blue bird
Hazards of ozone pollution to birds
Amanda Rodewald, Ivan Rudik, and Catherine Kling talk about the hazards of ozone pollution to birds.
Listen
Past PodcastsSubscribe
Goats standing in a pin
Transplantation of sperm-producing stem cells
CRISPR-Cas9 gene editing can improve the effectiveness of spermatogonial stem cell transplantation in mice and livestock, a study finds.
Image credit: Jon M. Oatley.

Similar Articles

Site Logo
Powered by HighWire
  • Submit Manuscript
  • Twitter
  • Facebook
  • RSS Feeds
  • Email Alerts

Articles

  • Current Issue
  • Special Feature Articles – Most Recent
  • List of Issues

PNAS Portals

  • Anthropology
  • Chemistry
  • Classics
  • Front Matter
  • Physics
  • Sustainability Science
  • Teaching Resources

Information

  • Authors
  • Editorial Board
  • Reviewers
  • Librarians
  • Press
  • Site Map
  • PNAS Updates

Feedback    Privacy/Legal

Copyright © 2021 National Academy of Sciences. Online ISSN 1091-6490