Skip to main content
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian
  • Log in
  • My Cart

Main menu

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses
  • Submit
  • About
    • Editorial Board
    • PNAS Staff
    • FAQ
    • Accessibility Statement
    • Rights and Permissions
    • Site Map
  • Contact
  • Journal Club
  • Subscribe
    • Subscription Rates
    • Subscriptions FAQ
    • Open Access
    • Recommend PNAS to Your Librarian

User menu

  • Log in
  • My Cart

Search

  • Advanced search
Home
Home

Advanced Search

  • Home
  • Articles
    • Current
    • Special Feature Articles - Most Recent
    • Special Features
    • Colloquia
    • Collected Articles
    • PNAS Classics
    • List of Issues
  • Front Matter
  • News
    • For the Press
    • This Week In PNAS
    • PNAS in the News
  • Podcasts
  • Authors
    • Information for Authors
    • Editorial and Journal Policies
    • Submission Procedures
    • Fees and Licenses

New Research In

Physical Sciences

Featured Portals

  • Physics
  • Chemistry
  • Sustainability Science

Articles by Topic

  • Applied Mathematics
  • Applied Physical Sciences
  • Astronomy
  • Computer Sciences
  • Earth, Atmospheric, and Planetary Sciences
  • Engineering
  • Environmental Sciences
  • Mathematics
  • Statistics

Social Sciences

Featured Portals

  • Anthropology
  • Sustainability Science

Articles by Topic

  • Economic Sciences
  • Environmental Sciences
  • Political Sciences
  • Psychological and Cognitive Sciences
  • Social Sciences

Biological Sciences

Featured Portals

  • Sustainability Science

Articles by Topic

  • Agricultural Sciences
  • Anthropology
  • Applied Biological Sciences
  • Biochemistry
  • Biophysics and Computational Biology
  • Cell Biology
  • Developmental Biology
  • Ecology
  • Environmental Sciences
  • Evolution
  • Genetics
  • Immunology and Inflammation
  • Medical Sciences
  • Microbiology
  • Neuroscience
  • Pharmacology
  • Physiology
  • Plant Biology
  • Population Biology
  • Psychological and Cognitive Sciences
  • Sustainability Science
  • Systems Biology
Research Article

Distress and rumor exposure on social media during a campus lockdown

Nickolas M. Jones, Rebecca R. Thompson, Christine Dunkel Schetter, and View ORCID ProfileRoxane Cohen Silver
PNAS October 31, 2017 114 (44) 11663-11668; first published October 17, 2017; https://doi.org/10.1073/pnas.1708518114
Nickolas M. Jones
aDepartment of Psychology and Social Behavior, University of California, Irvine, CA 92697-7085;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rebecca R. Thompson
aDepartment of Psychology and Social Behavior, University of California, Irvine, CA 92697-7085;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christine Dunkel Schetter
bDepartment of Psychology, University of California, Los Angeles, CA 90095-1563;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Roxane Cohen Silver
aDepartment of Psychology and Social Behavior, University of California, Irvine, CA 92697-7085;
cDepartment of Medicine, University of California, Irvine, CA 92697;
dProgram in Public Health, University of California, Irvine, CA 92697
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Roxane Cohen Silver
  • For correspondence: rsilver@uci.edu
  1. Edited by Susan T. Fiske, Princeton University, Princeton, NJ, and approved September 25, 2017 (received for review June 2, 2017)

  • Article
  • Figures & SI
  • Info & Metrics
  • PDF
Loading

Significance

During active shooter events when danger is imminent and official information is disseminated inconsistently, ambiguity is high. In these situations, individuals may seek information from unofficial channels (e.g., social media), thereby exposing themselves to unverified information and rumors. In a study of students caught in a university-wide lockdown, we found that those who relied on social media for updates reported increased exposure to conflicting information. Moreover, those who trusted what they read reported greater distress. Then, using a big-data analysis of Twitter data spanning ∼5 hours surrounding the event, we demonstrated that rumor transmission tracks with community-level negative emotion during gaps in official communication. Officials should monitor social media channels to mitigate the negative impact of rumors during collective traumas.

Abstract

During crisis events, people often seek out event-related information to stay informed of what is happening. However, when information from official channels is lacking or disseminated irregularly, people may be at risk for exposure to rumors that fill the information void. We studied information-seeking during a university lockdown following an active-shooter event. In study 1, students in the lockdown (n = 3,890) completed anonymous surveys 1 week later. Those who indicated receiving conflicting information about the lockdown reported greater acute stress [standardized regression coefficient (b) = 0.07; SE = 0.01; 95% confidence interval (CI), 0.04, 0.10]. Additionally, those who reported direct contact with close others via text message (or phone) and used Twitter for critical updates during the lockdown were exposed to more conflicting information. Higher acute stress was reported by heavy social media users who trusted social media for critical updates (b = 0.06, SE = 0.01; 95% CI, 0.03, 0.10). In study 2, we employed a big data approach to explore the time course of rumor transmission across 5 hours surrounding the lockdown within a subset of the university’s Twitter followers. We also examined the patterning of distress in the hours during the lockdown as rumors about what was happening (e.g., presence of multiple shooters) spread among Twitter users. During periods without updates from official channels, rumors and distress increased. Results highlight the importance of releasing substantive updates at regular intervals during a crisis event and monitoring social media for rumors to mitigate rumor exposure and distress.

  • rumor
  • crisis event
  • Twitter
  • lockdown
  • social media

Since 2000, active shooter events in the United States have been on the rise and often result in higher casualty counts when they occur in educational institutions compared with other settings (1). Crisis events like these are often accompanied by deficits of credible information as authorities attempt to piece together the facts of the unfolding events. As a consequence, individuals caught in the wake of the crisis are left vulnerable to rumors and conflicting information from unofficial communication channels they trust. Despite a robust scientific literature on the circumstances in which rumors are generated (2⇓–4) and transmitted (5, 6), little is known about the psychological correlates of exposure to rumors during crisis events. When rumors proliferate during dangerous and uncertain situations, what impact do they have on people who receive and believe them?

Crisis events are often ambiguous in nature, and when uncertainty is high, appraisals of threat among individuals caught in their path can be heightened (7). This, in turn, may instigate information-seeking behavior as a way of reducing situational uncertainty (8, 9) and consequently the psychological distress such uncertainty engenders (10). In the past, this information seeking led people to their radios and televisions to acquire critical updates from official channels. However, when a crisis unfolds, people now increasingly acquire critical updates from social media (e.g., Twitter; refs. 11⇓⇓⇓–15), along with traditional media channels (16).

Moreover, when information from official channels is irregular or lacks new information, uncertainty and information-seeking behavior are likely sustained. As a result, people may also turn to unofficial channels, such as social media, to mitigate their discomfort. The challenge with social media as a resource for updates, however, is the lack of mechanisms for vetting the accuracy of the information being shared among users. This is particularly important because, as the rumor literature suggests, trust in an information source moderates whether rumors are believed and transmitted (17). In addition, once rumors begin to spread on social media, they are very difficult to undermine with updates or corrections (6).

What people see when they are exposed to media-based coverage of a crisis event has been studied previously in the context of collective traumas, such as terrorist attacks and natural disasters that affect many people and occur without warning (16). Large studies of representative US samples demonstrate that, among other variables, repeated indirect, media-based exposure to collective traumas is associated with event-related distress, even when controlling for pretrauma media habits and preexisting mental health conditions (18, 19). For example, in a study following the Boston Marathon bombings (BMB), researchers found that 6 or more hours of BMB-related media use was associated with higher acute stress than was direct exposure to the bombings (18). This relationship is thought to be at least partly driven by the transmission of graphic, event-related imagery via news coverage (16, 20). However, when images are not relevant or available, other content, like rumors or conflicting information, may also contribute to the distress individuals experience during a crisis.

We explored the role of rumors in two studies of a single university shooting, using multiple methods to characterize the community’s response. In study 1, we examined psychological distress and correlates of communication-channel use among 3,890 students at a major university in the United States who were under a protracted lockdown (∼2 hours) during an active shooter event in which critical updates from officials were infrequent. In study 2, we employed a big data approach to explore the time course of rumor transmission and patterning of distress during the lockdown.

Study 1

Data were collected using a Qualtrics survey software link emailed on the researchers’ behalf by the university administration to all enrolled students 7 days after the shooting. Students reported their distress about the lockdown by responding to items on a standardized multi-item measure of acute stress (21). Respondents also indicated the communication channels from which they acquired information and critical updates during the lockdown, including direct contact from close others (e.g., phone calls and texts from friends and/or family), traditional media (e.g., radio, television, online news), and social media (e.g., Twitter, Facebook, Snapchat, Reddit, Instagram). For every communication channel students used, they reported how much they trusted it for critical updates about the shooting and lockdown. To capture exposure to rumors during the lockdown, students reported the overall extent to which they received conflicting information about the details of the lockdown across all communication channels they used.

Results indicated that exposure to conflicting information was associated with acute stress related to the lockdown, after controlling for several relevant covariates (Table 1). Traditional media use was not associated with acute stress, but direct contact with close others and social media use were each associated with greater acute stress. We then examined whether trust in these communication channels moderated their respective relations with distress. No moderating effect was found for trust in direct contact with close others. However, greater acute stress was reported by heavy social media users who trusted social media for critical updates (Fig. 1). In addition, students who acquired critical updates via text messages from close others or via Twitter reported increased exposure to conflicting information compared to those who did not rely on these channels (Table 2).

View this table:
  • View inline
  • View popup
Table 1.

Correlates of acute stress among students in the lockdown

Fig. 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 1.

Association between count of social media channels used during the lockdown and acute stress, moderated by level of trust in social media.

View this table:
  • View inline
  • View popup
Table 2.

Communication channels students consulted during the lockdown and their independent associations with exposure to conflicting information (n = 3,393)

Study 2

Because students in this first study who used Twitter reported increased exposure to conflicting information, in study 2 we examined the time course of community-level rumor generation and virality (i.e., degree to which rumors were circulated) among a subset of Twitter users who followed two official university Twitter accounts. Using R (22), we connected to Twitter via its Application Programming Interface (API) on the day of the lockdown and downloaded a list of the most recent 13,000 public followers of the university’s primary and emergency response Twitter accounts. Two weeks later, we downloaded the most recent 200 tweets from each follower. Because tweets were time-stamped, we constrained our analysis to tweets generated in the hour leading up to the initial 911 call until the second hour after the lockdown was lifted, segmenting time into 15-min blocks. Each tweet in this frame was tagged if it contained a rumor, defined as a statement verified to be blatantly false following the incident. To capture community-level distress about the lockdown, we devised an R script to automatically tag tweets referencing the lockdown incident (for a similar method, see ref. 23) and those containing negative emotion words using the Linguistic Inquiry and Word Counter (LIWC) negative emotion dictionary (24). For example, tweets about the lockdown that also contained words such as “distress” or “afraid” were tagged to reflect event-related negative emotions. Tagging tweets in this way allowed us to calculate a count of rumor tweets, as well as calculate the proportion of tweets with event-related negative emotions in each 15-min segment over time. We then overlaid the official campus alerts sent to all university students during the same time frame (Table S1).

View this table:
  • View inline
  • View popup
Table S1.

Official alerts sent via text message and Twitter during the lockdown

Within the corpus of tweets generated around the lockdown time frame (Fig. 2), 38 rumors were identified (Mretweet count = 179, SD = 427; min = 0, max = 2,299). Viral rumors (i.e., those retweeted most frequently) involved descriptions of a nonexistent white male suspect and his movements. Other rumors involved claims of multiple deaths and warnings of multiple shooters at several locations on campus (Table 3). As depicted in Fig. 2, the bulk of rumors were generated during the 90-min gap in communication from campus officials after the first lockdown alert and continued consistently until a second campus alert was disseminated to remind students about the lockdown. Although the number of rumors decreased after the second alert, the virality of the few rumors that were generated in the time block after a third alert (again regarding the lockdown) far exceeded any rumor tweet in the preceding blocks (Fig. 3). It is not clear why the rumors in this block went viral, but it might have been due to more people becoming aware of the situation and wanting to pass information on to others. Although we cannot directly link them together, event-related negative emotions tracked almost identically with rumor virality consistently across time (Fig. 3). These findings suggest that the virality of rumors may be implicated in the transmission of distress during a crisis.

Fig. 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 2.

Time course of rumor generation, event-related negative emotions, and campus alerts in the hours before, during, and after the lockdown.

View this table:
  • View inline
  • View popup
Table 3.

Example rumors and their virality

Fig. 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
Fig. 3.

Time course of rumor virality, event-related negative emotions, and campus alerts in the hours before, during, and after the lockdown.

Discussion

Prior research on rumors demonstrates that situational ambiguity, high importance, and anxiety are necessary conditions for rumor generation (2⇓–4). Consistent with this work, our findings indicate that during crisis events, when critical updates from official channels are irregular, rumors proliferate. Individuals who are caught in the path of a crisis event are often left feeling helpless and without situational control (25), which can lead people to see patterns in the information obtained that are not present (e.g., via illusory pattern perception; ref. 26). In addition, situational stress may interfere with information processing via inhibited executive functioning (e.g., working memory, self-regulation processes; ref. 27). Taken together, these effects may diminish the myriad cognitive processes necessary for scrutinizing the veracity of unique and repeated information (28), such as content propagated on social media platforms during a crisis. This causal chain likely plays a role in increasing the potency of rumor exposure during potentially threatening and ambiguous crisis situations.

To mitigate this problem, we offer several recommendations. First, emergency officials should disseminate frequent updates to the affected population, in real time. In the context of a school shooting, repeated alerts have been found to increase the perception of urgency among participants who received them (29), a factor necessary for eliciting swift and appropriate action. Although we cannot explicitly test whether more frequent updates from official channels would have mitigated rumors and distress using the data we collected, crisis communication scholars posit that regular communications from emergency management officials are essential for mitigating uncertainty and rumors after a crisis (30). For example, as part of their response to a mass shooting at a shopping mall in Munich, Germany, local police urged the public via press conferences and social media to resist speculation about the attack and directly addressed rumors on social media as they became aware of them (31). Despite false reports of additional shootings in the city and the overall lack of clarity about what was happening during the citywide lockdown, police chose to maintain transparency and constant contact with the public throughout the ordeal, a strategy likely appreciated by the public (32). Had the Munich police remained silent, however, the budding rumors about shootings in other city locations would have likely filled the information void. As communities learn to manage active shooter crises and other emergencies, crisis communications like those employed by the Munich police department will be prudent to put in place.

Second, critical updates disseminated to the public should include new information, when possible. However, when new information is not available, updates should be tailored to reduce situational uncertainty (33), thereby mitigating distress and rumors (30). Additionally, emergency management officials should attempt to counter the impact of rumors that arise during crisis situations by monitoring social media channels and encouraging individuals to keep a healthy skepticism about information coming from unofficial channels.

Furthermore, we believe the news media, which play a critical role in informing the public during crisis events (30), must share the responsibility for disseminating accurate information. The importance of this point is illustrated by the examples of conspiracy theories propagated on social media (and other channels) that resonate with individuals psychologically attuned to alternative narratives (34). Although seemingly benign, conspiracy theories can lead people to deny that acts of horror, like the 9/11 terrorist attacks and the Sandy Hook Elementary School massacre, occurred at all. Consequently, denial narratives born from inconsistencies in news reporting can directly and negatively impact the individuals in communities devastated by these events (35).

Although we examined the correlates of unofficial communication-channel use in our analyses in study 1, we acknowledge the important role of official channel use during a crisis. Unfortunately, because 96% of respondents in our sample indicated consulting official channels, and roughly 92% indicated trusting these channels somewhat or strongly, the lack of variation precluded our ability to include these variables in our statistical models. Also, we are unable to determine whether participants actively sought—or were passively exposed to—information from different channels. During the lockdown, participants may have sought information (especially during the 90-min gap in communication from campus officials) by accessing news sites and social media, or they might have sent text messages to friends and family to see if they knew any details. However, students could have simultaneously received unsolicited messages via social media or text during this event, in which case their receipt of information could be considered passive. An additional limitation of study 1 was that data collection occurred retrospectively (albeit soon after the event), and we did not employ real-time data collection methods during the lockdown (e.g., ecological momentary assessment), which would have been valuable for assessing exposure to conflicting information and distress responses. To compensate for this, we collected archival Twitter data—before, during, and after the lockdown—from thousands of users in study 2, providing supplemental data that occurred in real time. This supplemental analysis of Twitter data fostered additional depth to our understanding of the crisis event we studied.

Conclusion

Exposure to rumors and conflicting information that arise out of the ambiguity of a crisis may have negative consequences for the people who receive and believe them. Moreover, the extent to which people trust the channels through which unofficial and conflicting information flow may exacerbate distress. Rumor generation during ambiguous crisis events is certain to continue. Therefore, social scientists should study the psychological impact of rumor exposure using methodological triangulation to understand the dynamic contextual features of and community responses to these events. Doing so will help to better elucidate the function and impact of crisis-related communications, or the lack thereof, on distress responses. Science on crisis communications and the media can be an ally in this challenging set of tasks.

Materials and Methods

Study 1.

Sample and procedures.

Beginning 7 days after the campus shooting, undergraduate and graduate students were invited to complete an anonymous, internet-based survey via a system-wide email sent on the researchers’ behalf by the university administration. The survey was fielded to all 40,339 students listed in the university system. A reminder email was sent out a week later to bolster student participation. Participants who clicked the link to the survey were presented with an initial screen indicating that the purpose of the survey was to study the impact of the campus shooting; informed consent was obtained from all individuals included in the study. Participants were asked to complete the survey without consulting others and were instructed to answer items as honestly as possible. Participants were also presented with contact information for the lead researchers and the campus counseling center and encouraged to call or visit the center if they felt a need to speak with someone about their feelings regarding the incident. Data were collected up to 29 days following the shooting, with the majority of responses (92%) collected within 16 days postevent. The participation rate was ∼18% (n = 6,540). Of these, 3,890 (∼60%) students reported having been in the lockdown; between 2,696 and 3,393 of these students had complete information on variables across analyses in study 1. Of the 3,051 students who provided ethnicity data, nearly 40% identified as European American, roughly 30% identified as Asian American, and 14% identified as Latino American; the remainder identified as multiracial/ethnic (8.6%), African American (2.7%), or other (6%). All procedures for this study were approved by the Institutional Review Board of the University of California, Irvine.

Dependent variables.

Acute stress.

Symptoms of acute stress were assessed using the Acute Stress Disorder Scale-5 (21), which is based on the Diagnostic and Statistical Manual of Mental Disorders, fifth edition (DSM-5; ref. 36). Respondents used a 5-point Likert-type scale ranging from 0 (not at all) to 4 (very much) to describe the extent to which they experienced each of 14 possible reactions “since the shooting and lockdown” (e.g., “Do you have distressing dreams about the lockdown/shooting?”). Responses were summed (range, 0–56) to create a continuous score for acute stress symptoms and to capture maximum variability in potential responses (37).

Conflicting information.

Respondents were asked to indicate the extent to which they agreed with the statement. “I received conflicting information from different sources about the details of the shooting.” Responses were measured on a 5-point Likert-type scale ranging from 0 (not at all) to 4 (a great deal). Because no valid information about the event was available to any students during the lockdown, this variable was used as a proxy for rumor exposure.

To validate this assumption, we examined responses to an open-ended survey item that asked “What particular parts of the event were most upsetting to you?” We used an R script to code each response for whether it mentioned the word “rumor.” Those who mentioned rumors reported higher exposure to conflicting information (standardized b = 0.31, SE = 0.04, P < 0.001). To further clarify what participants wrote about rumors, we examined the word pairs (i.e., bigram analysis) that occurred most commonly in the corpus of responses using a text analysis program called Meaning Extraction Helper (38). The four word pairs occurring most commonly were multiple shooter, rumor spread, rumor multiple, and rumor shooter. The words rumors and false information appeared in other responses with less frequency but were also present. Given that many respondents wrote at length, we also conducted a trigram analysis, which analyzes the most common occurrence of three words appearing together across responses. This analysis revealed that “rumor [of] multiple shooters” was the most common response.

Independent variables.

Traditional media and online news.

On a 3-point Likert-type scale (0 = not at all, 1 = some of the time, 2 = most or all of the time), respondents indicated receiving critical updates from radio, television, and online news sites (e.g., CNN, New York Times, TMZ). Responses for each of these channels were dichotomously coded (0 = not at all, 1 = at least some of the time). They were aggregated to form a count of traditional media/online news sites used (range, 0–3).

Direct contact from close others.

On a 3-point Likert-type scale (0 = not at all, 1 = some of the time, 2 = most or all of the time), respondents indicated whether they received critical updates from a group text message from a campus student organization, a text message from a friend, a text message from a family member, a phone call from a friend, and a phone call from a family member. Responses for each of these channels were dichotomously coded (0 = not at all, 1 = at least some of the time). They were aggregated to form a count of direct contact from close others (range, 0–5).

Social media.

On a 3-point Likert-type scale (0 = not at all, 1 = some of the time, 2 = most or all of the time), respondents indicated whether they received critical updates from Twitter, Facebook, Snapchat, Reddit, and Instagram or some other platform not listed. Responses were dichotomously coded (0 = not at all, 1 = at least some of the time). They were aggregated to form a count of social media channels used (range, 0–5).

Channel trust.

For each communication channel students reported using, they were asked to rate how much they trusted it for information about the shooting and lockdown. These ratings were reported on a 5-point Likert-type scale ranging from 1 (strongly distrust) to 5 (strongly trust). That is, if students reported using Twitter, they were asked to rate how much they trusted it for information and critical updates. Trust ratings were averaged across each communication channel category to create a composite of trust for traditional media and online news (α = 0.90), direct contact from close others (α = 0.89), and social media (α = 0.90), respectively.

Relevant covariates.

Prior school shooting experience.

Respondents indicated whether or not they, or someone close to them, ever experienced a school shooting. A total of 16.11% (n = 611) reported previously having such an experience.

Prior trauma exposure.

Respondents were asked whether they personally experienced a natural disaster (e.g., tornado, earthquake), community violence (e.g., shooting, civil unrest), combat during war, or any other form of violence before the shooting. Responses across these four items were summed and ranged from 0–4.

Affiliation with affected department.

To capture psychological proximity to the department where the shooting took place, respondents reported their affiliation with the department. In all, 26.2% (n = 830) indicated being affiliated with the department either by being a department major, minor, having taken classes in the department, or some other reason.

Lockdown event exposure.

Respondents were asked to indicate whether they experienced each of 11 exposures to the lockdown (e.g., “I was in [building name omitted] when the shooting occurred”). Affirmative responses across these items were summed to create an index of event exposure. Responses ranged from 0 to 11 exposures.

Alone.

Respondents indicated whether they were alone or with others during the lockdown. Responses were dummy coded such that if a student indicated being alone, he or she was coded with a 1.

Analytic strategy.

Statistical analyses were conducted in Stata 14 (College Station, TX). A series of ordinary least-squares regression analyses were conducted to examine correlates of acute stress and exposure to conflicting information, respectively. Because a number of collective traumas were prominent in the media during data collection, we opted to control for survey completion week to account for the potential influence of these events on participant responses. We also included statistical controls for age and gender. Descriptive statistics for all model variables are reported in Tables S2 and S3.

View this table:
  • View inline
  • View popup
Table S2.

Descriptive statistics for all variables of interest (n = 3,162)

View this table:
  • View inline
  • View popup
Table S3.

Percentage of individuals who relied on various communication channels in the regression analysis examining the channels associated with receipt of conflicting information (n = 3,393)

Study 2.

Twitter user selection.

There are several challenges associated with searching for tweets in a geographic area using the Twitter API. Although Twitter does allow for searching based on geographic coordinates (geotags), only 1–5% of tweets are geotagged. Moreover, it is not currently possible to perform searches for tweets generated more than 3 days before the date of the search. To circumvent these challenges in the context of a campus shooting, researchers have relied on downloading tweets directly from followers of a university’s Twitter account; the efficacy of this technique for approximating users who are likely to be students affiliated with the university has been demonstrated across several incidents of campus violence (23). Thus, on the day of the shooting and lockdown, we used the twitteR package (39) for R (22) to connect to the Twitter API and download the list of the most recent 20,000 followers of (or subscribers to) the university’s main Twitter account and 6,000 followers of the university’s emergency management Twitter account.

We then removed users from this list based on the following criteria: non-English language account, private account (in which case tweets would not be publicly available), “verified” account (usually indicative of high-profile Twitter users or businesses), and accounts with more than 1,000 total tweets (to omit superusers). After employing these exclusion criteria, 13,000 user accounts were available from which to pull tweets. Approximately 2 weeks after the shooting and lockdown, we interfaced with the API and requested the most recent 200 tweets from each user in our trimmed list.

Tweet processing.

We downloaded nearly 2.3 million tweets. We then constrained our analysis to the time frame immediately around the lockdown: approximately 1 hour before the 911 call up until the end of the second hour after the all-clear. Within this 5-hour window of time, we captured 11,617 tweets from 2,863 users. After removing duplicate tweets, we were left with 7,824 tweets from 2,515 users.

Measures.

Rumor tweets.

All tweets generated in the time frame around the lockdown were manually coded for rumors. A coder was instructed to tag tweets in the sample that contained information that was not verified at the time of the lockdown. Given that virtually no information was available during the lockdown, aside from official reminders that the university was on lockdown, the task of identifying rumor tweets was relatively straightforward. In all, 38 tweets with rumors were identified.

Rumor virality.

Every tweet downloaded via the Twitter API comes with a measure of how many times it was retweeted. This measure captures the virality of the tweet over its lifetime and is not tied to its virality at a given time point (e.g., during the lockdown). However, given the targeted nature of this event, virality was likely isolated to the lockdown as there would be no need to retweet any rumors about the lockdown after the all-clear.

Event-related negative emotion.

We analyzed the linguistic content of each tweet using a custom R script that tallied the frequency with which words used in each tweet match words from the LIWC software’s negative emotion dictionary (24). Similar to prior research (23), we also employed an R script that used a 17-item custom word list to automatically identify and tag tweets about the shooting and lockdown. This list included context-specific words (e.g., lockdown, #[university name]strong, #prayfor[university name]) to bolster the script’s efficacy in identifying lockdown-related tweets. Tweets containing at least one negative emotion word and one word referencing the event were coded with a 1 (all others coded with 0).

Analytic strategy.

Data were imported into Stata 14 (College Station, TX) from R (22), and tweets were combined into 15-min blocks across time. The proportion of tweets with event-related negative emotion expression in each 15-min block was calculated. We also calculated the quantity and virality (via retweet counts) of rumor tweets in each block, respectively. Event-related negative emotion expression was plotted across time, and rumor generation count and rumor virality were overlaid, respectively, in two graphs (Figs. 2 and 3).

Note: The university that allowed authors access to the students who served as subjects in study 1 did so with the proviso that the institution under study would not be revealed. Although data were collected anonymously, the identity of the institution and affected department are easily accessible in both the questions asked on the survey as well as in responses provided by subjects. Therefore, we are not allowed to release these data publicly. The affected institution is also clearly identifiable in the tweets analyzed in study 2. Although data cannot be posted publicly, we would be willing to make available to interested readers carefully redacted documentation and data files upon request.

Acknowledgments

We thank Maryann J. Gray, E. Alison Holman, and Dana Rose Garfin for their valuable input at the onset of study 1 and Carly Steinberger for her efforts coding tweets in study 2. We also thank Azim Shariff for his comments on an earlier version of this paper.

Footnotes

  • ↵1To whom correspondence should be addressed. Email: rsilver{at}uci.edu.
  • Author contributions: N.M.J., C.D.S., and R.C.S. designed study 1; N.M.J. designed study 2; N.M.J., C.D.S., and R.C.S. performed research; N.M.J. contributed new reagents/analytic tools; N.M.J. and R.R.T. analyzed data; and N.M.J. and R.C.S. wrote the paper, with input from R.R.T. and C.D.S.

  • The authors declare no conflict of interest.

  • This article is a PNAS Direct Submission.

  • This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1708518114/-/DCSupplemental.

  • Copyright © 2017 the Author(s). Published by PNAS.

This open access article is distributed under Creative Commons Attribution-NonCommercial-NoDerivatives License 4.0 (CC BY-NC-ND).

References

  1. ↵
    1. Blair JP,
    2. Schweit KW
    (2014) A Study of Active Shooter Incidents in the United States Between 2000 and 2013 (US Department of Justice, Federal Bureau of Investigation, Washington, DC).
  2. ↵
    1. Allport GW,
    2. Postman L
    (1946) An analysis of rumor. Public Opin Q 10:501–517.
    OpenUrlCrossRef
  3. ↵
    1. Festinger L, et al.
    (1948) A study of a rumor: Its origin and spread. Hum Relat 1:464–486.
    OpenUrlCrossRef
  4. ↵
    1. Rosnow RL
    (1991) Inside rumor: A personal journey. Am Psychol 46:484–496.
    OpenUrlCrossRef
  5. ↵
    1. Fitzhugh SM,
    2. Gibson CB,
    3. Spiro ES,
    4. Butts CT
    (2016) Spatio-temporal filtering techniques for the detection of disaster-related communication. Soc Sci Res 59:137–154.
    OpenUrl
  6. ↵
    1. Starbird K,
    2. Maddock J,
    3. Orand M,
    4. Achterman P,
    5. Mason RM
    (2014) Rumors, false flags, and digital vigilantes: Misinformation on Twitter after the 2013 Boston Marathon bombing. iConference 2014 Proceedings (iSchools, Grandville, MI), pp 654–662.
  7. ↵
    1. Taha SA,
    2. Matheson K,
    3. Anisman H
    (2014) H1N1 was not all that scary: Uncertainty and stressor appraisals predict anxiety related to a coming viral threat. Stress Health 30:149–157.
    OpenUrl
  8. ↵
    1. Greenberg BS
    1. Seeger MW,
    2. Vennette S,
    3. Ulmer RR
    (2002) Media use, information seeking, and reported needs in post crisis contexts. Communication and Terrorism: Public and Media Responses to 9/11, ed Greenberg BS (Hampton, Cresskill, NJ), pp 53–74.
  9. ↵
    1. Ball-Rokeach SJ,
    2. DeFleur ML
    (1976) A dependency model of mass-media effects. Communic Res 3:3–21.
    OpenUrlCrossRef
  10. ↵
    1. Chen CY,
    2. Hong RY
    (2010) Intolerance of uncertainty moderates the relation between negative life events and anxiety. Pers Individ Dif 49:49–53.
    OpenUrl
  11. ↵
    1. Mazer JP, et al.
    (2015) Communication in the face of a school crisis: Examining the volume and content of social media mentions during active shooter incidents. Comput Human Behav 53:238–248.
    OpenUrl
  12. ↵
    1. Palen L,
    2. Anderson KM
    (2016) Crisis informatics–New data for extraordinary times. Science 353:224–225.
    OpenUrlAbstract/FREE Full Text
  13. ↵
    1. Palen L,
    2. Liu SB
    (2007) Citizen communications in crisis: Anticipating a future of ICT-supported public participation. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM, New York), pp 727–736.
  14. ↵
    1. Hughes AL,
    2. Palen L
    (2009) Twitter adoption and use in mass convergence and emergency events. Int J Emerg Manag 6:248–260.
    OpenUrl
  15. ↵
    1. Spiro ES, et al.
    (2012) Rumoring during extreme events: A case study of Deepwater Horizon 2010. Proceedings of the ACM Web Science 2012 Conference (ACM, New York), pp 275–283.
  16. ↵
    1. Jones NM,
    2. Garfin DR,
    3. Holman EA,
    4. Silver RC
    (2016) Media use and exposure to graphic content in the week following the Boston Marathon bombings. Am J Community Psychol 58:47–59.
    OpenUrl
  17. ↵
    1. Rosnow RL,
    2. Yost JH,
    3. Esposito JL
    (1986) Belief in rumor and likelihood of rumor transmission. Lang Commun 6:189–194.
    OpenUrlCrossRef
  18. ↵
    1. Holman EA,
    2. Garfin DR,
    3. Silver RC
    (2014) Media’s role in broadcasting acute stress following the Boston Marathon bombings. Proc Natl Acad Sci USA 111:93–98.
    OpenUrlAbstract/FREE Full Text
  19. ↵
    1. Silver RC, et al.
    (2013) Mental- and physical-health effects of acute exposure to media images of the September 11, 2001, attacks and the Iraq War. Psychol Sci 24:1623–1634.
    OpenUrlCrossRefPubMed
  20. ↵
    1. Schlenger WE, et al.
    (2002) Psychological reactions to terrorist attacks: Findings from the national study of Americans’ reactions to September 11. JAMA 288:581–588.
    OpenUrlCrossRefPubMed
  21. ↵
    1. Bryant RA
    (2016) Acute Stress Disorder: What It Is and How to Treat It (Guilford, New York).
  22. ↵
    1. R Core Team
    (2016) R: A Language and Environment for Statistical Computing (R Foundation for Statistical Computing, Vienna), Version 3.4.1.
  23. ↵
    1. Jones NM,
    2. Wojcik SP,
    3. Sweeting J,
    4. Silver RC
    (2016) Tweeting negative emotion: An investigation of Twitter data in the aftermath of violence on college campuses. Psychol Methods 21:526–541.
    OpenUrl
  24. ↵
    1. Tausczik YR,
    2. Pennebaker JW
    (2010) The psychological meaning of words: LIWC and computerized text analysis methods. J Lang Soc Psychol 29:24–54.
    OpenUrlCrossRef
  25. ↵
    1. Janoff-Bulman R
    (1992) Shattered Assumptions: Towards a New Psychology of Trauma (The Free Press, New York).
  26. ↵
    1. Whitson JA,
    2. Galinsky AD
    (2008) Lacking control increases illusory pattern perception. Science 322:115–117.
    OpenUrlAbstract/FREE Full Text
  27. ↵
    1. Henderson RK,
    2. Snyder HR,
    3. Gupta T,
    4. Banich MT
    (2012) When does stress help or harm? The effects of stress controllability and subjective stress response on Stroop performance. Front Psychol 3:179.
    OpenUrlPubMed
  28. ↵
    1. Lewandowsky S,
    2. Ecker UKH,
    3. Seifert CM,
    4. Schwarz N,
    5. Cook J
    (2012) Misinformation and its correction: Continued influence and successful debiasing. Psychol Sci Public Interest 13:106–131.
    OpenUrlCrossRefPubMed
  29. ↵
    1. Stephens KK,
    2. Barrett AK,
    3. Mahometa MJ
    (2013) Organizational communication in emergencies: Using multiple channels and sources to combat noise and capture attention. Hum Commun Res 39:230–251.
    OpenUrlCrossRef
  30. ↵
    1. Seeger MW,
    2. Sellnow TL,
    3. Ulmer RR
    (2003) Communication and Organizational Crisis (Praeger, Westport, CT).
  31. ↵
    1. Shuster S
    (2016) Munich police face questions over false tweets during shooting. Available at time.com/4421410/munich-shooting-germany-terrorism-tweets/. Accessed March 13, 2017.
  32. ↵
    1. Fischhoff B
    (2011) Communicating about the risks of terrorism (or anything else). Am Psychol 66:520–531.
    OpenUrlCrossRefPubMed
  33. ↵
    1. Reynolds B,
    2. Seeger MW
    (2005) Crisis and emergency risk communication as an integrative model. J Health Commun 10:43–55.
    OpenUrlCrossRefPubMed
  34. ↵
    1. Del Vicario M, et al.
    (2016) The spreading of misinformation online. Proc Natl Acad Sci USA 113:554–559.
    OpenUrlAbstract/FREE Full Text
  35. ↵
    1. Wendling M
    (2017) Sandy Hook to Trump: ‘Help us stop conspiracy theorists’. Available at www.bbc.com/news/blogs-trending-39194035. Accessed May 2, 2017.
  36. ↵
    1. American Psychiatric Association
    (2013) Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, Washington, DC), 5th Ed.
  37. ↵
    1. MacCallum RC,
    2. Zhang S,
    3. Preacher KJ,
    4. Rucker DD
    (2002) On the practice of dichotomization of quantitative variables. Psychol Methods 7:19–40.
    OpenUrlCrossRefPubMed
  38. ↵
    1. Boyd RL
    (2017) MEH: Meaning Extraction Helper [Software] Version 1.4.15. Available at meh.ryanb.cc. Accessed August 16, 2017.
  39. ↵
    1. Gentry J
    (2015) twitteR: R Based Twitter Client. Available at https://cran.r-project.org/web/packages/twitteR/twitteR.pdf. Accessed September 27, 2016.
PreviousNext
Back to top
Article Alerts
Email Article

Thank you for your interest in spreading the word on PNAS.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Distress and rumor exposure on social media during a campus lockdown
(Your Name) has sent you a message from PNAS
(Your Name) thought you would like to see the PNAS web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Rumors during a campus lockdown
Nickolas M. Jones, Rebecca R. Thompson, Christine Dunkel Schetter, Roxane Cohen Silver
Proceedings of the National Academy of Sciences Oct 2017, 114 (44) 11663-11668; DOI: 10.1073/pnas.1708518114

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Request Permissions
Share
Rumors during a campus lockdown
Nickolas M. Jones, Rebecca R. Thompson, Christine Dunkel Schetter, Roxane Cohen Silver
Proceedings of the National Academy of Sciences Oct 2017, 114 (44) 11663-11668; DOI: 10.1073/pnas.1708518114
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Mendeley logo Mendeley
Proceedings of the National Academy of Sciences: 114 (44)
Table of Contents

Submit

Sign up for Article Alerts

Article Classifications

  • Social Sciences
  • Psychological and Cognitive Sciences

Jump to section

  • Article
    • Abstract
    • Study 1
    • Study 2
    • Discussion
    • Conclusion
    • Materials and Methods
    • Acknowledgments
    • Footnotes
    • References
  • Figures & SI
  • Info & Metrics
  • PDF

You May Also be Interested in

Surgeons hands during surgery
Inner Workings: Advances in infectious disease treatment promise to expand the pool of donor organs
Despite myriad challenges, clinicians see room for progress.
Image credit: Shutterstock/David Tadevosian.
Setting sun over a sun-baked dirt landscape
Core Concept: Popular integrated assessment climate policy models have key caveats
Better explicating the strengths and shortcomings of these models will help refine projections and improve transparency in the years ahead.
Image credit: Witsawat.S.
Double helix
Journal Club: Noncoding DNA shown to underlie function, cause limb malformations
Using CRISPR, researchers showed that a region some used to label “junk DNA” has a major role in a rare genetic disorder.
Image credit: Nathan Devery.
Steamboat Geyser eruption.
Eruption of Steamboat Geyser
Mara Reed and Michael Manga explore why Yellowstone's Steamboat Geyser resumed erupting in 2018.
Listen
Past PodcastsSubscribe
Birds nestling on tree branches
Parent–offspring conflict in songbird fledging
Some songbird parents might improve their own fitness by manipulating their offspring into leaving the nest early, at the cost of fledgling survival, a study finds.
Image credit: Gil Eckrich (photographer).

Similar Articles

Site Logo
Powered by HighWire
  • Submit Manuscript
  • Twitter
  • Facebook
  • RSS Feeds
  • Email Alerts

Articles

  • Current Issue
  • Special Feature Articles – Most Recent
  • List of Issues

PNAS Portals

  • Anthropology
  • Chemistry
  • Classics
  • Front Matter
  • Physics
  • Sustainability Science
  • Teaching Resources

Information

  • Authors
  • Editorial Board
  • Reviewers
  • Librarians
  • Press
  • Site Map
  • PNAS Updates

Feedback    Privacy/Legal

Copyright © 2021 National Academy of Sciences. Online ISSN 1091-6490