Distress and rumor exposure on social media during a campus lockdown
Edited by Susan T. Fiske, Princeton University, Princeton, NJ, and approved September 25, 2017 (received for review June 2, 2017)
Significance
During active shooter events when danger is imminent and official information is disseminated inconsistently, ambiguity is high. In these situations, individuals may seek information from unofficial channels (e.g., social media), thereby exposing themselves to unverified information and rumors. In a study of students caught in a university-wide lockdown, we found that those who relied on social media for updates reported increased exposure to conflicting information. Moreover, those who trusted what they read reported greater distress. Then, using a big-data analysis of Twitter data spanning ∼5 hours surrounding the event, we demonstrated that rumor transmission tracks with community-level negative emotion during gaps in official communication. Officials should monitor social media channels to mitigate the negative impact of rumors during collective traumas.
Abstract
During crisis events, people often seek out event-related information to stay informed of what is happening. However, when information from official channels is lacking or disseminated irregularly, people may be at risk for exposure to rumors that fill the information void. We studied information-seeking during a university lockdown following an active-shooter event. In study 1, students in the lockdown (n = 3,890) completed anonymous surveys 1 week later. Those who indicated receiving conflicting information about the lockdown reported greater acute stress [standardized regression coefficient (b) = 0.07; SE = 0.01; 95% confidence interval (CI), 0.04, 0.10]. Additionally, those who reported direct contact with close others via text message (or phone) and used Twitter for critical updates during the lockdown were exposed to more conflicting information. Higher acute stress was reported by heavy social media users who trusted social media for critical updates (b = 0.06, SE = 0.01; 95% CI, 0.03, 0.10). In study 2, we employed a big data approach to explore the time course of rumor transmission across 5 hours surrounding the lockdown within a subset of the university’s Twitter followers. We also examined the patterning of distress in the hours during the lockdown as rumors about what was happening (e.g., presence of multiple shooters) spread among Twitter users. During periods without updates from official channels, rumors and distress increased. Results highlight the importance of releasing substantive updates at regular intervals during a crisis event and monitoring social media for rumors to mitigate rumor exposure and distress.
Sign up for PNAS alerts.
Get alerts for new articles, or get an alert when an article is cited.
Since 2000, active shooter events in the United States have been on the rise and often result in higher casualty counts when they occur in educational institutions compared with other settings (1). Crisis events like these are often accompanied by deficits of credible information as authorities attempt to piece together the facts of the unfolding events. As a consequence, individuals caught in the wake of the crisis are left vulnerable to rumors and conflicting information from unofficial communication channels they trust. Despite a robust scientific literature on the circumstances in which rumors are generated (2–4) and transmitted (5, 6), little is known about the psychological correlates of exposure to rumors during crisis events. When rumors proliferate during dangerous and uncertain situations, what impact do they have on people who receive and believe them?
Crisis events are often ambiguous in nature, and when uncertainty is high, appraisals of threat among individuals caught in their path can be heightened (7). This, in turn, may instigate information-seeking behavior as a way of reducing situational uncertainty (8, 9) and consequently the psychological distress such uncertainty engenders (10). In the past, this information seeking led people to their radios and televisions to acquire critical updates from official channels. However, when a crisis unfolds, people now increasingly acquire critical updates from social media (e.g., Twitter; refs. 11–15), along with traditional media channels (16).
Moreover, when information from official channels is irregular or lacks new information, uncertainty and information-seeking behavior are likely sustained. As a result, people may also turn to unofficial channels, such as social media, to mitigate their discomfort. The challenge with social media as a resource for updates, however, is the lack of mechanisms for vetting the accuracy of the information being shared among users. This is particularly important because, as the rumor literature suggests, trust in an information source moderates whether rumors are believed and transmitted (17). In addition, once rumors begin to spread on social media, they are very difficult to undermine with updates or corrections (6).
What people see when they are exposed to media-based coverage of a crisis event has been studied previously in the context of collective traumas, such as terrorist attacks and natural disasters that affect many people and occur without warning (16). Large studies of representative US samples demonstrate that, among other variables, repeated indirect, media-based exposure to collective traumas is associated with event-related distress, even when controlling for pretrauma media habits and preexisting mental health conditions (18, 19). For example, in a study following the Boston Marathon bombings (BMB), researchers found that 6 or more hours of BMB-related media use was associated with higher acute stress than was direct exposure to the bombings (18). This relationship is thought to be at least partly driven by the transmission of graphic, event-related imagery via news coverage (16, 20). However, when images are not relevant or available, other content, like rumors or conflicting information, may also contribute to the distress individuals experience during a crisis.
We explored the role of rumors in two studies of a single university shooting, using multiple methods to characterize the community’s response. In study 1, we examined psychological distress and correlates of communication-channel use among 3,890 students at a major university in the United States who were under a protracted lockdown (∼2 hours) during an active shooter event in which critical updates from officials were infrequent. In study 2, we employed a big data approach to explore the time course of rumor transmission and patterning of distress during the lockdown.
Study 1
Data were collected using a Qualtrics survey software link emailed on the researchers’ behalf by the university administration to all enrolled students 7 days after the shooting. Students reported their distress about the lockdown by responding to items on a standardized multi-item measure of acute stress (21). Respondents also indicated the communication channels from which they acquired information and critical updates during the lockdown, including direct contact from close others (e.g., phone calls and texts from friends and/or family), traditional media (e.g., radio, television, online news), and social media (e.g., Twitter, Facebook, Snapchat, Reddit, Instagram). For every communication channel students used, they reported how much they trusted it for critical updates about the shooting and lockdown. To capture exposure to rumors during the lockdown, students reported the overall extent to which they received conflicting information about the details of the lockdown across all communication channels they used.
Results indicated that exposure to conflicting information was associated with acute stress related to the lockdown, after controlling for several relevant covariates (Table 1). Traditional media use was not associated with acute stress, but direct contact with close others and social media use were each associated with greater acute stress. We then examined whether trust in these communication channels moderated their respective relations with distress. No moderating effect was found for trust in direct contact with close others. However, greater acute stress was reported by heavy social media users who trusted social media for critical updates (Fig. 1). In addition, students who acquired critical updates via text messages from close others or via Twitter reported increased exposure to conflicting information compared to those who did not rely on these channels (Table 2).
Table 1.
Model 1, n = 3,162† | Model 2, n = 2,696† | |||||
---|---|---|---|---|---|---|
Variables | b(95% CI) | SEb | t | b(95% CI) | SEb | t |
Completion week | −0.05(−0.08, −0.01)* | 0.01 | −3.10 | −0.08(−0.13, −0.03)* | 0.02 | −3.23 |
Gender | ||||||
Female = 0 | — | — | — | |||
Male | −0.37(−0.44, −0.29)** | 0.03 | −10.27 | −0.36(−0.44, −0.29)** | 0.03 | −9.30 |
Other | 0.48(0.16, 0.80)* | 0.16 | 2.98 | 0.44(0.08, 0.80)* | 0.18 | 2.44 |
Age | −0.01(−0.05, 0.01) | 0.01 | −0.93 | −0.001(−0.01, 0.01) | 0.004 | −0.32 |
Prior shooting exposure | 0.17(0.08, 0.26)** | 0.04 | 3.85 | 0.21(0.12, 0.31)** | 0.04 | 4.48 |
Prior trauma—violence, war, other | 0.13(0.10, 0.17)** | 0.01 | 8.07 | 0.15(0.10, 0.19)** | 0.02 | 7.09 |
Department affiliation, none = 0 | 0.10(0.03, 0.18)* | 0.03 | 2.86 | 0.10(0.02, 0.18)* | 0.04 | 2.53 |
Lockdown event exposure | 0.09(0.05, 0.12)** | 0.01 | 5.00 | 0.05(0.02, 0.07)** | 0.01 | 4.00 |
Alone, with others = 0 | −0.11(−0.21, −0.01)* | 0.05 | −2.25 | −0.11(−0.22, −0.01)* | 0.05 | −2.14 |
Exposure to conflicting information | 0.07(0.04, 0.10)** | 0.01 | 4.28 | 0.08(0.04, 0.12)** | 0.02 | 4.14 |
Count of traditional media use | 0.01(−0.02, 0.05) | 0.01 | 0.85 | 0.01(−0.03, 0.05) | 0.02 | 0.40 |
Count of contact with friends/family | 0.13(0.10, 0.17)** | 0.01 | 7.21 | 0.09(0.06, 0.12)** | 0.01 | 6.70 |
Count of social media use | 0.07(0.03, 0.10)** | 0.01 | 3.99 | −0.15(−0.28, −0.03)* | 0.06 | −2.42 |
Social media trust | — | — | — | −0.06(−0.15, 0.01) | 0.04 | −1.55 |
Social Media Use × Social Media Trust | — | — | — | 0.06(0.03, 0.10)** | 0.01 | 3.66 |
Model statistics | F(13, 3,148) = 43.02, P < 0.001; R2 = 0.15 | F(15, 2,680) = 33.31, P < 0.001, R2 = 0.15 |
*
P < 0.05; **P < 0.001; all regression coefficients are standardized.
†
Sample sizes vary across models due to missing data.
Fig. 1.
Table 2.
Variables | b(95% CI) | SEb | t |
---|---|---|---|
Direct contact | |||
Text message from a campus group | 0.41(0.34, 0.48)** | 0.03 | 11.49 |
Text message from a friend | 0.29(0.16, 0.42)** | 0.06 | 4.58 |
Text message from family | 0.09(0.01, 0.18)* | 0.04 | 2.16 |
Phone call from a friend | −0.09(−0.17, −0.01)* | 0.04 | −2.15 |
Phone call from family | −0.03(−0.12, 0.05) | 0.04 | −0.81 |
Social media | |||
0.08(0.01, 0.14)* | 0.03 | 2.49 | |
0.07(−0.002, 0.14)† | 0.03 | 1.90 | |
Snapchat | 0.03(−0.04, 0.11) | 0.03 | 0.90 |
0.01(−0.06, 0.07) | 0.03 | 0.15 | |
0.07(−0.02, 0.16) | 0.04 | 1.52 | |
Model statistics | F(10, 3,382) = 25.28, P < 0.001, R2 = 0.07 |
*
P < 0.05; **P < 0.001; †P = 0.057; all regression coefficients are standardized.
Study 2
Because students in this first study who used Twitter reported increased exposure to conflicting information, in study 2 we examined the time course of community-level rumor generation and virality (i.e., degree to which rumors were circulated) among a subset of Twitter users who followed two official university Twitter accounts. Using R (22), we connected to Twitter via its Application Programming Interface (API) on the day of the lockdown and downloaded a list of the most recent 13,000 public followers of the university’s primary and emergency response Twitter accounts. Two weeks later, we downloaded the most recent 200 tweets from each follower. Because tweets were time-stamped, we constrained our analysis to tweets generated in the hour leading up to the initial 911 call until the second hour after the lockdown was lifted, segmenting time into 15-min blocks. Each tweet in this frame was tagged if it contained a rumor, defined as a statement verified to be blatantly false following the incident. To capture community-level distress about the lockdown, we devised an R script to automatically tag tweets referencing the lockdown incident (for a similar method, see ref. 23) and those containing negative emotion words using the Linguistic Inquiry and Word Counter (LIWC) negative emotion dictionary (24). For example, tweets about the lockdown that also contained words such as “distress” or “afraid” were tagged to reflect event-related negative emotions. Tagging tweets in this way allowed us to calculate a count of rumor tweets, as well as calculate the proportion of tweets with event-related negative emotions in each 15-min segment over time. We then overlaid the official campus alerts sent to all university students during the same time frame (Table S1).
Table S1.
Message no. | Content | Time, UTC |
---|---|---|
1 | Police Activity vic[inity of] [BUILDING NAME]. Avoid area until further notice. | 16:49 |
2 | Shooting at [BUILDING NAME]. Go to secure location and deny entry (lockdown) now! | 16:53 |
3 | Follow up: Shooting. Lock down continues for entire campus. Regardless of location on campus go to secure… Msg 1 of 2 | 18:26 |
4 | …location and deny entry, (lockdown) now! More information once available. Msg 2 of 2 | 18:26 |
5 | Lock down continues. Do not go outside unless instructed by [CAMPUS POLICE]. Do not come to campus. If outside, go indoors and lock down. | 18:42 |
6 | Lockdown lifted. All Clear. Check [web address omitted] | 19:19 |
UTC, coordinated universal time.
Within the corpus of tweets generated around the lockdown time frame (Fig. 2), 38 rumors were identified (Mretweet count = 179, SD = 427; min = 0, max = 2,299). Viral rumors (i.e., those retweeted most frequently) involved descriptions of a nonexistent white male suspect and his movements. Other rumors involved claims of multiple deaths and warnings of multiple shooters at several locations on campus (Table 3). As depicted in Fig. 2, the bulk of rumors were generated during the 90-min gap in communication from campus officials after the first lockdown alert and continued consistently until a second campus alert was disseminated to remind students about the lockdown. Although the number of rumors decreased after the second alert, the virality of the few rumors that were generated in the time block after a third alert (again regarding the lockdown) far exceeded any rumor tweet in the preceding blocks (Fig. 3). It is not clear why the rumors in this block went viral, but it might have been due to more people becoming aware of the situation and wanting to pass information on to others. Although we cannot directly link them together, event-related negative emotions tracked almost identically with rumor virality consistently across time (Fig. 3). These findings suggest that the virality of rumors may be implicated in the transmission of distress during a crisis.
Fig. 2.
Table 3.
Text of retweeted rumors | No. retweets |
---|---|
Description of perpetrator(s) | |
[user omitted] per scanner [university name omitted] suspects are male and female white male approx 6 ft tall | 103 |
[user omitted] [university omitted] shooting 2 victims per [university name omitted] newsroom campus on lockdown shooter described as 6ft white male wearing black | 859 |
[user omitted] police search for 6foot white male dressed in all black after two people shot dead at [university name omitted] | 1,096 |
Warnings of multiple shooters and victims | |
[user omitted] multiple shooters on campus right now make sure to get into a safe place | 9 |
[user omitted] wtf multiple shooters people on stretchers 5 helicopters in the air im literally so scared right now | 9 |
[user omitted] 2 confirmed victims down multiple shooters on the loose been almost 30 min still not caught | 15 |
Fig. 3.
Discussion
Prior research on rumors demonstrates that situational ambiguity, high importance, and anxiety are necessary conditions for rumor generation (2–4). Consistent with this work, our findings indicate that during crisis events, when critical updates from official channels are irregular, rumors proliferate. Individuals who are caught in the path of a crisis event are often left feeling helpless and without situational control (25), which can lead people to see patterns in the information obtained that are not present (e.g., via illusory pattern perception; ref. 26). In addition, situational stress may interfere with information processing via inhibited executive functioning (e.g., working memory, self-regulation processes; ref. 27). Taken together, these effects may diminish the myriad cognitive processes necessary for scrutinizing the veracity of unique and repeated information (28), such as content propagated on social media platforms during a crisis. This causal chain likely plays a role in increasing the potency of rumor exposure during potentially threatening and ambiguous crisis situations.
To mitigate this problem, we offer several recommendations. First, emergency officials should disseminate frequent updates to the affected population, in real time. In the context of a school shooting, repeated alerts have been found to increase the perception of urgency among participants who received them (29), a factor necessary for eliciting swift and appropriate action. Although we cannot explicitly test whether more frequent updates from official channels would have mitigated rumors and distress using the data we collected, crisis communication scholars posit that regular communications from emergency management officials are essential for mitigating uncertainty and rumors after a crisis (30). For example, as part of their response to a mass shooting at a shopping mall in Munich, Germany, local police urged the public via press conferences and social media to resist speculation about the attack and directly addressed rumors on social media as they became aware of them (31). Despite false reports of additional shootings in the city and the overall lack of clarity about what was happening during the citywide lockdown, police chose to maintain transparency and constant contact with the public throughout the ordeal, a strategy likely appreciated by the public (32). Had the Munich police remained silent, however, the budding rumors about shootings in other city locations would have likely filled the information void. As communities learn to manage active shooter crises and other emergencies, crisis communications like those employed by the Munich police department will be prudent to put in place.
Second, critical updates disseminated to the public should include new information, when possible. However, when new information is not available, updates should be tailored to reduce situational uncertainty (33), thereby mitigating distress and rumors (30). Additionally, emergency management officials should attempt to counter the impact of rumors that arise during crisis situations by monitoring social media channels and encouraging individuals to keep a healthy skepticism about information coming from unofficial channels.
Furthermore, we believe the news media, which play a critical role in informing the public during crisis events (30), must share the responsibility for disseminating accurate information. The importance of this point is illustrated by the examples of conspiracy theories propagated on social media (and other channels) that resonate with individuals psychologically attuned to alternative narratives (34). Although seemingly benign, conspiracy theories can lead people to deny that acts of horror, like the 9/11 terrorist attacks and the Sandy Hook Elementary School massacre, occurred at all. Consequently, denial narratives born from inconsistencies in news reporting can directly and negatively impact the individuals in communities devastated by these events (35).
Although we examined the correlates of unofficial communication-channel use in our analyses in study 1, we acknowledge the important role of official channel use during a crisis. Unfortunately, because 96% of respondents in our sample indicated consulting official channels, and roughly 92% indicated trusting these channels somewhat or strongly, the lack of variation precluded our ability to include these variables in our statistical models. Also, we are unable to determine whether participants actively sought—or were passively exposed to—information from different channels. During the lockdown, participants may have sought information (especially during the 90-min gap in communication from campus officials) by accessing news sites and social media, or they might have sent text messages to friends and family to see if they knew any details. However, students could have simultaneously received unsolicited messages via social media or text during this event, in which case their receipt of information could be considered passive. An additional limitation of study 1 was that data collection occurred retrospectively (albeit soon after the event), and we did not employ real-time data collection methods during the lockdown (e.g., ecological momentary assessment), which would have been valuable for assessing exposure to conflicting information and distress responses. To compensate for this, we collected archival Twitter data—before, during, and after the lockdown—from thousands of users in study 2, providing supplemental data that occurred in real time. This supplemental analysis of Twitter data fostered additional depth to our understanding of the crisis event we studied.
Conclusion
Exposure to rumors and conflicting information that arise out of the ambiguity of a crisis may have negative consequences for the people who receive and believe them. Moreover, the extent to which people trust the channels through which unofficial and conflicting information flow may exacerbate distress. Rumor generation during ambiguous crisis events is certain to continue. Therefore, social scientists should study the psychological impact of rumor exposure using methodological triangulation to understand the dynamic contextual features of and community responses to these events. Doing so will help to better elucidate the function and impact of crisis-related communications, or the lack thereof, on distress responses. Science on crisis communications and the media can be an ally in this challenging set of tasks.
Materials and Methods
Study 1.
Sample and procedures.
Beginning 7 days after the campus shooting, undergraduate and graduate students were invited to complete an anonymous, internet-based survey via a system-wide email sent on the researchers’ behalf by the university administration. The survey was fielded to all 40,339 students listed in the university system. A reminder email was sent out a week later to bolster student participation. Participants who clicked the link to the survey were presented with an initial screen indicating that the purpose of the survey was to study the impact of the campus shooting; informed consent was obtained from all individuals included in the study. Participants were asked to complete the survey without consulting others and were instructed to answer items as honestly as possible. Participants were also presented with contact information for the lead researchers and the campus counseling center and encouraged to call or visit the center if they felt a need to speak with someone about their feelings regarding the incident. Data were collected up to 29 days following the shooting, with the majority of responses (92%) collected within 16 days postevent. The participation rate was ∼18% (n = 6,540). Of these, 3,890 (∼60%) students reported having been in the lockdown; between 2,696 and 3,393 of these students had complete information on variables across analyses in study 1. Of the 3,051 students who provided ethnicity data, nearly 40% identified as European American, roughly 30% identified as Asian American, and 14% identified as Latino American; the remainder identified as multiracial/ethnic (8.6%), African American (2.7%), or other (6%). All procedures for this study were approved by the Institutional Review Board of the University of California, Irvine.
Dependent variables.
Acute stress.
Symptoms of acute stress were assessed using the Acute Stress Disorder Scale-5 (21), which is based on the Diagnostic and Statistical Manual of Mental Disorders, fifth edition (DSM-5; ref. 36). Respondents used a 5-point Likert-type scale ranging from 0 (not at all) to 4 (very much) to describe the extent to which they experienced each of 14 possible reactions “since the shooting and lockdown” (e.g., “Do you have distressing dreams about the lockdown/shooting?”). Responses were summed (range, 0–56) to create a continuous score for acute stress symptoms and to capture maximum variability in potential responses (37).
Conflicting information.
Respondents were asked to indicate the extent to which they agreed with the statement. “I received conflicting information from different sources about the details of the shooting.” Responses were measured on a 5-point Likert-type scale ranging from 0 (not at all) to 4 (a great deal). Because no valid information about the event was available to any students during the lockdown, this variable was used as a proxy for rumor exposure.
To validate this assumption, we examined responses to an open-ended survey item that asked “What particular parts of the event were most upsetting to you?” We used an R script to code each response for whether it mentioned the word “rumor.” Those who mentioned rumors reported higher exposure to conflicting information (standardized b = 0.31, SE = 0.04, P < 0.001). To further clarify what participants wrote about rumors, we examined the word pairs (i.e., bigram analysis) that occurred most commonly in the corpus of responses using a text analysis program called Meaning Extraction Helper (38). The four word pairs occurring most commonly were multiple shooter, rumor spread, rumor multiple, and rumor shooter. The words rumors and false information appeared in other responses with less frequency but were also present. Given that many respondents wrote at length, we also conducted a trigram analysis, which analyzes the most common occurrence of three words appearing together across responses. This analysis revealed that “rumor [of] multiple shooters” was the most common response.
Independent variables.
Traditional media and online news.
On a 3-point Likert-type scale (0 = not at all, 1 = some of the time, 2 = most or all of the time), respondents indicated receiving critical updates from radio, television, and online news sites (e.g., CNN, New York Times, TMZ). Responses for each of these channels were dichotomously coded (0 = not at all, 1 = at least some of the time). They were aggregated to form a count of traditional media/online news sites used (range, 0–3).
Direct contact from close others.
On a 3-point Likert-type scale (0 = not at all, 1 = some of the time, 2 = most or all of the time), respondents indicated whether they received critical updates from a group text message from a campus student organization, a text message from a friend, a text message from a family member, a phone call from a friend, and a phone call from a family member. Responses for each of these channels were dichotomously coded (0 = not at all, 1 = at least some of the time). They were aggregated to form a count of direct contact from close others (range, 0–5).
Social media.
On a 3-point Likert-type scale (0 = not at all, 1 = some of the time, 2 = most or all of the time), respondents indicated whether they received critical updates from Twitter, Facebook, Snapchat, Reddit, and Instagram or some other platform not listed. Responses were dichotomously coded (0 = not at all, 1 = at least some of the time). They were aggregated to form a count of social media channels used (range, 0–5).
Channel trust.
For each communication channel students reported using, they were asked to rate how much they trusted it for information about the shooting and lockdown. These ratings were reported on a 5-point Likert-type scale ranging from 1 (strongly distrust) to 5 (strongly trust). That is, if students reported using Twitter, they were asked to rate how much they trusted it for information and critical updates. Trust ratings were averaged across each communication channel category to create a composite of trust for traditional media and online news (α = 0.90), direct contact from close others (α = 0.89), and social media (α = 0.90), respectively.
Relevant covariates.
Prior school shooting experience.
Respondents indicated whether or not they, or someone close to them, ever experienced a school shooting. A total of 16.11% (n = 611) reported previously having such an experience.
Prior trauma exposure.
Respondents were asked whether they personally experienced a natural disaster (e.g., tornado, earthquake), community violence (e.g., shooting, civil unrest), combat during war, or any other form of violence before the shooting. Responses across these four items were summed and ranged from 0–4.
Affiliation with affected department.
To capture psychological proximity to the department where the shooting took place, respondents reported their affiliation with the department. In all, 26.2% (n = 830) indicated being affiliated with the department either by being a department major, minor, having taken classes in the department, or some other reason.
Lockdown event exposure.
Respondents were asked to indicate whether they experienced each of 11 exposures to the lockdown (e.g., “I was in [building name omitted] when the shooting occurred”). Affirmative responses across these items were summed to create an index of event exposure. Responses ranged from 0 to 11 exposures.
Alone.
Respondents indicated whether they were alone or with others during the lockdown. Responses were dummy coded such that if a student indicated being alone, he or she was coded with a 1.
Analytic strategy.
Statistical analyses were conducted in Stata 14 (College Station, TX). A series of ordinary least-squares regression analyses were conducted to examine correlates of acute stress and exposure to conflicting information, respectively. Because a number of collective traumas were prominent in the media during data collection, we opted to control for survey completion week to account for the potential influence of these events on participant responses. We also included statistical controls for age and gender. Descriptive statistics for all model variables are reported in Tables S2 and S3.
Table S2.
Variables | M | SD | % | Min | Max | |
---|---|---|---|---|---|---|
Acute stress | 10.57 | 10.11 | 0 | 56 | ||
Conflicting information exposure | 3.37 | 0.94 | 0 | 4 | ||
Traditional media count | 1.53 | 0.79 | 0 | 3 | ||
Direct contact from friends/family count | 3.22 | 1.41 | 0 | 5 | ||
Social media count* | 1.90 | 1.25 | 0 | 5 | ||
Trust in traditional media† | 4.03 | 0.84 | 1 | 5 | ||
Trust in direct contact from friends/family† | 3.73 | 0.85 | 1 | 5 | ||
Trust in social media* | 3.29 | 0.91 | 1 | 5 | ||
Covariates and sample characteristics | ||||||
Age | 22.43 | 5.05 | 18 | 68 | ||
Survey completion week | 1.88 | 0.71 | 1 | 4 | ||
Prior trauma exposure | 1.06 | 0.88 | 0 | 4 | ||
Lockdown event exposure | 2.60 | 1.43 | 0 | 9 | ||
Prior school shooting exposure | 16 | |||||
Alone during lockdown | 11 | |||||
Department affiliation | 26 | |||||
Gender | ||||||
Female | 67 | |||||
Male | 32 | |||||
Other | 1 |
*
In model 2, complete data were available for 2,696 participants. Mean social media use was 2.22 (SD = 1.07); mean social media trust was 3.29 (SD = 0.91).
†
Sample size varies due to missing data.
Table S3.
Variables | % |
---|---|
Direct contact friends/family | |
Text from campus organization | 68 |
Text from friend | 91 |
Text from family | 76 |
Phone call from friend | 42 |
Phone call from family | 50 |
Social media | |
49 | |
69 | |
Snapchat | 28 |
34 | |
13 |
Traditional media was not included because it was not associated with the extent to which participants felt they received conflicting information.
Study 2.
Twitter user selection.
There are several challenges associated with searching for tweets in a geographic area using the Twitter API. Although Twitter does allow for searching based on geographic coordinates (geotags), only 1–5% of tweets are geotagged. Moreover, it is not currently possible to perform searches for tweets generated more than 3 days before the date of the search. To circumvent these challenges in the context of a campus shooting, researchers have relied on downloading tweets directly from followers of a university’s Twitter account; the efficacy of this technique for approximating users who are likely to be students affiliated with the university has been demonstrated across several incidents of campus violence (23). Thus, on the day of the shooting and lockdown, we used the twitteR package (39) for R (22) to connect to the Twitter API and download the list of the most recent 20,000 followers of (or subscribers to) the university’s main Twitter account and 6,000 followers of the university’s emergency management Twitter account.
We then removed users from this list based on the following criteria: non-English language account, private account (in which case tweets would not be publicly available), “verified” account (usually indicative of high-profile Twitter users or businesses), and accounts with more than 1,000 total tweets (to omit superusers). After employing these exclusion criteria, 13,000 user accounts were available from which to pull tweets. Approximately 2 weeks after the shooting and lockdown, we interfaced with the API and requested the most recent 200 tweets from each user in our trimmed list.
Tweet processing.
We downloaded nearly 2.3 million tweets. We then constrained our analysis to the time frame immediately around the lockdown: approximately 1 hour before the 911 call up until the end of the second hour after the all-clear. Within this 5-hour window of time, we captured 11,617 tweets from 2,863 users. After removing duplicate tweets, we were left with 7,824 tweets from 2,515 users.
Measures.
Rumor tweets.
All tweets generated in the time frame around the lockdown were manually coded for rumors. A coder was instructed to tag tweets in the sample that contained information that was not verified at the time of the lockdown. Given that virtually no information was available during the lockdown, aside from official reminders that the university was on lockdown, the task of identifying rumor tweets was relatively straightforward. In all, 38 tweets with rumors were identified.
Rumor virality.
Every tweet downloaded via the Twitter API comes with a measure of how many times it was retweeted. This measure captures the virality of the tweet over its lifetime and is not tied to its virality at a given time point (e.g., during the lockdown). However, given the targeted nature of this event, virality was likely isolated to the lockdown as there would be no need to retweet any rumors about the lockdown after the all-clear.
Event-related negative emotion.
We analyzed the linguistic content of each tweet using a custom R script that tallied the frequency with which words used in each tweet match words from the LIWC software’s negative emotion dictionary (24). Similar to prior research (23), we also employed an R script that used a 17-item custom word list to automatically identify and tag tweets about the shooting and lockdown. This list included context-specific words (e.g., lockdown, #[university name]strong, #prayfor[university name]) to bolster the script’s efficacy in identifying lockdown-related tweets. Tweets containing at least one negative emotion word and one word referencing the event were coded with a 1 (all others coded with 0).
Analytic strategy.
Data were imported into Stata 14 (College Station, TX) from R (22), and tweets were combined into 15-min blocks across time. The proportion of tweets with event-related negative emotion expression in each 15-min block was calculated. We also calculated the quantity and virality (via retweet counts) of rumor tweets in each block, respectively. Event-related negative emotion expression was plotted across time, and rumor generation count and rumor virality were overlaid, respectively, in two graphs (Figs. 2 and 3).
Note: The university that allowed authors access to the students who served as subjects in study 1 did so with the proviso that the institution under study would not be revealed. Although data were collected anonymously, the identity of the institution and affected department are easily accessible in both the questions asked on the survey as well as in responses provided by subjects. Therefore, we are not allowed to release these data publicly. The affected institution is also clearly identifiable in the tweets analyzed in study 2. Although data cannot be posted publicly, we would be willing to make available to interested readers carefully redacted documentation and data files upon request.
Acknowledgments
We thank Maryann J. Gray, E. Alison Holman, and Dana Rose Garfin for their valuable input at the onset of study 1 and Carly Steinberger for her efforts coding tweets in study 2. We also thank Azim Shariff for his comments on an earlier version of this paper.
Supporting Information
Supporting Information (PDF)
- Download
- 33.94 KB
References
1
JP Blair, KW Schweit A Study of Active Shooter Incidents in the United States Between 2000 and 2013 (US Department of Justice, Federal Bureau of Investigation, Washington, DC, 2014).
2
GW Allport, L Postman, An analysis of rumor. Public Opin Q 10, 501–517 (1946).
3
L Festinger, et al., A study of a rumor: Its origin and spread. Hum Relat 1, 464–486 (1948).
4
RL Rosnow, Inside rumor: A personal journey. Am Psychol 46, 484–496 (1991).
5
SM Fitzhugh, CB Gibson, ES Spiro, CT Butts, Spatio-temporal filtering techniques for the detection of disaster-related communication. Soc Sci Res 59, 137–154 (2016).
6
K Starbird, J Maddock, M Orand, P Achterman, RM Mason, Rumors, false flags, and digital vigilantes: Misinformation on Twitter after the 2013 Boston Marathon bombing. iConference 2014 Proceedings (iSchools, Grandville, MI), pp. 654–662 (2014).
7
SA Taha, K Matheson, H Anisman, H1N1 was not all that scary: Uncertainty and stressor appraisals predict anxiety related to a coming viral threat. Stress Health 30, 149–157 (2014).
8
MW Seeger, S Vennette, RR Ulmer, Media use, information seeking, and reported needs in post crisis contexts. Communication and Terrorism: Public and Media Responses to 9/11, ed BS Greenberg (Hampton, Cresskill, NJ), pp. 53–74 (2002).
9
SJ Ball-Rokeach, ML DeFleur, A dependency model of mass-media effects. Communic Res 3, 3–21 (1976).
10
CY Chen, RY Hong, Intolerance of uncertainty moderates the relation between negative life events and anxiety. Pers Individ Dif 49, 49–53 (2010).
11
JP Mazer, et al., Communication in the face of a school crisis: Examining the volume and content of social media mentions during active shooter incidents. Comput Human Behav 53, 238–248 (2015).
12
L Palen, KM Anderson, Crisis informatics–New data for extraordinary times. Science 353, 224–225 (2016).
13
L Palen, SB Liu, Citizen communications in crisis: Anticipating a future of ICT-supported public participation. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM, New York), pp. 727–736 (2007).
14
AL Hughes, L Palen, Twitter adoption and use in mass convergence and emergency events. Int J Emerg Manag 6, 248–260 (2009).
15
ES Spiro, et al., Rumoring during extreme events: A case study of Deepwater Horizon 2010. Proceedings of the ACM Web Science 2012 Conference (ACM, New York), pp. 275–283 (2012).
16
NM Jones, DR Garfin, EA Holman, RC Silver, Media use and exposure to graphic content in the week following the Boston Marathon bombings. Am J Community Psychol 58, 47–59 (2016).
17
RL Rosnow, JH Yost, JL Esposito, Belief in rumor and likelihood of rumor transmission. Lang Commun 6, 189–194 (1986).
18
EA Holman, DR Garfin, RC Silver, Media’s role in broadcasting acute stress following the Boston Marathon bombings. Proc Natl Acad Sci USA 111, 93–98 (2014).
19
RC Silver, et al., Mental- and physical-health effects of acute exposure to media images of the September 11, 2001, attacks and the Iraq War. Psychol Sci 24, 1623–1634 (2013).
20
WE Schlenger, et al., Psychological reactions to terrorist attacks: Findings from the national study of Americans’ reactions to September 11. JAMA 288, 581–588 (2002).
21
RA Bryant Acute Stress Disorder: What It Is and How to Treat It (Guilford, New York, 2016).
22
; R Core Team, R: A Language and Environment for Statistical Computing (R Foundation for Statistical Computing, Vienna), Version 3.4.1. (2016).
23
NM Jones, SP Wojcik, J Sweeting, RC Silver, Tweeting negative emotion: An investigation of Twitter data in the aftermath of violence on college campuses. Psychol Methods 21, 526–541 (2016).
24
YR Tausczik, JW Pennebaker, The psychological meaning of words: LIWC and computerized text analysis methods. J Lang Soc Psychol 29, 24–54 (2010).
25
R Janoff-Bulman Shattered Assumptions: Towards a New Psychology of Trauma (The Free Press, New York, 1992).
26
JA Whitson, AD Galinsky, Lacking control increases illusory pattern perception. Science 322, 115–117 (2008).
27
RK Henderson, HR Snyder, T Gupta, MT Banich, When does stress help or harm? The effects of stress controllability and subjective stress response on Stroop performance. Front Psychol 3, 179 (2012).
28
S Lewandowsky, UKH Ecker, CM Seifert, N Schwarz, J Cook, Misinformation and its correction: Continued influence and successful debiasing. Psychol Sci Public Interest 13, 106–131 (2012).
29
KK Stephens, AK Barrett, MJ Mahometa, Organizational communication in emergencies: Using multiple channels and sources to combat noise and capture attention. Hum Commun Res 39, 230–251 (2013).
30
MW Seeger, TL Sellnow, RR Ulmer Communication and Organizational Crisis (Praeger, Westport, CT, 2003).
31
S Shuster, Munich police face questions over false tweets during shooting., Available at time.com/4421410/munich-shooting-germany-terrorism-tweets/. Accessed March 13, 2017. (2016).
32
B Fischhoff, Communicating about the risks of terrorism (or anything else). Am Psychol 66, 520–531 (2011).
33
B Reynolds, MW Seeger, Crisis and emergency risk communication as an integrative model. J Health Commun 10, 43–55 (2005).
34
M Del Vicario, et al., The spreading of misinformation online. Proc Natl Acad Sci USA 113, 554–559 (2016).
35
M Wendling, Sandy Hook to Trump: ‘Help us stop conspiracy theorists’. Available at www.bbc.com/news/blogs-trending-39194035. Accessed May 2, 2017. (2017).
36
; American Psychiatric Association Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 5th Ed, Washington, DC, 2013).
37
RC MacCallum, S Zhang, KJ Preacher, DD Rucker, On the practice of dichotomization of quantitative variables. Psychol Methods 7, 19–40 (2002).
38
RL Boyd, MEH: Meaning Extraction Helper [Software] Version 1.4.15. Available at meh.ryanb.cc. Accessed August 16, 2017. (2017).
39
J Gentry, twitteR: R Based Twitter Client. Available at https://cran.r-project.org/web/packages/twitteR/twitteR.pdf. Accessed September 27, 2016. (2015).
Information & Authors
Information
Published in
Classifications
Copyright
Copyright © 2017 the Author(s). Published by PNAS. This open access article is distributed under Creative Commons Attribution-NonCommercial-NoDerivatives License 4.0 (CC BY-NC-ND).
Submission history
Published online: October 17, 2017
Published in issue: October 31, 2017
Keywords
Acknowledgments
We thank Maryann J. Gray, E. Alison Holman, and Dana Rose Garfin for their valuable input at the onset of study 1 and Carly Steinberger for her efforts coding tweets in study 2. We also thank Azim Shariff for his comments on an earlier version of this paper.
Notes
This article is a PNAS Direct Submission.
Authors
Competing Interests
The authors declare no conflict of interest.
Metrics & Citations
Metrics
Citation statements
Altmetrics
Citations
Cite this article
114 (44) 11663-11668,
Export the article citation data by selecting a format from the list below and clicking Export.
Cited by
Loading...
View Options
View options
PDF format
Download this article as a PDF file
DOWNLOAD PDFLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Personal login Institutional LoginRecommend to a librarian
Recommend PNAS to a LibrarianPurchase options
Purchase this article to access the full text.