Team science for science communication

Gabrielle Wong-Parodi; Benjamin H. Strauss

doi:10.1073/pnas.1320021111

New Research In

Edited by Baruch Fischhoff, Carnegie Mellon University, Pittsburgh, PA, and accepted by the Editorial Board April 15, 2014 (received for review November 1, 2013)

Abstract

Natural scientists from Climate Central and social scientists from Carnegie Mellon University collaborated to develop science communications aimed at presenting personalized coastal flood risk information to the public. We encountered four main challenges: agreeing on goals; balancing complexity and simplicity; relying on data, not intuition; and negotiating external pressures. Each challenge demanded its own approach. We navigated agreement on goals through intensive internal communication early on in the project. We balanced complexity and simplicity through evaluation of communication materials for user understanding and scientific content. Early user test results that overturned some of our intuitions strengthened our commitment to testing communication elements whenever possible. Finally, we did our best to negotiate external pressures through regular internal communication and willingness to compromise.

Overcoming the Challenges of Collaboration to Design Effective Science Communication

Science powers the technology behind modern society while also providing a window onto its risks. Individual and policy decisions commonly carry both benefits and costs that science can speak to; for example, burning fossil fuel helps energize our economies while also endangering them by contributing to climate change. When the benefits and costs of an action appear similar, or are not broadly or well understood, we are challenged to make more measured decisions (1 ⇓⇓–4). Having some grasp of the relevant science can help. Decision makers need not be experts, but understanding risks and benefits allows them to make informed decisions reflecting their values (5 ⇓⇓–8). An important aim for many science communications can be to achieve this end, with the goal not of agreement, per se, but of “fewer, better disagreements” (9).

One approach to science communication follows four interrelated steps: identifying relevant science, determining people’s informational needs, designing communications to fill those needs, and evaluating the adequacy of those communications, with refinements until adequacy is demonstrated (9). We believe that collaboration between natural and social scientists increases the chances for success in this approach. Social scientists need natural scientists for their topic area expertise to ensure communications remain true to the science, and natural scientists need social scientists for their expertise to ensure communications are relevant and understandable to lay target audiences. However, natural and social scientists use different languages and methods (10), which can make it difficult to work together even when sharing the same goal of science communication. However, these challenges are surmountable, and overcoming them may yield a productive collaborative relationship as well as stronger communications.

We are part of a team of natural scientists from Climate Central and social scientists from Carnegie Mellon University who have worked together on a communications research and design effort concerning coastal flood risk as aggravated by sea level rise. This effort supported Climate Central’s development of an interactive, Web-based platform to share related information (Surging Seas Risk Finder, at http://sealevel.climatecentral.org/). Over the course of our collaboration, we had to address many challenges. Some can be attributed to differences in disciplinary perspectives, and others arose as a result of forces outside the team’s control.

Overall, the challenges we encountered fell into four main categories: agreeing on goals; balancing complexity and simplicity; relying on data, not intuition; and negotiating external pressures.

The next sections explore each category in turn, beginning with a general discussion and then sharing anecdotes from our own experience.

Challenge 1: Agreeing on Goals

Collaborators who share clear goals and view them as attainable and important are more likely to achieve quality products and satisfaction with the process (11, 12). One common barrier is simple lack of time (13). Others include lack of openness, patience, understanding, trust, and respect between collaborators; unspoken jealousies; or perceived threats to authority or power (14, 15). Individuals tend to conform to the perceived norms or values of the team (16) and may avert conflict by not fully voicing their own opinions. Collective inexperience may leave collaborators unaware of the importance of clearly defining goals (17). Effective internal team communication may also enhance the team’s ability to work more efficiently together, increase the team’s flexibility, and increase their resiliency in the face of external pressures (15).

The Response: Coming to an Agreement on What We Meant By “Effective” Communication.

In our case, the critical issue for agreeing on common goals was how to define an effective communication of flood and sea level risk. Climate Central researchers invited this collaboration out of a sense that many Americans’ interest and understanding about climate change, and more specifically, in this instance, sea-level rise and coastal flood risk, were not commensurate with the risk. Carnegie Mellon University questioned how anyone could decide what exactly the “right” level of concern is for another person. After a series of conversations, we settled on the goal of providing lay audiences with the information needed to demonstrate knowledge, make logical inferences, and show consistency in preferences.

Knowledge can be assessed through information recall (e.g., “What is the likelihood of there being at least one flood between today and 2020 that is 3 feet?”) (18). The ability to make logical inferences can be assessed through problem-solving tasks (e.g., after showing people the likelihood of a 10-foot flood, asking, “What is the likelihood of an 11-foot flood?”) (19). Consistency can be measured by asking a question in several different ways (e.g., asking participants what level of flood risk they would tolerate and separately asking whether they would move to a place where risk exceeds this level, according to information presented earlier) (20).

In other words, we reached a shared definition of “effective” communications; namely, ones that help people make informed decisions, reflective of their own unique situations and values, rather than communications that push people to make persuaded decisions, reflective of some outside vision of what the decision should be. Furthermore, this early work to define shared goals laid the groundwork for more effective and efficient team communication throughout the project.

Challenge 2: Balancing Complexity and Simplicity

A general challenge for science communications is to stay true to the science, and its complexity, while still allowing most lay audiences to understand it (21). The degree of simplification that can be required often dwarfs what scientists anticipate (22).

Understandability may be enhanced by following “best practices” of science communications (23). For example, to convey probabilistic risk information about sea level rise, communicators can turn to numeracy research. Research on the ability to understand and use numbers has shown that people better understand probabilistic information as denominators of base 10 (e.g., “20 in 100 chance that a region will experience sea level rise of 3 feet between today and 2050”) compared with when the same information is presented using 1 of N (e.g., “1 in 5 chance that a region will experience sea level rise of 3 feet between today and 2050”) (24). Observed differences in understanding can be attributed to the relative ease with which people translate base values into percentages (25). Testing communications with lay target audiences (26) allows refining as needed and may further enhance these initial drafts.

The Response: Understanding the Risk for Coastal Flood Aggravated By Sea Level Rise.

Perhaps the biggest challenge of our project was how to present Climate Central’s extensive and complex set of forecast and exposure analyses in a digestible way that effectively informs decisions affected by future coastal flooding risk. Our practical objective was to inform the development of Climate Central’s interactive Web-based platform, the Surging Seas Risk Finder, which would be (and now is) freely available to the general public.

At the start of our work together, Climate Central shared with Carnegie Mellon University a sketch indicative of the data that were available to share and that might be included in a Web platform (Fig. 1). Our joint project focused on forecasts. Climate Central had generated sea level and flood risk projections for 55 water level stations along US coasts from 2012 to 2100, at 10 different water levels ranging from 1 to 10 feet. The analysis assessed annual risk, cumulative risk, and how warming-driven sea level rise will multiply risk. In addition, Climate Central generated results conditional on carbon dioxide emissions scenarios (e.g., low, medium, or high) and sea level rise models. We quickly judged that presenting all of this information together at once would confuse nonexperts. After several team discussions, Climate Central determined that it would be worth exploring the design of a pared down, simplified presentation. This version would show users a small number of basic options up front that they could adjust on an advanced settings page, allowing exploration of more complex and nuanced information.

Fig. 1.

Original sketch of the intended science communication, showing the full range of science information about coastal flooding available and the many options for users to tailor the display to fit their specific needs. Pct, percentage; FEMA, Federal Emergency Management Agency.

To assess user understanding of the most basic elements, we developed a simplified experimental online tool following relevant best practices from the science communications literature (23). For example, we made the tool interactive (allowing users to adjust water level), consistent with evidence suggesting the power of experiential learning (27).

One design issue that warranted empirical evaluation was the effect of time frame. Focusing on just a single period would allow a simplification of the online presentation. Sea level rise and flood risk projections become much more dramatic toward the end of the century, suggesting that a longer time would increase perceived risk. However, research on psychological distance finds that the farther in the future the consequences of a decision appear to be, the less relevant and urgent the decision feels (28). In turn, people are less likely to fully process and understand information relating to decisions they believe lack urgency (29, 30). To explore whether temporal distance affected understanding, users’ understanding was assessed across three time horizons: projections for 2020, 2050, and 2100 (31). Each user saw just a single time frame (Fig. 2). Of course, long periods entail larger cumulative risks (32). Therefore, to the extent that our participants expressed differences in perceived risk, any observed differences in understanding could reflect both cumulative risk and temporal distance. We did not find, however, any differences in understanding between the three time frames.

Fig. 2.

Simplified Risk Finder mockup tool showing risk profile information for the periods between today and 2020 (Left) and between today and 2100 (Right) for Baldwin County, Alabama.

We then piloted the tool by performing user testing, following the Think Aloud Protocol (33). We recruited 10 US adult participants through Carnegie Mellon University’s Center for Behavioral and Decision Research Participant Pool. The center maintains a pool of participants drawn from the City of Pittsburgh and the surrounding areas, representing a wide range of socioeconomic backgrounds. Half the participants were women, and most had at least some college education. Interviews were audiorecorded, transcribed, and analyzed for understanding of key terms and concepts (e.g., sea level rise), preferences for terms (e.g., slow sea level rise versus optimistic sea level rise), and preferences for layout.

Using this approach, we asked participants what they were doing, thinking, and feeling as they interacted with the tool. Thus, we were able to adjust ineffective design elements informed by these interviews and to further test and refine language and the presentation of quantitative information that was not being well understood.

Finally, we evaluated the refined tool with a larger sample of participants. We recruited 149 adult members of the US general public through Amazon’s Mechanical Turk. Their average age was 36.1 years (standard deviation, 13.0 years), with 47.7% being women, 79.2% identifying as White or Caucasian, 48.4% having at least a bachelor’s degree, and 42.2% having household incomes of at least $51K. Most reported being Democrats, at 51%, with 28.2% independents, 16.8% Republicans, and 4% other or “prefer not to answer.” Some reported having lived on the coast (37.6%), and most had vacationed there (71.8%). Many reported some familiarity with the coastline (34.1%), having experienced a hurricane (44.3%) or flood or knowing someone who had (36.9%). Responses to the three time frames were pooled with the exception of the few cases in which they differed significantly. Using statistics, responses were evaluated through three criteria: knowledge, consistency, and active mastery. A manuscript describing this work is currently under review.

After these participants interacted with the platform, we administered an assessment of their knowledge (e.g., “What is the likelihood of there being at least one flood between today and 2020 that is 3 feet?” requires participants to accurately recall information), ability to make logical inferences (e.g., “What is the likelihood of an 11-foot flood?” requires people to extrapolate beyond the tool maximum of 10 feet), and consistency in responses (e.g., asking participants what level of flood risk they would tolerate and separately asking whether they would move to a place where risk exceeds this level, according to information presented earlier).

Challenge 3: Relying on Data, Not Intuition

One common trap that natural and social scientists can fall into is to rely too heavily on their intuition in the design of science communication. Studies have shown that ill-designed science communications can have no effect or can even lead to misunderstandings, misperceptions, and mistrust (34, 35). Designers can forget that their audiences may not share the same scientific language, and therefore may misunderstand or tune out messages that include complex scientific language or visuals. Designers can also forget that people may not understand or respond to science information in the way they expect, which may seem irrational at face value (appearing as biased judgments or hyperbolic discounting), but which may make sense to the recipient, given their personal situations and values (36, 37). Thus, a major challenge facing collaborators is the natural inclination to rely on intuition rather than on data in the design of science communication (38 ⇓–40).

Data-driven assessments can take many forms, including interviews, surveys, focus groups, and randomized controlled trials (23, 41). Interviews or focus groups can be performed with a small number of individuals from the lay target audience, providing insight into the understandability of science communications through their answers about what makes sense, what does not, and why. Informed by these results, surveys of a larger and more diverse sample of the lay target audience can be conducted to assess understanding more widely. Finally, randomized controlled trials can then be used to evaluate the effectiveness of different variants of the communication.

The Response: Learning How to Let Go of Our Intuition and Listen to What the Data Tell Us.

One concept Climate Central wanted to convey through its final tool was the wide range of possible future sea level rise scenarios (42). Therefore, the team tested ways of presenting three different scenarios drawn from a recent report (43): 0.5, 1.2, or 2.0 m sea level rise by 2100.

On the basis of the risk communication literature on numeracy (44, 45), literacy (46, 47), and compelling presentation (48 ⇓–50), the team created three terms we believed would help people quickly understand the underlying concept so that they could better interpret the risk information: optimistic (0.5 m), neutral (1.2 m), and pessimistic (2.0 m) sea level rise.

We then conducted semistructured interviews with members of the Carnegie Mellon University’s Center for Behavioral and Decision Research Participant Pool. We matched the terms with basic descriptors (“optimistic” with “slow rise,” “neutral” with “medium rise,” and “pessimistic” with “fast rise”) and showed our participants the matched sets in randomized order. After each term, we asked participants to tell us what came to mind as well as to provide a numerical estimate of the rate of sea level rise. At the end, we asked participants to rank their preference for the terms in each matched set (e.g., “optimistic” versus “slow rise”).

What we found contradicted our intuition. We thought that using an emotionally compelling word like optimistic, rather than slow, would help people understand the underlying concept of rate. Instead, we found that people thought “slow” was a more accurate term than “optimistic,” which made them think there was no sea level rise. We found that people understood “fast” and “pessimistic,” with “pessimistic” making them feel more concerned. However, we also found “fast” made them feel hopeful, as though something could still be done about sea level rise, whereas “pessimistic” made them feel like giving up because all hope is lost. Finally, we found that people thought “medium” was a more accurate term than “neutral,” which was seen as a contradiction in terms because it meant there was no sea level rise taking place. In short, although we found that the use of emotional terms was evocative, it seemed to get in the way of understanding the concept we were trying to convey.

Challenge 4: Negotiating External Pressures

Even collaborators who agree on an ideal process for design (i.e., identify relevant science, determine the audience’s informational needs, target those informational needs, and iteratively evaluate the adequacy of test communications) are subject to external forces that may make it hard for them to do so. Pressures can come from collaborators’ institutional homes, funding sources, or even world events (e.g., natural disasters such as Superstorm Sandy) (12, 13, 15).

Building resilience to external pressures can be difficult. These pressures may play differently on specific members of the team, which may lead to intragroup conflict about how the research should proceed and what the final product should look like. For example, if the scientific topic is relevant to major current events or decisions, there may be external pressure to disseminate the communication before the team has completed its research (e.g., testing for understanding). Team members may also disagree internally over the tradeoff between quality and speed, worried that delay may result in missed opportunities to inform consequential decisions. Although agreeing before such conflicts arise as to how a team will proceed in such cases is ideal, there may be instances in which bringing an outside person to mediate might be warranted. In transdisciplinary research, mediators have helped collaborators to define what could and should be done (51), as well as to note and vocalize points of consensus (52), thereby helping the team overcome intragroup conflict.

The Response: Forces Shaping the Design of the Sea Level Tool.

Of the external pressures facing our team, the most challenging pressure had to do with time. The official launch date for Climate Central’s tool was to be fall 2013, and we began our collaboration in January 2013. In addition, Climate Central was contracting in parallel with a Web design team, which was a necessity because of the launch timeline and the complexity of the information to be presented.

The result of the study described under Challenge 2: Balancing Complexity and Simplicity demonstrated that presenting the content in question with a 2050 time horizon is both compelling and understandable. One limitation of the study is that we showed risk information from only a single water level station, and thus we could not conclude that 2050 would be a “sweet spot” year for stations with different time patterns of risk. Given the tight timeline, we could not investigate further. Furthermore, Climate Central wanted to present risk information across a wide time horizon (by decade, from 2020 to 2100) to service diverse user interests; whereas Carnegie Mellon University felt it was premature to present such granular information. Climate Central decided to present the fine-grained information but, at the same time, include language to more clearly communicate that the risk at each point differs, with a simple sentence or phrase (as shown in Fig. 3). We agreed that if future research were to indicate that the 2050 findings apply widely, then Climate Central would look to emphasize this time frame in other content, such as press releases or fact sheets.

Fig. 3.

Draft Surging Seas page showing the total risk for a 3-foot coastal flood forecast, including sea level rise, with descriptors, by decade.

Conclusions

Effective science communication benefits when collaborators fulfill four interrelated tasks: identifying relevant science, determining people’s informational needs, designing communications to fill those needs, and evaluating the adequacy of those communications. A number of challenges may arise when natural and social scientists work together, even when both parties share the same goal of effective science communication. Here we present the four main challenges we encountered during our collaboration: agreeing on goals; balancing complexity and simplicity; relying on data, not intuition; and negotiating external pressures. We present a brief description of each challenge, describing its nature and the importance of dealing with it, and reflect on our own personal experience.

In the process of our collaboration, we navigated agreement on goals through intensive within-team communication early in the project. We balanced complexity and simplicity through evaluation of the communication for understanding and scientific content. We addressed the challenge of relying on data, not intuition, by agreeing on the value of testing. Finally, we did our best to negotiate external pressures through communication and compromise. Inevitably, we were able to investigate only a fraction of the design elements needed for Climate Central’s full Web tool and communications needs, but our joint research identified and addressed problems that otherwise could have reduced the effectiveness of the website.

Collaborations between natural and social scientists face many challenges in achieving effective science communications, but effort wins rewards. When contributors from different disciplines work together, they may grow to appreciate other ways of looking at the world and creating knowledge, perhaps leading to new or innovative research directions. More important, effective collaboration increases the chances for effective communication to the public, thereby facilitating people’s ability to make more informed decisions, reflective of their values, hoping for “fewer, better disagreements” (9) about challenging decisions they face in their personal lives, as well as those facing our society.

Acknowledgments

We thank Alex Engel and Tamar Krishnamurti for their helpful comments. The research described in this paper was supported by the Rockefeller Foundation and the National Science Foundation's Center for Climate and Energy Decision-Making [NSF 09-554].

Footnotes

↵¹To whom correspondence should be addressed. Email: gwongpar{at}cmu.edu.

Author contributions: G.W.-P. and B.H.S. designed research; G.W.-P. performed research; G.W.-P. and B.H.S. contributed new reagents/analytic tools; G.W.-P. analyzed data; and G.W.-P. and B.H.S. wrote the paper.
The authors declare no conflict of interest.
This paper results from the Arthur M. Sackler Colloquium of the National Academy of Sciences, “The Science of Science Communication II,” held September 23–25, 2013, at the National Academy of Sciences in Washington, DC. The complete program and video recordings of most presentations are available on the NAS website at www.nasonline.org/science-communication-II.
This article is a PNAS Direct Submission. B.F. is a guest editor invited by the Editorial Board.

View Abstract

References

↵
1. Morgan MG,
2. Fischhoff B,
3. Bostrom A,
4. Atman CJ
(2001) Risk Communication: A Mental Models Approach (Cambridge University Press, UK).
.
↵
1. Downs JS,
2. et al.
(2004) Interactive video behavioral intervention to reduce adolescent females’ STD risk: A randomized controlled trial. Soc Sci Med 59(8):1561–1572.
.
OpenUrl CrossRef PubMed
↵
1. Bostrom A,
2. Fischhoff B,
3. Morgan MG
(1992) Characterizing mental models of hazardous processes: A methodology and an application to radon. J Soc Issues 48(4):85–100.
.
OpenUrl CrossRef
↵
1. Klima K,
2. Morgan MG,
3. Grossman I,
4. Emanuel K
(2011) Does it make sense to modify tropical cyclones? A decision-analytic assessment. Env Sci Tech 45(10):4242–4248.
.
OpenUrl CrossRef
↵
1. Braddock CH 3rd,
2. Edwards KA,
3. Hasenberg NM,
4. Laidley TL,
5. Levinson W
(1999) Informed decision making in outpatient practice: Time to get back to basics. JAMA 282(24):2313–2320.
.
OpenUrl CrossRef PubMed
↵
1. de Best-Waldhober M,
2. Daamen D,
3. Faaij A
(2009) Informed and uninformed public opinions on CO₂ capture and storage technologies in the Netherlands. Int J Greenh Gas Control 3(3):322–332.
.
OpenUrl CrossRef
↵
1. Lusardi A
(2008) Financial Literacy: An Essential Tool for Informed Consumer Choice? (No. w14084) (National Bureau of Economic Research, Cambridge, MA).
.
↵
1. Ver Steegh N
(2002) Yes, no, and maybe: Informed decision making about divorce mediation in the presence of domestic violence. Wm & Mary J Women & L 9:145.
.
OpenUrl
↵
1. Fischhoff B
(2013) The sciences of science communication. Proc Natl Acad Sci USA 110(Suppl 3):14033–14039.
.
OpenUrl Abstract/FREE Full Text
↵
1. Hara N,
2. Solomon P,
3. Kim SL,
4. Sonnenwald DH
(2003) An emerging view of scientific collaboration: Scientists' perspectives on collaboration and factors that impact collaboration. J Am Soc Inf Sci Technol 54(10):952–965.
.
OpenUrl CrossRef
↵
1. Barnes T,
2. Pashby I,
3. Gibbons A
(2002) Effective University-Industry interaction: A multi-case evaluation of collaborative R&D projects. Eur Manage J 20(3):272–285.
.
OpenUrl CrossRef
↵
1. Stokols D
(2006) Toward a science of transdisciplinary action research. Am J Community Psychol 38(1-2):63–77.
.
OpenUrl CrossRef PubMed
↵
1. Mâsse LC,
2. et al.
(2008) Measuring collaboration and transdisciplinary integration in team science. Am J Prev Med 35(Suppl 2):S151–S160.
.
OpenUrl CrossRef PubMed
↵
1. Kelly MJ,
2. Schaan JL,
3. Joncas H
(2002) Managing alliance relationships: Key challenges in the early stages of collaboration. R & D Manag 32(1):11–22.
.
OpenUrl CrossRef
↵
1. Naiman RJ
(1999) A perspective on interdisciplinary science. Ecosystems (N Y) 2:292–295.
.
OpenUrl CrossRef
↵
1. Gilbert DT,
2. Fiske ST,
3. Lindze G
1. Cialdini RB,
2. Trost MR
(1998) in The Handbook of Social Psychology, eds Gilbert DT, Fiske ST, Lindze G (McGraw-Hill, New York), 4th Ed, Vol 1 and 2, pp 151–192.
.
OpenUrl
↵
1. Stokols D,
2. Misra S,
3. Moser RP,
4. Hall KL,
5. Taylor BK
(2008) The ecology of team science: Understanding contextual influences on transdisciplinary collaboration. Am J Prev Med 35(Suppl 2):S96–S115.
.
OpenUrl CrossRef PubMed
↵
1. Todd P,
2. Benbasat I
(1992) The use of information in decision making: An experimental investigation of the impact of computer-based decision aids. MIS Q 16(13):373–393.
.
OpenUrl CrossRef
↵
1. Anderson JR
(1993) Problem solving and learning. Am Psychol 48(1):35–44.
.
OpenUrl CrossRef
↵
1. O’Connor AM,
2. Légaré F,
3. Stacey D
(2003) Risk communication in practice: The contribution of decision aids. BMJ 327(7417):736–740.
.
OpenUrl FREE Full Text
↵
1. Weaver W
(1948) Science and complexity. Am Sci 36(4):536–544.
.
OpenUrl PubMed
↵
1. Treise D,
2. Weigold MF
(2002) Advancing Science Communication A Survey of Science Communicators. Sci Commun 23(3):310–322.
.
OpenUrl Abstract/FREE Full Text
↵
1. Stocklmayer SM,
2. Gore MM,
3. Bryant CR
, eds (2001) Science Communication in Theory and Practice (Kluwer Academic Publishers, Netherlands), Vol 14.
.
↵
1. Lipkus IM
(2007) Numeric, verbal, and visual formats of conveying health risks: Suggested best practices and future recommendations. Med Decis Making 27(5):696–713.
.
OpenUrl Abstract/FREE Full Text
↵
1. Cuite CL,
2. Weinstein ND,
3. Emmons K,
4. Colditz G
(2008) A test of numeric formats for communicating risk probabilities. Med Decis Making 28(3):377–384.
.
OpenUrl Abstract/FREE Full Text
↵
1. Mertens DM
(2009) Research and Evaluation in Education and Psychology: Integrating Diversity with Quantitative, Qualitative, and Mixed Methods (Sage Publications, Thousand Oaks, CA).
.
↵
1. Beard CM,
2. Wilson JP
(2002) The Power of Experiential Learning (Kogan Page Publishers, London).
.
↵
1. Trope Y,
2. Liberman N
(2010) Construal-level theory of psychological distance. Psychol Rev 117(2):440–463.
.
OpenUrl CrossRef PubMed
↵
1. Wade SE
(2001) Research on importance and interest: Implications for curriculum development and future research. Educ Psychol Rev 13(3):243–261.
.
OpenUrl CrossRef
↵
1. Hidi S
(1990) Interest and its contribution as a mental resource for learning. Rev Educ Res 60(4):549–571.
.
OpenUrl CrossRef
↵
1. Spence A,
2. Poortinga W,
3. Pidgeon N
(2012) The psychological distance of climate change. Risk Anal 32(6):957–972.
.
OpenUrl CrossRef PubMed
↵
1. Slovic P,
2. Fischhoff B,
3. Lichtenstein S
(1978) Accident probabilities and seat belt usage: A psychological perspective. Accid Anal Prev 10(4):281–285.
.
OpenUrl CrossRef
↵
1. Ericsson KA,
2. Simon HA
(1980) Verbal reports as data. Psychol Rev 87(3):215–251.
.
OpenUrl CrossRef
↵
1. Friedman DB,
2. Corwin SJ,
3. Dominick GM,
4. Rose ID
(2009) African American men’s understanding and perceptions about prostate cancer: Why multiple dimensions of health literacy are important in cancer communication. J Community Health 34(5):449–460.
.
OpenUrl CrossRef PubMed
↵
1. Tan HT,
2. Wang E,
3. Zhou B
(2013) How Does Readability Influence Investors' Judgments? Consistency of Benchmark Performance Matters (Social Science Research Network, Rochester, NY).
.
↵
1. Wynne B
(2001) Creating public alienation: Expert cultures of risk and ethics on GMOs. Sci Cult (Lond) 10(4):445–481.
.
OpenUrl CrossRef PubMed
↵
1. Marris C
(2001) Public views on GMOs: Deconstructing the myths. Stakeholders in the GMO debate often describe public opinion as irrational. But do they really understand the public? EMBO Rep 2(7):545–548.
.
OpenUrl FREE Full Text
↵
1. Cook G,
2. Pieri E,
3. Robbins PT
(2004) ‘The scientists think and the public feels’: Expert perceptions of the discourse of GM food. Discourse Soc 15(4):433–449.
.
OpenUrl Abstract
↵
1. Cosmides L,
2. Tooby J
(1994) Beyond intuition and instinct blindness: Toward an evolutionarily rigorous cognitive science. Cognition 50(1-3):41–77.
.
OpenUrl CrossRef PubMed
↵
1. Myers DG
(2004) Intuition: Its Powers and Perils (Yale University Press, New Haven, CT).
.
↵
1. Merton RK
(1987) The focussed interview and focus groups: Continuities and discontinuities. Public Opin Q 51(4):550–566.
.
OpenUrl Abstract/FREE Full Text
↵
1. Meehl GA,
2. et al.
(2005) How much more global warming and sea level rise? Science 307(5716):1769–1772.
.
OpenUrl Abstract/FREE Full Text
↵
1. Parris A,
2. et al.
(2012) Global Sea Level Rise Scenarios for the United States National Climate Assessment (National Oceanic and Atmospheric Administration, Silver Spring, MD) NOAA Technical Report OAR CPO-1.
.
↵
1. Reyna VF,
2. Nelson WL,
3. Han PK,
4. Dieckmann NF
(2009) How numeracy influences risk comprehension and medical decision making. Psychol Bull 135(6):943–973.
.
OpenUrl CrossRef PubMed
↵
1. Peters E,
2. Hart PS,
3. Fraenkel L
(2011) Informing patients: The influence of numeracy, framing, and format of side effect information on risk perceptions. Med Decis Making 31(3):432–436.
.
OpenUrl Abstract/FREE Full Text
↵
1. Davis TC,
2. et al.
(2006) Low literacy impairs comprehension of prescription drug warning labels. J Gen Intern Med 21(8):847–851.
.
OpenUrl CrossRef PubMed
↵
1. Fischhoff B,
2. Brewer N,
3. Downs JS
(2011) Communicating Risks and Benefits: An Evidence-Based User Guide (Food and Drug Administration, Washington, DC).
.
↵
1. Baldwin RS,
2. Peleg-Bruckner Z,
3. McClintock AH
(1985) Effects of topic interest and prior knowledge on reading comprehension. Read Res Q 20(4):497–504.
.
OpenUrl CrossRef
↵
1. Ackerman PL
(1996) A Theory of adult intellectual development: Process, personality, interests, and knowledge. Intelligence 22(2):227–257.
.
OpenUrl CrossRef
↵
1. Wong-Parodi G,
2. Dowlatabadi H,
3. McDaniels T,
4. Ray I
(2011) Influencing attitudes toward carbon capture and sequestration: A social marketing approach. Environ Sci Technol 45(16):6743–6751.
.
OpenUrl CrossRef PubMed
↵
1. Thompson JK
(2004) Prospects for transdisciplinarity. Futures 36(4):515–526.
.
OpenUrl CrossRef
↵
1. Rasmussen B,
2. Andersen PD,
3. Borch K
(2010) Managing transdisciplinarity in strategic foresight. Creat Innov Manag 19(1):37–46.
.
OpenUrl CrossRef

Article Alerts

Email Article

Citation Tools

Request Permissions

Proceedings of the National Academy of Sciences: 111 (Supplement 4)

Table of Contents

Submit

[1] ↵
Morgan MG,
Fischhoff B,
Bostrom A,
Atman CJ
(2001) Risk Communication: A Mental Models Approach (Cambridge University Press, UK).
.

[2] Morgan MG,

[3] Fischhoff B,

[4] Bostrom A,

[5] Atman CJ

[6] ↵
Downs JS,
et al.
(2004) Interactive video behavioral intervention to reduce adolescent females’ STD risk: A randomized controlled trial. Soc Sci Med 59(8):1561–1572.
.
OpenUrl CrossRef PubMed

[7] Downs JS,

[8] et al.

[9] ↵
Bostrom A,
Fischhoff B,
Morgan MG
(1992) Characterizing mental models of hazardous processes: A methodology and an application to radon. J Soc Issues 48(4):85–100.
.
OpenUrl CrossRef

[10] Bostrom A,

[11] Fischhoff B,

[12] Morgan MG

[13] ↵
Klima K,
Morgan MG,
Grossman I,
Emanuel K
(2011) Does it make sense to modify tropical cyclones? A decision-analytic assessment. Env Sci Tech 45(10):4242–4248.
.
OpenUrl CrossRef

[14] Klima K,

[15] Morgan MG,

[16] Grossman I,

[17] Emanuel K

[18] ↵
Braddock CH 3rd,
Edwards KA,
Hasenberg NM,
Laidley TL,
Levinson W
(1999) Informed decision making in outpatient practice: Time to get back to basics. JAMA 282(24):2313–2320.
.
OpenUrl CrossRef PubMed

[19] Braddock CH 3rd,

[20] Edwards KA,

[21] Hasenberg NM,

[22] Laidley TL,

[23] Levinson W

[24] ↵
de Best-Waldhober M,
Daamen D,
Faaij A
(2009) Informed and uninformed public opinions on CO₂ capture and storage technologies in the Netherlands. Int J Greenh Gas Control 3(3):322–332.
.
OpenUrl CrossRef

[25] de Best-Waldhober M,

[26] Daamen D,

[27] Faaij A

[28] ↵
Lusardi A
(2008) Financial Literacy: An Essential Tool for Informed Consumer Choice? (No. w14084) (National Bureau of Economic Research, Cambridge, MA).
.

[29] Lusardi A

[30] ↵
Ver Steegh N
(2002) Yes, no, and maybe: Informed decision making about divorce mediation in the presence of domestic violence. Wm & Mary J Women & L 9:145.
.
OpenUrl

[31] Ver Steegh N

[32] ↵
Fischhoff B
(2013) The sciences of science communication. Proc Natl Acad Sci USA 110(Suppl 3):14033–14039.
.
OpenUrl Abstract/FREE Full Text

[33] Fischhoff B

[34] ↵
Hara N,
Solomon P,
Kim SL,
Sonnenwald DH
(2003) An emerging view of scientific collaboration: Scientists' perspectives on collaboration and factors that impact collaboration. J Am Soc Inf Sci Technol 54(10):952–965.
.
OpenUrl CrossRef

[35] Hara N,

[36] Solomon P,

[37] Kim SL,

[38] Sonnenwald DH

[39] ↵
Barnes T,
Pashby I,
Gibbons A
(2002) Effective University-Industry interaction: A multi-case evaluation of collaborative R&D projects. Eur Manage J 20(3):272–285.
.
OpenUrl CrossRef

[40] Barnes T,

[41] Pashby I,

[42] Gibbons A

[43] ↵
Stokols D
(2006) Toward a science of transdisciplinary action research. Am J Community Psychol 38(1-2):63–77.
.
OpenUrl CrossRef PubMed

[44] Stokols D

[45] ↵
Mâsse LC,
et al.
(2008) Measuring collaboration and transdisciplinary integration in team science. Am J Prev Med 35(Suppl 2):S151–S160.
.
OpenUrl CrossRef PubMed

[46] Mâsse LC,

[47] et al.

[48] ↵
Kelly MJ,
Schaan JL,
Joncas H
(2002) Managing alliance relationships: Key challenges in the early stages of collaboration. R & D Manag 32(1):11–22.
.
OpenUrl CrossRef

[49] Kelly MJ,

[50] Schaan JL,

[51] Joncas H

[52] ↵
Naiman RJ
(1999) A perspective on interdisciplinary science. Ecosystems (N Y) 2:292–295.
.
OpenUrl CrossRef

[53] Naiman RJ

[54] ↵
Gilbert DT,
Fiske ST,
Lindze G
Cialdini RB,
Trost MR
(1998) in The Handbook of Social Psychology, eds Gilbert DT, Fiske ST, Lindze G (McGraw-Hill, New York), 4th Ed, Vol 1 and 2, pp 151–192.
.
OpenUrl

[55] Gilbert DT,

[56] Fiske ST,

[57] Lindze G

[58] Cialdini RB,

[59] Trost MR

[60] ↵
Stokols D,
Misra S,
Moser RP,
Hall KL,
Taylor BK
(2008) The ecology of team science: Understanding contextual influences on transdisciplinary collaboration. Am J Prev Med 35(Suppl 2):S96–S115.
.
OpenUrl CrossRef PubMed

[61] Stokols D,

[62] Misra S,

[63] Moser RP,

[64] Hall KL,

[65] Taylor BK

[66] ↵
Todd P,
Benbasat I
(1992) The use of information in decision making: An experimental investigation of the impact of computer-based decision aids. MIS Q 16(13):373–393.
.
OpenUrl CrossRef

[67] Todd P,

[68] Benbasat I

[69] ↵
Anderson JR
(1993) Problem solving and learning. Am Psychol 48(1):35–44.
.
OpenUrl CrossRef

[70] Anderson JR

[71] ↵
O’Connor AM,
Légaré F,
Stacey D
(2003) Risk communication in practice: The contribution of decision aids. BMJ 327(7417):736–740.
.
OpenUrl FREE Full Text

[72] O’Connor AM,

[73] Légaré F,

[74] Stacey D

[75] ↵
Weaver W
(1948) Science and complexity. Am Sci 36(4):536–544.
.
OpenUrl PubMed

[76] Weaver W

[77] ↵
Treise D,
Weigold MF
(2002) Advancing Science Communication A Survey of Science Communicators. Sci Commun 23(3):310–322.
.
OpenUrl Abstract/FREE Full Text

[78] Treise D,

[79] Weigold MF

[80] ↵
Stocklmayer SM,
Gore MM,
Bryant CR
, eds (2001) Science Communication in Theory and Practice (Kluwer Academic Publishers, Netherlands), Vol 14.
.

[81] Stocklmayer SM,

[82] Gore MM,

[83] Bryant CR

[84] ↵
Lipkus IM
(2007) Numeric, verbal, and visual formats of conveying health risks: Suggested best practices and future recommendations. Med Decis Making 27(5):696–713.
.
OpenUrl Abstract/FREE Full Text

[85] Lipkus IM

[86] ↵
Cuite CL,
Weinstein ND,
Emmons K,
Colditz G
(2008) A test of numeric formats for communicating risk probabilities. Med Decis Making 28(3):377–384.
.
OpenUrl Abstract/FREE Full Text

[87] Cuite CL,

[88] Weinstein ND,

[89] Emmons K,

[90] Colditz G

[91] ↵
Mertens DM
(2009) Research and Evaluation in Education and Psychology: Integrating Diversity with Quantitative, Qualitative, and Mixed Methods (Sage Publications, Thousand Oaks, CA).
.

[92] Mertens DM

[93] ↵
Beard CM,
Wilson JP
(2002) The Power of Experiential Learning (Kogan Page Publishers, London).
.

[94] Beard CM,

[95] Wilson JP

[96] ↵
Trope Y,
Liberman N
(2010) Construal-level theory of psychological distance. Psychol Rev 117(2):440–463.
.
OpenUrl CrossRef PubMed

[97] Trope Y,

[98] Liberman N

[99] ↵
Wade SE
(2001) Research on importance and interest: Implications for curriculum development and future research. Educ Psychol Rev 13(3):243–261.
.
OpenUrl CrossRef

[100] Wade SE

[101] ↵
Hidi S
(1990) Interest and its contribution as a mental resource for learning. Rev Educ Res 60(4):549–571.
.
OpenUrl CrossRef

[102] Hidi S

[103] ↵
Spence A,
Poortinga W,
Pidgeon N
(2012) The psychological distance of climate change. Risk Anal 32(6):957–972.
.
OpenUrl CrossRef PubMed

[104] Spence A,

[105] Poortinga W,

[106] Pidgeon N

[107] ↵
Slovic P,
Fischhoff B,
Lichtenstein S
(1978) Accident probabilities and seat belt usage: A psychological perspective. Accid Anal Prev 10(4):281–285.
.
OpenUrl CrossRef

[108] Slovic P,

[109] Fischhoff B,

[110] Lichtenstein S

[111] ↵
Ericsson KA,
Simon HA
(1980) Verbal reports as data. Psychol Rev 87(3):215–251.
.
OpenUrl CrossRef

[112] Ericsson KA,

[113] Simon HA

[114] ↵
Friedman DB,
Corwin SJ,
Dominick GM,
Rose ID
(2009) African American men’s understanding and perceptions about prostate cancer: Why multiple dimensions of health literacy are important in cancer communication. J Community Health 34(5):449–460.
.
OpenUrl CrossRef PubMed

[115] Friedman DB,

[116] Corwin SJ,

[117] Dominick GM,

[118] Rose ID

[119] ↵
Tan HT,
Wang E,
Zhou B
(2013) How Does Readability Influence Investors' Judgments? Consistency of Benchmark Performance Matters (Social Science Research Network, Rochester, NY).
.

[120] Tan HT,

[121] Wang E,

[122] Zhou B

[123] ↵
Wynne B
(2001) Creating public alienation: Expert cultures of risk and ethics on GMOs. Sci Cult (Lond) 10(4):445–481.
.
OpenUrl CrossRef PubMed

[124] Wynne B

[125] ↵
Marris C
(2001) Public views on GMOs: Deconstructing the myths. Stakeholders in the GMO debate often describe public opinion as irrational. But do they really understand the public? EMBO Rep 2(7):545–548.
.
OpenUrl FREE Full Text

[126] Marris C

[127] ↵
Cook G,
Pieri E,
Robbins PT
(2004) ‘The scientists think and the public feels’: Expert perceptions of the discourse of GM food. Discourse Soc 15(4):433–449.
.
OpenUrl Abstract

[128] Cook G,

[129] Pieri E,

[130] Robbins PT

[131] ↵
Cosmides L,
Tooby J
(1994) Beyond intuition and instinct blindness: Toward an evolutionarily rigorous cognitive science. Cognition 50(1-3):41–77.
.
OpenUrl CrossRef PubMed

[132] Cosmides L,

[133] Tooby J

[134] ↵
Myers DG
(2004) Intuition: Its Powers and Perils (Yale University Press, New Haven, CT).
.

[135] Myers DG

[136] ↵
Merton RK
(1987) The focussed interview and focus groups: Continuities and discontinuities. Public Opin Q 51(4):550–566.
.
OpenUrl Abstract/FREE Full Text

[137] Merton RK

[138] ↵
Meehl GA,
et al.
(2005) How much more global warming and sea level rise? Science 307(5716):1769–1772.
.
OpenUrl Abstract/FREE Full Text

[139] Meehl GA,

[140] et al.

[141] ↵
Parris A,
et al.
(2012) Global Sea Level Rise Scenarios for the United States National Climate Assessment (National Oceanic and Atmospheric Administration, Silver Spring, MD) NOAA Technical Report OAR CPO-1.
.

[142] Parris A,

[143] et al.

[144] ↵
Reyna VF,
Nelson WL,
Han PK,
Dieckmann NF
(2009) How numeracy influences risk comprehension and medical decision making. Psychol Bull 135(6):943–973.
.
OpenUrl CrossRef PubMed

[145] Reyna VF,

[146] Nelson WL,

[147] Han PK,

[148] Dieckmann NF

[149] ↵
Peters E,
Hart PS,
Fraenkel L
(2011) Informing patients: The influence of numeracy, framing, and format of side effect information on risk perceptions. Med Decis Making 31(3):432–436.
.
OpenUrl Abstract/FREE Full Text

[150] Peters E,

[151] Hart PS,

[152] Fraenkel L

[153] ↵
Davis TC,
et al.
(2006) Low literacy impairs comprehension of prescription drug warning labels. J Gen Intern Med 21(8):847–851.
.
OpenUrl CrossRef PubMed

[154] Davis TC,

[155] et al.

[156] ↵
Fischhoff B,
Brewer N,
Downs JS
(2011) Communicating Risks and Benefits: An Evidence-Based User Guide (Food and Drug Administration, Washington, DC).
.

[157] Fischhoff B,

[158] Brewer N,

[159] Downs JS

[160] ↵
Baldwin RS,
Peleg-Bruckner Z,
McClintock AH
(1985) Effects of topic interest and prior knowledge on reading comprehension. Read Res Q 20(4):497–504.
.
OpenUrl CrossRef

[161] Baldwin RS,

[162] Peleg-Bruckner Z,

[163] McClintock AH

[164] ↵
Ackerman PL
(1996) A Theory of adult intellectual development: Process, personality, interests, and knowledge. Intelligence 22(2):227–257.
.
OpenUrl CrossRef

[165] Ackerman PL

[166] ↵
Wong-Parodi G,
Dowlatabadi H,
McDaniels T,
Ray I
(2011) Influencing attitudes toward carbon capture and sequestration: A social marketing approach. Environ Sci Technol 45(16):6743–6751.
.
OpenUrl CrossRef PubMed

[167] Wong-Parodi G,

[168] Dowlatabadi H,

[169] McDaniels T,

[170] Ray I

[171] ↵
Thompson JK
(2004) Prospects for transdisciplinarity. Futures 36(4):515–526.
.
OpenUrl CrossRef

[172] Thompson JK

[173] ↵
Rasmussen B,
Andersen PD,
Borch K
(2010) Managing transdisciplinarity in strategic foresight. Creat Innov Manag 19(1):37–46.
.
OpenUrl CrossRef

[174] Rasmussen B,

[175] Andersen PD,

[176] Borch K

Main menu

User menu

Search

New Research In

Team science for science communication

Abstract

Overcoming the Challenges of Collaboration to Design Effective Science Communication

Challenge 1: Agreeing on Goals

The Response: Coming to an Agreement on What We Meant By “Effective” Communication.

Challenge 2: Balancing Complexity and Simplicity

The Response: Understanding the Risk for Coastal Flood Aggravated By Sea Level Rise.

Challenge 3: Relying on Data, Not Intuition

The Response: Learning How to Let Go of Our Intuition and Listen to What the Data Tell Us.

Challenge 4: Negotiating External Pressures

The Response: Forces Shaping the Design of the Sea Level Tool.

Conclusions

Acknowledgments

Footnotes

References

Citation Manager Formats

You May Also be Interested in

Similar Articles

Articles

PNAS Portals

Information

Main menu

User menu

Search

New Research In

Physical Sciences

Featured Portals

Articles by Topic

Social Sciences

Featured Portals

Articles by Topic

Biological Sciences

Featured Portals

Articles by Topic

Team science for science communication

Abstract

Overcoming the Challenges of Collaboration to Design Effective Science Communication

Challenge 1: Agreeing on Goals

The Response: Coming to an Agreement on What We Meant By “Effective” Communication.

Challenge 2: Balancing Complexity and Simplicity

The Response: Understanding the Risk for Coastal Flood Aggravated By Sea Level Rise.

Challenge 3: Relying on Data, Not Intuition

The Response: Learning How to Let Go of Our Intuition and Listen to What the Data Tell Us.

Challenge 4: Negotiating External Pressures

The Response: Forces Shaping the Design of the Sea Level Tool.

Conclusions

Acknowledgments

Footnotes

References

Citation Manager Formats

Sign up for Article Alerts

Jump to section

You May Also be Interested in

Similar Articles

Articles

PNAS Portals

Information