1 Introduction

Global concerns about climate change vary. Generally, citizens of European nations are more worried about its immediacy compared to Americans and countries that are high emitters of carbon dioxide tend to exhibit less concern about its impacts [Wike, 2016 ]. Climate change refers to statistical changes in the Earth’s climatic system and associated events over long timescales [American Meteorological Society, 2012 ]. Global warming, a byproduct of climate change, refers to the increase in average global temperature due to anthropogenic emissions, primarily carbon dioxide. While the terms “global warming” and “climate change”, are often used interchangeably by media to refer to the same phenomenon [IPCC, 2013 ], they evoke different associations among lay audiences [Leiserowitz et al., 2014 ; Schuldt, Konrath and Schwarz, 2011 ; Schuldt and Roh, 2014 ; Whitmarsh, 2009 ]. For example, quantitative and qualitative surveys show that the term “global warming”, relative to “climate change”, evokes more concern among residents in the south of England [Whitmarsh, 2009 ]. Further, the former elicits more associations with temperature and human causality. In the present study, we further scholarship on people’s associations with these terms in the context of social media.

Online media are becoming one of the prime means through which people encounter scientific information. Although Americans, relative to British adults, tend to look to the Internet more for scientific information, the use of social media has increased worldwide. The abundance of interactive, Web-2.0 media have expanded our ability to engage in discussions with each other about a variety of scientific issues [Brossard, 2013 ; Scheufele, 2013 ]. These technologies also offer rapid and widespread information sharing. Twitter, a social microblogging platform, has become a significant environment for real-time opinion sharing, interaction with experts and non-experts alike, and information dissemination related to diverse issues ranging from politics [Papacharissi and Fatima Oliveira, 2012 ] to nanotechnology [Runge et al., 2013 ]. Understanding and mapping discourses surrounding scientific issues on social media are valuable to the scholarship and practice of science communication. While online opinions are not always representative of public opinion, the sentiments and discussions expressed online represent untapped sources of data that can be leveraged to inform science communication scholars and practitioners [Yeo and Brossard, 2017 ].

While scholars have linked Twitter discourse to temperature changes and climate change [Kirilenko, Molodtsova and Stepchenkova, 2015 ], there has been no investigation of the topics of discussion associated with the terms “global warming” and “climate change.” This motivates us to explore the discursive contexts in which audiences use these. Further, while studies have examined the relationship between Twitter activity, local changes in temperature, and mass media, in the present work we explore how regional temperature changes and topics discussed on Twitter using the two terms are related. In doing so, we obtain insight into people’s perceptions and associations with these terms through spontaneous expressions of opinion.

Thus, the goals of this study are two-fold: (i) to determine whether differences exist in topics of Twitter conversation using the terms “climate change” and “global warming” within the context of six topics of discussion in which these terms are often used (energy, weather, policy, environment, political theater, and factual statements; see Methods for further explanation); and (ii) to explore whether temperature variations across geographic regions in the United States and in response to extreme temperature events are related to Twitter reactions using the terms “climate change” or “global warming.” Given the context of our study, we focus our review of the literature on scholarship primarily conducted in the United States.

2 Literature review

2.1 Differences in public opinion regarding global warming and climate change

Among Americans, a stark political partisan divide in climate change opinions persists. This divide began to widen in the early 1990s when discussions among non-experts became more politicized [Boykoff and Boykoff, 2004 ; Boykoff and Boykoff, 2007 ; Dunlap and McCright, 2008 ; Leggett, 2001 ; Trumbo, 1996 ] and is apparent in how people associate weather events with the two terms. While there is no difference among Democrats, many Republicans and Independents believe global warming, compared to climate change, is more likely to impact weather in the United States “a lot” [Leiserowitz et al., 2014 ]. Further, Republicans are more likely to suggest a large-scale effort to reduce climate change than to reduce global warming [Leiserowitz et al., 2014 ]. Other research has shown that the terms have different implications of seriousness across party lines; Republicans rate “climate change” as more serious while Democrats rank “global warming” as more serious [Villar and Krosnick, 2011 ].

Predilections for climate change-related terms exist across different segments of the public, despite a large portion of people having no preference [Akerlof and Maibach, 2011 ]. “Global warming” was found to be more polarizing and preferred by those who believe climate change is occurring, while those who believe it was not occurring opted for “climate change.” Similarly, polarization has been observed on coverage of the issue in mass and social media such as Twitter, with differences in the frames and partisanship associated with the two terms [O’Neill et al., 2015 ; Pearce et al., 2014 ; Williams et al., 2015 ]. “Global warming” was more commonly associated with tweets using a hoax frame (“global warming is a hoax/fraud”) and more often used in Republican than Democratic states [Jang and Hart, 2015 ].

2.2 Opinions about global warming and climate change on Twitter

Until recently, most studies of non-expert discourses surrounding global warming and climate change did not focus specifically on social media communications [Nielsen and Kjærgaard, 2011 ]. Yet, Twitter has risen in popularity over the last several years. In 2014, 23 percent of online American adults used Twitter [Duggan et al., 2015 ]. Among Twitter users, 59 percent use the platform to attend to news [Gottfried and Shearer, 2016 ]. Importantly, Twitter is used worldwide and has four times as many international users compared to in the United States [DeSilver, 2016 ].

While the opinions on Twitter do not necessarily reflect public opinion [Mitchell and Hitlin, 2013 ], it remains valuable to examine discourses on this platform. Twitter content is posted in real-time, and represents unsolicited, instantaneous responses to current issues in broader society. Studies employing such reactive opinions are not well represented in the literature on lay discourse about global warming and climate change, as earlier studies primarily employ survey methodologies that allow participants to reflect more deeply on the issue.

Recent studies have begun to analyze the nature of a broad range of scientific discourses on Twitter, including the Higgs-Boson particle [Boyle, 2012 ], nuclear energy [Kim et al., 2016 ], nanotechnology [Runge et al., 2013 ; Yeo et al., 2014a ], and the arsenic bacteria controversy [Yeo et al., 2016 ]. Researchers have even used Twitter content to analyze political discourse [Beauchamp, 2016 ; Small, 2011 ], as well as in concert with users’ geographic locations to map real-time earthquake events in Japan [Sakaki, Okazaki and Matsuo, 2013 ]. Many of these scientific issues have been addressed in detail in online news media. Given that scientific issues covered by mainstream media have previously trended on Twitter, that the issue of climate change receives extensive media coverage, and that climate adaptation and mitigation are significant societal issues that have ethical and legal implications, examining opinions expressed on Twitter will improve our understanding of how people spontaneously react to global warming and inform communication efforts around this issue.

Recent studies have begun to use Twitter data to study specific conversations related to climate change [Su, Akin and Brossard, 2017 ]. For example, Pearce et al. [ 2014 ] investigated conversations surrounding the release of the International Panel on Climate Change (IPCC) Working Group I report to examine how Twitter users formed communities around this issue. Using network analysis, they showed that content focused on both the science and politics surrounding climate change and users were more likely to share information with like-minded others, further underscoring the polarized nature of discourse on this issue. Another study tracked changes in climate change sentiment on Twitter using happiness scores to determine how sentiment varied in response to news and events about climate change [Cody et al., 2015 ]. On average, “global warming” tweets were more negative and profane, contained more climate denier information, and had fewer mentions of science. Over the study period, decreases in happiness were observed to coincide with the occurrence of several natural disasters (e.g., Hurricane Sandy in 2012).

Another recent study investigated changes in the volume of global warming and climate change online searches in concert with emotional response to these topics using Google and Twitter, respectively [Lineman et al., 2015 ]. They showed that Twitter posts between 12 October and 12 December 2013 were more negative about global warming. While this study provides a foundation for understanding temporal changes in search interest and related emotional response to these two terms, the specific contexts and topics in which these terms have been considered has not been investigated. Therefore, one goal of our study is to investigate differences in global warming and climate change tweets in the context of topics in which these two terms are commonly used. By categorizing daily Twitter discourse into various topics of discussion, we can improve our understanding of how often these terms are used, including whether one term is “preferred” over the other within various topics of discussion.

Given the evident differences in social media conversations about climate change using these terms, we set out to determine whether differences exist in the average daily number of Twitter posts using the terms “climate change” and “global warming” within the context of six topics of discussion. For each topic, we test the following hypothesis:

H1: The average daily number of Twitter posts about “global warming” will differ significantly from that of “climate change” over the period studied (1 January 2012 and 31 March 2014).

2.3 Global warming, climate change, and extreme weather

People tend to rely on cognitive shortcuts when forming attitudes toward scientific issues [Brossard and Nisbet, 2007 ; Brossard et al., 2009 ; Finucane et al., 2000 ; Su et al., 2016 ; Yeo et al., 2014b ], including climate change. For example, the likability of weather forecasters has been linked to greater perceptions of harm caused by the phenomenon [Anderson et al., 2013 ]. Climate change opinions can also be predicted by geographic variability; patterns of climate opinion among Americans vary with expected political patterns as more politically liberal states exhibit greater levels of concern relative to conservative ones [Howe et al., 2015 ]. Other scholarship has also shown that global warming opinions are tied to outdoor temperature [Joireman, Truelove and Duell, 2010 ] as well as perceptions of temperature [Li, Johnson and Zaval, 2011 ]. Higher actual and perceived temperatures are associated with greater belief in the occurrence of global warming. Moreover, abnormal temperature events have greater influence on people’s belief in, and concern about, climate change [Zaval et al., 2014 ]. Such examples underscore a demonstrated link between macro-level phenomena and individual behaviors [Schwarz and Clore, 1983 ]. Thus, occurrences such as weather events can influence people’s perceptions of, and sentiment toward, global warming.

Few studies have examined Twitter discourse related specifically to weather. One study found tweet volume to be highly correlated with the number of people affected by tornado watches and warnings, suggesting that Twitter may be a useful platform for disseminating information and understanding audience reactions to severe weather [Ripberger et al., 2014 ]. Kirilenko, Molodtsova and Stepchenkova [ 2015 ] found that during extreme weather events (quantified using anomalous temperature data), there was an increase in the number of tweets about climate change, especially for colder and wetter regions of the United States and during the months of December to February and June to August.

While these recent studies consider the volume of tweets, these studies do not specifically categorize their content. Understanding differences in content would further develop our understanding of the emotional response Twitter users have when discussing these terms. Furthermore, while Kirilenko, Molodtsova and Stepchenkova [ 2015 ] provide a foundation for understanding the relationship between extreme weather and global warming/climate change tweet volume, a more in-depth investigation of this relationship in the context of notable events would shed light on why we observe changes in opinions during such extreme events.

This motivates us to explore the relationship between global warming and climate change tweets and temperature across regions in the United States in addition to during extreme temperature events. We explore these relationships in the context of the research questions below:

RQ1 : Is regional temperature in the United States associated with Twitter posts using the term global warming and/or climate change?

RQ2 : Are tweets about climate change or global warming related to temperature during the month of an extreme temperature event?

We investigate RQ1 by examining correlations between regional temperature in the United States over the study period and tweets about global warming and climate change. To address RQ2, we use case studies focusing on two events, a heat wave (March 2012) and a cold surge (January 2014). Case studies have been used by atmospheric scientists who aim to investigate relationships between a weather event and its associated atmospheric and/or societal response [e.g., Mohri, 1953 ; Hakim, Keyser and Bosart, 1996 ; Winters and Martin, 2016 ; Bosart et al., 1996 ]. While the results of case studies are not generalizable, such analyses allow us to observe interesting trends in tweets and extreme temperatures, which can be combined with statistical analyses to further our understanding of relationships of interest.

We build on previous work in the following ways: (i) we investigate how these terms are used in different topics of conversation on social media with a multi-year census of tweets; and (ii) we examine the influence of regional temperature on unsolicited expressions and in reaction to a significant heat wave and cold surge event.

3 Methods

3.1 Twitter data

We used the software, ForSight, from the social media monitoring company, Crimson Hexagon, to classify tweets into topic categories. ForSight is a supervised learning software that detects and tracks underlying linguistic patterns, based on concepts identified by human coders using an initial training set, and applies the learned algorithm to analyze the remaining, typically large, amounts of social media texts [Hopkins and King, 2010 ]. Scholars have argued for applying this hybrid content analysis method to social media discourses as it possesses the reliability and efficiency of computer-based coding while preserving the latent validity of human coding [Su et al., 2017 ; Su, Akin and Brossard, 2017 ]. Others have examined and verified such supervised learning programs [Collingwood and Wilkerson, 2012 ]. Specifically, ForSight has been verified through comparison with surveys data and election results [Ceron et al., 2014 ; Hitlin, 2015 ]. These scholars, among others, have also verified the resilience of supervised learning programs based on the training set used for the program [Collingwood and Wilkerson, 2012 ; Hopkins and King, 2010 ]. Using a large and randomly distributed subset of the sample posts improves the accuracy of the program, in addition to extensive human coding [Collingwood and Wilkerson, 2012 ; Neuendorf, 2017 ].

We collected and analyzed a census of publicly-available tweets posted between 1 January 2012 and 31 March 2014 using ForSight. A total of 3,732,058 English-language tweets from the United States were collected and analyzed. 1 ForSight uses monitors with intelligent algorithms and a Boolean logic-based keyword search to track linguistic patterns based on training by human coders. To train the algorithm, the program randomly samples from the census of publicly available tweets based on the given keywords. To ensure a representative and high-quality subset of tweets is used to train the algorithm, the posts are categorized by human coders according to a codebook. During the process of manually coding the random sample, only mutually exclusive and unambiguous examples were used to train the monitors. Non-exclusive tweets (i.e., those that could fit into multiple categories) were not included in the training subset. Human-coders thus analyzed more posts that were subsequently included in the training subset. Once consensus between coders is reached, the trained categories are used by the software to analyze the remaining posts. Training the algorithm with human coding requires a minimum of 20 posts, as recommended by Crimson Hexagon, in each defined category. Additional research by Hopkins and King [ 2010 ] suggests a total of 100 hand-coded items is sufficient for reliable results (in their analysis, 100 congressional documents were distributed into seven categories).

We used two separate monitors for this study, each with individual keywords. 2 Tweets were coded into one of the six categories based on the topic: (i) energy; (ii) weather; (iii) policy implications; (iv) environment; (v) political theater; and (vi) statements about climate change or global warming. Categories were chosen based on an initial inductive examination of a randomly selected sample of tweets as they reflect common themes associated with discussions of the issue. Other categories, such as human health, were not commonly included in Twitter discourse relative to the categories selected. This is relatively unsurprising as climate change is not widely recognized as a health issue among American publics [Akerlof et al., 2010 ]. This is similarly the case in Canada [Cardwell and Elliott, 2013 ]. We combined this inductive process with our collective experience with climate science education and research. Examples of each category are shown in Table 1 . Tweets that expressed opinions about fracking, fossil fuels, and nuclear or renewable energy were coded in the energy category. Those related to temperature, precipitation, seasons, or extreme weather events were classified as weather. Policy implications included mentions of cap and trade, carbon limits or tax, and public projects. Tweets in the environment category included mentions of agriculture, habitat loss, and extinction. Political theater tweets had to be actor-focused, containing specific mentions of public figures. Lastly, tweets that were declarations such as “Climate change is a fact” were categorized as statements about “climate change” or “global warming.”


Table 1 : Examples of categorized tweets containing the keywords climate change and global warming.
PIC

3.2 Temperature data and calculations

To identify events of interest, we used surface temperature data from the Climate Forecast System Reanalysis (CFSR) dataset [Saha et al., 2010 ], which has a horizontal resolution of 0.5°and a temporal resolution of 6 hours. Temperature anomalies were computed by subtracting daily average temperature from climatological temperature for a given day; positive (negative) temperature anomalies indicate the observed temperature was warmer (colder) than average. For each spatial point, the climatological mean temperature was determined by first applying a 21-day running mean centered over the day of interest. Then, the 30-year temperature average at the point of interest over the years 1980–2009 was calculated. Finally, we computed the square of each daily temperature anomaly, which represents a first-order measure of the variability of temperature at each spatial point:

T s q . a n o m . = ( T T c l i m o ) 2

where T is the daily average surface temperature and T c l i m o is the climatological mean at that point.

3.3 Data analysis

To address H1, we used independent samples t -tests to assess whether average daily posts in each topic of conversation on Twitter containing the keywords “global warming” differed significantly from those containing the keywords “climate change” over the study period (Table 2 ). To account for multiple comparisons and reduce the risk of Type I error, we adjusted our level of significance ( α ) based on the Bonferroni procedure [Rosenthal and Rubin, 1983 ; Wright, 1992 ]; we set α = 0 . 0 5 6 = 0 . 0 0 8 .


Table 2 : Descriptive statistics and results of independent samples t -tests comparing means of daily global warming and climate change tweets in topic categories over the study period (1 January 2012 – 31 March 2014). Positive values of Cohen’s d indicate that discussions using global warming have higher average daily posts.
PIC

To answer RQ1, we examined correlations between monthly average anomalous temperature and T s q . a n o m . , and that of number of tweets per capita about global warming and climate change. In the analysis that addressed RQ1, we did not differentiate between topics of conversation. Instead, we compared the monthly average of climate change and global warming tweets with temperature data from six regions in the United States over the study period (Supplemental Table 4 and Supplemental Figure 4 ). Regions were modified using tagged geographic location in Twitter data. ForSight uses two different methods to assign location data to tweets; approximately 1 percent of the tweets are geo-tagged by the user. The locations of the remaining tweets are estimated based on contextual clues, including users profile information, time zones, and language. The location estimation methodology is similar to that described by Beauchamp [ 2016 ]. Of the 3,732,058 total tweets, approximately 15 percent were excluded from analysis as they were not geo-tagged and could not be estimated, resulting in 3,181,229 posts.

The presence of seasonality within our temperature data has the potential to confound our analysis. For example, if number of tweets per capita is significantly correlated with temperature, then peak temperatures due to seasonality may lead to misleading conclusions. To alleviate this, we examined correlations between Twitter posts per capita and anomalous temperature, and between posts per capita and T s q . a n o m . .

To address RQ2, we conducted case studies focused on two separate extreme temperature events occurring in March 2012 and January 2014. As weather events are not consistent across the United States, not all delineated regions were affected by these extreme weather events. We identified the specific regions affected and used these as case studies. We did not differentiate between discursive topics in this analysis. During the March 2012 “heat wave”, temperatures were warmer than normal, particularly in the Northeast, Southeast, and Midwest, with average monthly anomalies of + 5 . 7 °C, + 5 . 0 °C, and + 8 . 0 °C, respectively. During the January 2014 “cold surge”, all except for the Western and High Plains regions experienced below average temperatures. Temperature anomalies ranged from 0 . 0 5 °C in the Southeast to 3 . 1 °C in the Midwest. This “cold surge” event coincided with President Obama’s 2014 State of the Union address in which he stated “Climate change is a fact” [Obama, 2014 ]. In both case studies, daily anomalous temperature was compared with daily number of global warming and climate change messages per capita on Twitter. We then determined whether anomalous temperature was significantly correlated with posts for each term.

4 Results and discussion

A total of 3,732,058 posts were collected over the study period (Figures 1 and 2 ). To address our hypothesis, we compared average daily tweets of climate change and global warming in each of the six topics of discourse. We find partial support for H1. Mean differences were significant for five of the six topics with medium to large effect sizes (Table 2 ); only statements made using the terms “global warming” and “climate change” did not differ significantly. A possible explanation for this finding is that it may indicate Twitter audiences do not hold different associations with these terms when using them in posts unrelated to the other five categories. This emphasizes that the context of discussion matters. When the discursive context was not clearly defined, Twitter users did not appear to hold different associations with these terms.


PIC
Figure 1 : Time series of daily Twitter posts about climate change.


PIC
Figure 2 : Time series of daily Twitter posts about global warming.

In discussions of energy and weather, the daily average tweets about global warming were significantly greater than those about climate change. In discussions of the environment and those related to policy or politics, daily mean posts about climate change were significantly greater. The differences were smallest for the weather (Cohen’s d = . 4 8 8 ) and political theater (Cohen’s d = . 3 8 7 ) categories, and highest in the environment category (Cohen’s d = 1 . 5 1 6 ). The significant differences in mean daily posts are consistent with previous studies that suggest these terms are not synonymous for online audiences. In addition to attaching different attitudes to these terms [Cody et al., 2015 ; Jang and Hart, 2015 ; Leiserowitz et al., 2014 ], our results show that Twitter audiences use global warming and climate change in different contexts.

Climate change was used more frequently when discussions were related to political issues. This may reflect the evolution in climate rhetoric [for details, see Besel, 2007 ] during the Bush administration. Frank Luntz, a Republican strategist, recommended that conservative-leaning politicians use “climate change” instead of “global warming”, as the former was found to induce less dread and fear among public audiences [Luntz, 2005 ]. With respect to the phrase global warming, our results suggest users associate temperature with this phenomenon. While this finding supports prior work linking climate perceptions and beliefs to temperature [Joireman, Truelove and Duell, 2010 ; Li, Johnson and Zaval, 2011 ], future research is required to confirm this hypothesis.

To address RQ1, we set our significance level at 0.05 and used bivariate analysis to examine the relationships between the average monthly geo-tagged tweets per capita using both terms with anomalous temperature and T s q . a n o m . over the six regions of the continental United States (Table 3 ). Climate change posts were not significantly correlated with either anomalous temperature or T s q . a n o m . in any geographic region. However, we found a significant positive correlation between global warming posts per capita and anomalous temperature in the Midwest where warmer temperatures were associated with more tweets about global warming ( r = . 4 1 7 , p = . 0 3 0 ). With regards to T s q . a n o m . , global warming tweets were correlated with this measure in the High Plains ( r = . 5 2 2 , p = . 0 0 5 ), Midwest ( r = . 4 7 5 , p = . 0 1 2 ), Southern ( r = . 4 0 5 , p = . 0 3 6 ), Southeast ( r = . 4 6 7 , p = . 0 1 4 ), and Northeast ( r = . 5 4 9 , p = . 0 0 3 ) regions. In all cases, greater deviations of temperature from the mean were associated with more Twitter messages per capita about global warming.


Table 3 : Pearson’s correlations and p -values (in parentheses) between monthly average T s q . a n o m . , temperature anomaly, and total daily Twitter posts per capita between January 2012 and March 2014 in the US.

PIC


In the Western United States, neither climate change or global warming tweets were correlated with anomalous temperature or T s q . a n o m . . The Western region includes the largest latitude range, as well as significant topographic differences relative to the other regions. Thus, the lack of correlation between temperature and posts about either climate change or global warming may be a product of combining states with highly variable temperatures. Taken together with our finding that global warming relative to climate change is used more frequently when the topic of conversation is weather, these results may be indicative of Twitter users commenting on the juxtaposition of the phrase global warming and low temperatures. For example, anomalously warm (cool) days in regions aside from the West may be perceived as events that support (refute) the phenomenon, thus leading users to turn to Twitter to express their views. These results could imply a deeper issue of climate literacy — global warming and climate change are used by experts to describe the same phenomenon, but Twitter audiences understand and use the terms differently. Moreover, it underscores how concern and belief in global climate change are, to some extent, driven by physical experiences with temperature [Zaval et al., 2014 ].

Thus far, we have referred to audiences on Twitter generally as non-experts. It is worth noting that numerous sources have tracked the demographics of users across the years. In surveys conducted by the Pew Research Center [Greenwood, Perrin and Duggan, 2016 ], at the beginning of this data collection period in 2012, 16 percent of online adults used Twitter. By the end in 2014, this number had increased to 23 percent. Compared to other social media, Twitter performs well with younger and more educated users, and has seen increases in users across a diversity of demographic groupings [Duggan et al., 2015 ; Greenwood, Perrin and Duggan, 2016 ]. Few studies have actively examined the breakdown of Twitter users across the roles they may play for specific issues (e.g., stakeholders, journalists, and politicians). While studies in political communication have found that elite actors, such as political leaders and traditional journalists, are prevalent on Twitter and can dominate online discussions [e.g. Conway, Kenski and Wang, 2015 ; Wells et al., 2016 ], there is evidence that “ordinary” users can disrupt traditional power systems via social media [Meraz, 2009 ].

Analyses specific to those tweeting about climate change are even more limited. Newman [ 2016 ] tracked those who tweeted about climate change or the fifth IPCC report a few days before and after the release date. Using a sample of “high attention” tweets, Newman examined these users to determine who had a large impact on the conversation, separating them into six categories. He found that non-elite (i.e., lay audience) accounts were the largest group with 35 percent of the 100 top retweeted posts. The remaining five groupings were more evenly split: media organizations (17 percent), political/advocacy organizations (16 percent), governmental/NGO (12 percent), journalists (9 percent), and finally, scientists (7 percent). While there is a diversity of actors represented within the Twitter conversation, it is important to note that not only do non-elite users contribute to the climate change conversation on Twitter, they are able to attract high levels of attention. While Newman [ 2016 ] focused only on the top-100 most attention-garnering accounts, the proportion of non-elite users will likely increase when all tweets are considered.

4.1 Case studies

In March 2012, the continental United States experienced temperatures significantly above normal, especially in the Northeast, Southeast, and Midwest regions [Borth, Castro and Birk, 2012 ]. We used this month as a case study to explore whether anomalous temperatures in these regions were related to the volume of tweets. Temperatures were slightly above average during the first week of March 2012 (Figure 3 a). During this week, the volume of posts about climate change and global warming were relatively constant. However, after 11 March, temperatures were consistently about 8°C warmer than average until 24 March. With the onset of higher temperatures, trends in global warming tweets increased relative to those of climate change. The greatest daily volume of global warming posts (~570) coincided with the greatest temperature anomaly (21 March). The highest daily posts about climate change on Twitter (~432) occurred on 29 March after the warmest period of the month.


PIC
Figure 3 : Trends in temperature and tweets per capita about climate change and global warming with respect to the March 2012 “heat wave” in the Midwest, Northeast, and Southeast regions, and January 2014 “cold surge” across all geographic regions.

Anomalous temperatures were significantly correlated with daily average volume of global warming messages ( r = 0 . 4 6 6 , p = . 0 0 8 ) but not with those of climate change ( r = 0 . 1 9 1 , p = . 3 0 4 ). Regional differences in the United States are highlighted when we examine the relationships between temperature deviations and Twitter posts (Table 3 ). In particular, the Midwest region was most drastically affected by the “heat wave” [Borth, Castro and Birk, 2012 ]; this is reflected in Twitter discourse on global warming. In March 2012, users in the Midwest tweeted more about global warming when temperatures were above average. Although it would be challenging to argue that tweets about global warming are driving temperature deviations in the United States, these results do not demonstrate causation. It is worth noting the potential for regional politics to affect the volume of Twitter posts in the regions examined. While this is beyond the scope of this study, we remain confident in our results as the rural-urban divide in the United States, compared to regional politics, is more likely to influence the political choices and related opinions of American voters [McKee, 2008 ; Scala and Johnson, 2017 ].

The second case study evaluated relationships between temperature and Twitter messages in January 2014. During this period, the continental United States experienced an abnormally cold month [Lindsey, 2014 ] with three dramatic decreases: January 6–8, 21–25, and 27–29. All three periods were associated with significant cold air outbreaks over the eastern part of the country. Moreover, on 28 January, President Obama overtly mentioned climate change in the State of the Union address [Obama, 2014 ].

Peaks in tweets occurred within one day of the temperature deviation minima associated with the dates listed (Figure 3 b). This may be a result of users commenting on forecasts of the events as well as the events themselves. These results suggest forecasted cold surge events may be tied to significant increases in tweets. The volume of global warming tweets between 6–8 January and 21–25 January were higher than that of climate change. The converse was observed during and immediately following the State of the Union address (January 27–29). In this case, Twitter messages about climate change outnumbered those related to global warming. The greatest number of global warming posts occurred on 7 January (~3,650), while the maximum volume for climate change occurred on 29 January (~4,600). We found significant negative correlations between anomalous temperature and both global warming ( r = . 6 6 6 , p . 0 0 1 ) and climate change tweets ( r = . 3 8 5 , p = . 0 3 2 ) for the entire month of January. The correlation between anomalous temperature and global warming reactions supports our finding that the volume of global warming messages on Twitter is associated with changes in temperature. This also supports our finding that the volume of climate change reactions on this social platform is strongly associated with political commentary.

4.2 Limitations

While this study is one of the few to investigate Twitter discourses surrounding global warming and climate change topics, some limitations exist. First, we underscore that opinions expressed on Twitter do not necessarily reflect those of publics [Mitchell and Hitlin, 2013 ]. However, it remains valuable to examine these discourses as they are real-time sharing of opinions. Such reactive and unsolicited expressions provide insight into how global warming and climate change are associated with temperature and extreme events when these issues arise in conversation.

A second limitation is that not all users report the location from which they are tweeting. Since our sample of geo-tagged Twitter posts is a subset (85 percent) of that used to analyze the topics of conversation, it is only able to provide a proxy for climate change and global warming discourses, and their relationships with temperature. Despite this limitation, our findings support previous research on the relationship between Twitter discourses and variability in temperature [Joireman, Truelove and Duell, 2010 ; Li, Johnson and Zaval, 2011 ], which gives us confidence that our results provide valid insight.

Lastly, the geographic regions defined are large enough in some cases that we may be averaging out some important temperature information. For example, the Western region includes a large area that spans various climates that can differ in temperature significantly during each season. Therefore, while no significant correlations arise in our study in the Western United States, the inclusion of so many climates within a region may play a role in this. Future studies might find it fruitful to consider correlations between temperature and tweets within smaller geographic regions.

5 Conclusions

Our goal was to investigate differences in topics of Twitter discourses using the terms global warming and climate change. Using automated content analysis with a supervised learning technique, we categorized discursive topics over a period of 27 months. Additionally, we examined the link between temperature and those discourses. The present work builds on scholarship examining perceptions [Joireman, Truelove and Duell, 2010 ; Li, Johnson and Zaval, 2011 ] and tweets about global warming and climate change [Kirilenko, Molodtsova and Stepchenkova, 2015 ; Lineman et al., 2015 ] by considering the topics of Twitter discourse related to each term and investigates of the role of extreme temperature events on such discussions. We first addressed whether significant differences in global warming and climate change posts on Twitter about various topics of discussion existed. Then, we examined whether daily average temperatures and extreme temperature events were correlated with global warming and climate change tweets.

We found the topic of discussion was an important factor in whether messages about global warming or climate change were more prevalent. While more reactions to global warming were observed for topics related to weather and energy, more climate change tweets were about environmental and political content. Consistent with previous research [Kirilenko, Molodtsova and Stepchenkova, 2015 ], our findings also showed that posts about global warming (but not climate change) were significantly correlated with anomalous temperature and impacted by seasonality. This result was further supported in our case study of the “heat wave”, where a statistically significant correlation between anomalous temperature and global warming reactions was observed. The January 2014 “cold surge” case study supported our finding that political statements appear to be associated with more climate change tweets relative to global warming.

These results have implications for climate change communication. Our findings underscore the importance of considering how communication may translate into concerns among lay audiences. Here, we demonstrate that Twitter audiences associate different dimensions of the phenomenon with the terms “climate change” and “global warming.” This highlights a need for strategic use of these terms as they may influence public discourses of climate change. However, the nature of the influence is likely to vary across different segments of the publics [Villar and Krosnick, 2011 ]. Depending on the policy issue at hand, it may be important to use the appropriate term to describe the phenomenon that resonates with people’s internal schema when developing messages about various aspects of the issue, such as using global warming to communicate energy issues and climate change for environment-related issues. It may also be more effective to discuss the issue using global warming during periods of temperature extremes, as we found evidence of a strong link between the term and anomalous temperature and T s q . a n o m . . Alternatively, “climate change” appears to be more linked with the political aspects of the issue; this term may be more appropriate for use in general discourses related to policies or the phenomenon itself.

As previous research conducted in the UK suggests that the term “global warming” is associated with higher concerns for the issue [Whitmarsh, 2009 ], our demonstration of linkages with temperature becomes more pertinent as it may indicate periods of high attention and concern. “Heat waves” and “cold surges” may be ideal times to discuss policies or communicate about climate change, as both interest and attention increase.

Lastly, despite the large number of people who recognize the need for significant lifestyles changes due to climate change, attitudes toward climate change are also tied to extreme temperature. This suggests there may be a disconnect between public opinion and behavior change, as attitudes and attention levels fluctuate with changes in temperature [Bamberg and Möser, 2007 ; Kollmuss and Agyeman, 2002 ]. Since our results are based on correlations, future work should probe causal relationships underpinning these findings and should consider how discourses on other Web-2.0 media are affected by physical factors.

A Supplemental table and figure


Table 4 : List of geographic regions in the United States modified from those delineated by the National Weather Service’s Regional Climate Centers.
PIC


PIC

Figure 4 : Map of United States regions modified from those delineated by the National Weather Service’s Regional Climate Centers.


References

Akerlof, K. and Maibach, E. W. (2011). ‘A rose by any other name…?: What members of the general public prefer to call “climate change”’. Climatic Change 106 (4), pp. 699–710. https://doi.org/10.1007/s10584-011-0070-4 .

Akerlof, K., DeBono, R., Berry, P., Leiserowitz, A., Roser-Renouf, C., Clarke, K.-L., Rogaeva, A., Nisbet, M. C., Weathers, M. R. and Maibach, E. W. (2010). ‘Public Perceptions of Climate Change as a Human Health Risk: Surveys of the United States, Canada and Malta’. International Journal of Environmental Research and Public Health 7 (6), pp. 2559–2606. https://doi.org/10.3390/ijerph7062559 .

American Meteorological Society (2012). ‘Climate change’. In: AMS Glossary. Boston, MA, U.S.A.: American Meteorological Society. URL: http://glossary.ametsoc.org/wiki/Climate_change .

Anderson, A. A., Myers, T. A., Maibach, E. W., Cullen, H., Gandy, J., Witte, J., Stenhouse, N. and Leiserowitz, A. (2013). ‘If They Like You, They Learn from You: How a Brief Weathercaster-Delivered Climate Education Segment Is Moderated by Viewer Evaluations of the Weathercaster’. Weather, Climate, and Society 5 (4), pp. 367–377. https://doi.org/10.1175/wcas-d-12-00051.1 .

Bamberg, S. and Möser, G. (2007). ‘Twenty years after Hines, Hungerford, and Tomera: A new meta-analysis of psycho-social determinants of pro-environmental behaviour’. Journal of Environmental Psychology 27 (1), pp. 14–25. https://doi.org/10.1016/j.jenvp.2006.12.002 .

Beauchamp, N. (2016). ‘Predicting and Interpolating State-Level Polls Using Twitter Textual Data’. American Journal of Political Science 61 (2), pp. 490–503. https://doi.org/10.1111/ajps.12274 .

Besel, R. D. (2007). ‘Communicating climate change: Climate rhetorics and discursive tipping points in United States global warming science and public policy’. Ph.D. dissertation. Champaign, IL, U.S.A.: University of Illinois at Urbana-Champaign.

Borth, S., Castro, R. and Birk, K. (2012). The Historic March 2012 Heatwave: A Meteorological Perspective. Chicago, IL, U.S.A.: National Weather Service.

Bosart, L. F., Hakim, G. J., Tyle, K. R., Bedrick, M. A., Bracken, W. E., Dickinson, M. J. and Schultz, D. M. (1996). ‘Large-Scale Antecedent Conditions Associated with the 12–14 March 1993 Cyclone (“Superstorm ’93”) over Eastern North America’. Monthly Weather Review 124 (9), pp. 1865–1891. https://doi.org/10.1175/1520-0493(1996)124<1865:lsacaw>2.0.co;2 .

Boykoff, M. T. and Boykoff, J. M. (2004). ‘Balance as bias: global warming and the US prestige press’. Global Environmental Change 14 (2), pp. 125–136. https://doi.org/10.1016/j.gloenvcha.2003.10.001 .

— (2007). ‘Climate change and journalistic norms: A case-study of US mass-media coverage’. Geoforum 38 (6), pp. 1190–1204. https://doi.org/10.1016/j.geoforum.2007.01.008 .

Boyle, A. (2012). ‘Ups and downs for Higgs boson buzz’. NBC News . URL: http://cosmiclog.nbcnews.com/_news/2012/06/21/12345552-ups-and-downs-for-higgs-boson-buzz?lite .

Brossard, D. (2013). ‘New media landscapes and the science information consumer’. Proceedings of the National Academy of Sciences 110 (Supplement 3), pp. 14096–14101. https://doi.org/10.1073/pnas.1212744110 . PMID: 23940316 .

Brossard, D. and Nisbet, M. C. (2007). ‘Deference to Scientific Authority Among a Low Information Public: Understanding U.S. Opinion on Agricultural Biotechnology’. International Journal of Public Opinion Research 19 (1), pp. 24–52. https://doi.org/10.1093/ijpor/edl003 .

Brossard, D., Scheufele, D. A., Kim, E. and Lewenstein, B. V. (2009). ‘Religiosity as a perceptual filter: examining processes of opinion formation about nanotechnology’. Public Understanding of Science 18 (5), pp. 546–558. https://doi.org/10.1177/0963662507087304 .

Cardwell, F. S. and Elliott, S. J. (2013). ‘Making the links: do we connect climate change with health? A qualitative case study from Canada’. BMC Public Health 13 (1). https://doi.org/10.1186/1471-2458-13-208 .

Ceron, A., Curini, L., Iacus, S. M. and Porro, G. (2014). ‘Every tweet counts? How sentiment analysis of social media can improve our knowledge of citizens’ political preferences with an application to Italy and France’. New Media & Society 16 (2), pp. 340–358. https://doi.org/10.1177/1461444813480466 .

Cody, E. M., Reagan, A. J., Mitchell, L., Dodds, P. S. and Danforth, C. M. (2015). ‘Climate Change Sentiment on Twitter: An Unsolicited Public Opinion Poll’. PLOS ONE 10 (8). Ed. by S. Lehmann, e0136092. https://doi.org/10.1371/journal.pone.0136092 .

Collingwood, L. and Wilkerson, J. (2012). ‘Tradeoffs in Accuracy and Efficiency in Supervised Learning Methods’. Journal of Information Technology & Politics 9 (3), pp. 298–318. https://doi.org/10.1080/19331681.2012.669191 .

Conway, B. A., Kenski, K. and Wang, D. (2015). ‘The Rise of Twitter in the Political Campaign: Searching for Intermedia Agenda-Setting Effects in the Presidential Primary’. Journal of Computer-Mediated Communication 20 (4), pp. 363–380. https://doi.org/10.1111/jcc4.12124 .

DeSilver, D. (2016). ‘Five Facts about Twitter at Age 10’. Pew Research Center . URL: http://www.pewresearch.org/fact-tank/2016/03/18/5-facts-about-twitter-at-age-10/ .

Duggan, M., Ellison, N. B., Lampe, C., Lenhart, A. and Madden, M. (9th January 2015). ‘Social Media Update 2014’. Pew Research Center . URL: http://www.pewinternet.org/2015/01/09/social-media-update-2014/ .

Dunlap, R. E. and McCright, A. M. (2008). ‘A Widening Gap: Republican and Democratic Views on Climate Change’. Environment: Science and Policy for Sustainable Development 50 (5), pp. 26–35. https://doi.org/10.3200/envt.50.5.26-35 .

Finucane, M. L., Alhakami, A., Slovic, P. and Johnson, S. M. (2000). ‘The affect heuristic in judgments of risks and benefits’. Journal of Behavioral Decision Making 13 (1), pp. 1–17. https://doi.org/10.1002/(sici)1099-0771(200001/03)13:1<1::aid-bdm333>3.0.co;2-s .

Gottfried, J. and Shearer, E. (2016). ‘News Use Across Social Media Platforms 2016’. Pew Research Center . URL: fromhttp://assets.pewresearch.org/wp-content/uploads/sites/13/2016/05/PJ_2016.05.26_social-media-and-news_FINAL-1.pdf .

Greenwood, S., Perrin, A. and Duggan, M. (11th November 2016). ‘Social Media Update 2016’. Pew Research Center . URL: http://www.pewinternet.org/2016/11/11/social-media-update-2016/ .

Hakim, G. J., Keyser, D. and Bosart, L. F. (1996). ‘The Ohio Valley Wave-Merger Cyclogenesis Event of 25–26 January 1978. Part II: Diagnosis Using Quasigeostrophic Potential Vorticity Inversion’. Monthly Weather Review 124 (10), pp. 2176–2205. https://doi.org/10.1175/1520-0493(1996)124<2176:tovwmc>2.0.co;2 .

Hitlin, P. (1st April 2015). ‘Methodology: How Crimson Hexagon Works’. Pew Research Center . URL: http://www.journalism.org/2015/04/01/methodology-crimson-hexagon/ .

Hopkins, D. J. and King, G. (2010). ‘A Method of Automated Nonparametric Content Analysis for Social Science’. American Journal of Political Science 54 (1), pp. 229–247. https://doi.org/10.1111/j.1540-5907.2009.00428.x .

Howe, P. D., Mildenberger, M., Marlon, J. R. and Leiserowitz, A. (2015). ‘Geographic variation in opinions on climate change at state and local scales in the USA’. Nature Climate Change 5 (6), pp. 596–603. https://doi.org/10.1038/nclimate2583 .

IPCC (2013). ‘Summary for Policymakers’. In: Climate Change 2013: The Physical Science Basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change. Ed. by T. F. Stocker, D. Qin, G.-K. Plattner, M. Tignor, S. K. Allen, J. Boschung, A. Nauels, Y. Xia, V. Bex and P. M. Midgley. Cambridge, U.K. and New York, NY, U.S.A.: Cambridge University Press, pp. 1–30. URL: http://www.climatechange2013.org/ .

Jang, S. M. and Hart, P. S. (2015). ‘Polarized frames on “climate change” and “global warming” across countries and states: Evidence from Twitter big data’. Global Environmental Change 32, pp. 11–17. https://doi.org/10.1016/j.gloenvcha.2015.02.010 .

Joireman, J., Truelove, H. B. and Duell, B. (2010). ‘Effect of outdoor temperature, heat primes and anchoring on belief in global warming’. Journal of Environmental Psychology 30 (4), pp. 358–367. https://doi.org/10.1016/j.jenvp.2010.03.004 .

Kim, J., Brossard, D., Scheufele, D. A. and Xenos, M. (2016). ‘“Shared” Information in the Age of Big Data’. Journalism & Mass Communication Quarterly 93 (2), pp. 430–445. https://doi.org/10.1177/1077699016640715 .

Kirilenko, A. P., Molodtsova, T. and Stepchenkova, S. O. (2015). ‘People as sensors: Mass media and local temperature influence climate change discussion on Twitter’. Global Environmental Change 30, pp. 92–100. https://doi.org/10.1016/j.gloenvcha.2014.11.003 .

Kollmuss, A. and Agyeman, J. (2002). ‘Mind the Gap: Why do people act environmentally and what are the barriers to pro-environmental behavior?’ Environmental Education Research 8 (3), pp. 239–260. https://doi.org/10.1080/13504620220145401 .

Leggett, J. (2001). The Carbon War. New York, U.S.A.: Routledge.

Leiserowitz, A., Feinberg, G., Rosenthal, S., Smith, N., Anderson, A., Roser-Renouf, C. and Maibach, E. (2014). What’s in a name? Global warming vs. climate change . Yale University and George Mason University. New Haven, CT, U.S.A.: Yale Project on Climate Change Communication.

Li, Y., Johnson, E. J. and Zaval, L. (2011). ‘Local Warming’. Psychological Science 22 (4), pp. 454–459. https://doi.org/10.1177/0956797611400913 .

Lindsey, R. (10th January 2014). ‘Polar vortex brings cold here and there, but not everywhere’. Climate.Gov . URL: https://www.climate.gov/news-features/event-tracker/polar-vortex-brings-cold-here-and-there-not-everywhere .

Lineman, M., Do, Y., Kim, J. Y. and Joo, G.-J. (2015). ‘Talking about Climate Change and Global Warming’. PLOS ONE 10 (9). Ed. by H. J. Fowler, e0138996. https://doi.org/10.1371/journal.pone.0138996 .

Luntz, F. I. (2005). The New American Lexicon. Manassas, VA, U.S.A.: Luntz Global.

McKee, S. C. (2008). ‘Rural Voters and the Polarization of American Presidential Elections’. PS: Political Science & Politics 41 (01), pp. 101–108. https://doi.org/10.1017/s1049096508080165 .

Meraz, S. (2009). ‘Is There an Elite Hold? Traditional Media to Social Media Agenda Setting Influence in Blog Networks’. Journal of Computer-Mediated Communication 14 (3), pp. 682–707. https://doi.org/10.1111/j.1083-6101.2009.01458.x .

Mitchell, A. and Hitlin, P. (2013). ‘Twitter reaction to events often at odds with overall public opinion’. Pew Research Center . URL: http://www.pewresearch.org/2013/03/04/twitter-reaction-to-events-often-at-odds-with-overall-public-opinion/ .

Mohri, K. (1953). ‘On the Fields of Wind and Temperature over Japan and Adjacent Waters during Winter of 1950-1951’. Tellus 5 (3), pp. 340–358. https://doi.org/10.1111/j.2153-3490.1953.tb01066.x .

Neuendorf, K. A. (2017). The Content Analysis Guidebook. 2nd ed. Thousand Oaks, CA, U.S.A.: SAGE Publications, Inc.

Newman, T. P. (2016). ‘Tracking the release of IPCC AR5 on Twitter: Users, comments, and sources following the release of the Working Group I Summary for Policymakers’. Public Understanding of Science , p. 0963662516628477. https://doi.org/10.1177/0963662516628477 .

Nielsen, K. H. and Kjærgaard, R. S. (2011). ‘News Coverage of Climate Change inNature NewsandScienceNOW during 2007’. Environmental Communication 5 (1), pp. 25–44. https://doi.org/10.1080/17524032.2010.520722 .

Obama, B. (2014). ‘President Barack Obama’s State of the Union Address’. The White House, Washington, D.C., U.S.A. URL: http://www.whitehouse.gov/the-press-office/2014/01/28/president-barack-obamas-state-union-address .

O’Neill, S., Williams, H. T. P., Kurz, T., Wiersma, B. and Boykoff, M. (2015). ‘Dominant frames in legacy and social media coverage of the IPCC Fifth Assessment Report’. Nature Climate Change 5 (4), pp. 380–385. https://doi.org/10.1038/nclimate2535 .

Papacharissi, Z. and Fatima Oliveira, M. de (2012). ‘Affective News and Networked Publics: The Rhythms of News Storytelling on #Egypt’. Journal of Communication 62 (2), pp. 266–282. https://doi.org/10.1111/j.1460-2466.2012.01630.x .

Pearce, W., Holmberg, K., Hellsten, I. and Nerlich, B. (2014). ‘Climate Change on Twitter: Topics, Communities and Conversations about the 2013 IPCC Working Group 1 Report’. PLOS ONE 9 (4), e94785. https://doi.org/10.1371/journal.pone.0094785 .

Ripberger, J. T., Jenkins-Smith, H. C., Silva, C. L., Carlson, D. E. and Henderson, M. (2014). ‘Social Media and Severe Weather: Do Tweets Provide a Valid Indicator of Public Attention to Severe Weather Risk Communication?’ Weather, Climate, and Society 6 (4), pp. 520–530. https://doi.org/10.1175/wcas-d-13-00028.1 .

Rosenthal, R. and Rubin, D. B. (1983). ‘Ensemble-adjusted p values.’ Psychological Bulletin 94 (3), pp. 540–541. https://doi.org/10.1037/0033-2909.94.3.540 .

Runge, K. K., Yeo, S. K., Cacciatore, M., Scheufele, D. A., Brossard, D., Xenos, M., Anderson, A., Choi, D.-h., Kim, J., Li, N., Liang, X., Stubbings, M. and Su, L. Y.-F. (2013). ‘Tweeting nano: how public discourses about nanotechnology develop in social media environments’. Journal of Nanoparticle Research 15 (1), pp. 1–11. https://doi.org/10.1007/s11051-012-1381-8 .

Saha, S., Moorthi, S., Pan, H.-L., Wu, X., Wang, J., Nadiga, S., Tripp, P., Kistler, R., Woollen, J., Behringer, D., Liu, H., Stokes, D., Grumbine, R., Gayno, G., Wang, J., Hou, Y.-T., Chuang, H.-Y., Juang, H.-M. H., Sela, J., Iredell, M., Treadon, R., Kleist, D., Delst, P. V., Keyser, D., Derber, J., Ek, M., Meng, J., Wei, H., Yang, R., Lord, S., Dool, H. V. D., Kumar, A., Wang, W., Long, C., Chelliah, M., Xue, Y., Huang, B., Schemm, J.-K., Ebisuzaki, W., Lin, R., Xie, P., Chen, M., Zhou, S., Higgins, W., Zou, C.-Z., Liu, Q., Chen, Y., Han, Y., Cucurull, L., Reynolds, R. W., Rutledge, G. and Goldberg, M. (2010). ‘The NCEP Climate Forecast System Reanalysis’. Bulletin of the American Meteorological Society 91 (8), pp. 1015–1057. https://doi.org/10.1175/2010bams3001.1 .

Sakaki, T., Okazaki, M. and Matsuo, Y. (2013). ‘Tweet Analysis for Real-Time Event Detection and Earthquake Reporting System Development’. IEEE Transactions on Knowledge and Data Engineering 25 (4), pp. 919–931. https://doi.org/10.1109/tkde.2012.29 .

Scala, D. J. and Johnson, K. M. (2017). ‘Political Polarization along the Rural-Urban Continuum? The Geography of the Presidential Vote, 2000–2016’. The ANNALS of the American Academy of Political and Social Science 672 (1), pp. 162–184. https://doi.org/10.1177/0002716217712696 .

Scheufele, D. A. (2013). ‘Communicating science in social settings’. Proceedings of the National Academy of Sciences 110 (Supplement 3), pp. 14040–14047. https://doi.org/10.1073/pnas.1213275110 .

Schuldt, J. P., Konrath, S. H. and Schwarz, N. (2011). ‘“Global warming” or “climate change”?: Whether the planet is warming depends on question wording’. Public Opinion Quarterly 75 (1), pp. 115–124. https://doi.org/10.1093/poq/nfq073 .

Schuldt, J. P. and Roh, S. (2014). ‘Media Frames and Cognitive Accessibility: What Do “Global Warming” and “Climate Change” Evoke in Partisan Minds?’ Environmental Communication 8 (4), pp. 529–548. https://doi.org/10.1080/17524032.2014.909510 .

Schwarz, N. and Clore, G. L. (1983). ‘Mood, misattribution, and judgments of well-being: Informative and directive functions of affective states.’ Journal of Personality and Social Psychology 45 (3), pp. 513–523. https://doi.org/10.1037/0022-3514.45.3.513 .

Small, T. A. (2011). ‘What the hashtag? A content analysis of Canadian politics on Twitter’. Information, Communication & Society 14 (6), pp. 872–895. https://doi.org/10.1080/1369118x.2011.554572 .

Su, L. Y.-F., Akin, H. and Brossard, D. (2017). ‘Research Methods for Assessing Online Climate Change Communication, Social Media Discussion, and Behavior’. In: The Oxford Encyclopedia of Climate Change Communication. Ed. by M. C. Nisbet. New York, NY, U.S.A.: Oxford University Press. https://doi.org/10.1093/acrefore/9780190228620.013.492 .

Su, L. Y.-F., Cacciatore, M. A., Brossard, D., Corley, E. A., Scheufele, D. A. and Xenos, M. A. (2016). ‘Attitudinal gaps: How experts and lay audiences form policy attitudes toward controversial science’. Science and Public Policy 43 (2), pp. 196–206. https://doi.org/10.1093/scipol/scv031 .

Su, L. Y.-F., Cacciatore, M. A., Liang, X., Brossard, D., Scheufele, D. A. and Xenos, M. A. (2017). ‘Analyzing public sentiments online: combining human- and computer-based content analysis’. Information, Communication & Society 20 (3), pp. 406–427. https://doi.org/10.1080/1369118x.2016.1182197 .

Trumbo, C. (1996). ‘Constructing climate change: claims and frames in US news coverage of an environmental issue’. Public Understanding of Science 5 (3), pp. 269–283. https://doi.org/10.1088/0963-6625/5/3/006 .

Villar, A. and Krosnick, J. A. (2011). ‘Global warming vs. climate change, taxes vs. prices: Does word choice matter?’ Climatic Change 105 (1–2), pp. 1–12. https://doi.org/10.1007/s10584-010-9882-x .

Wells, C., Thomme, J. V., Maurer, P., Hanna, A., Pevehouse, J., Shah, D. V. and Bucy, E. (2016). ‘Coproduction or cooptation? Real-time spin and social media response during the 2012 French and US presidential debates’. French Politics 14 (2), pp. 206–233. https://doi.org/10.1057/fp.2016.4 .

Whitmarsh, L. (2009). ‘What’s in a name? Commonalities and differences in public understanding of “climate change” and “global warming”’. Public Understanding of Science 18 (4), pp. 401–420. https://doi.org/10.1177/0963662506073088 .

Wike, R. (18th April 2016). ‘What the World Thinks About Climate Change in 7 Charts’. Pew Research Center . URL: http://www.pewresearch.org/fact-tank/2016/04/18/what-the-world-thinks-about-climate-change-in-7-charts/ .

Williams, H. T. P., McMurray, J. R., Kurz, T. and Hugo Lambert, F. (2015). ‘Network analysis reveals open forums and echo chambers in social media discussions of climate change’. Global Environmental Change 32, pp. 126–138. https://doi.org/10.1016/j.gloenvcha.2015.03.006 .

Winters, A. C. and Martin, J. E. (2016). ‘Synoptic and mesoscale processes supporting vertical superposition of the polar and subtropical jets in two contrasting cases’. Quarterly Journal of the Royal Meteorological Society 142 (695), pp. 1133–1149. https://doi.org/10.1002/qj.2718 .

Wright, S. P. (1992). ‘Adjusted P-Values for Simultaneous Inference’. Biometrics 48 (4), p. 1005. https://doi.org/10.2307/2532694 .

Yeo, S. K. and Brossard, D. (2017). Untapped sources of data on public attitudes toward science. Presented at the Encountering Science in Everyday Life: How Public Engagement with Science Shapes Long-term Attitudes. Cambridge, MA, U.S.A.: American Academy of Arts & Sciences.

Yeo, S. K., Xenos, M., Brossard, D. and Scheufele, D. A. (2014a). ‘Disconnected discourses’. Materials Today 17 (2), pp. 48–49. https://doi.org/10.1016/j.mattod.2014.01.002 .

Yeo, S. K., Cacciatore, M. A., Brossard, D., Scheufele, D. A., Runge, K., Su, L. Y., Kim, J., Xenos, M. and Corley, E. A. (2014b). ‘Partisan amplification of risk: American perceptions of nuclear energy risk in the wake of the Fukushima Daiichi disaster’. Energy Policy 67, pp. 727–736. https://doi.org/10.1016/j.enpol.2013.11.061 .

Yeo, S. K., Liang, X., Brossard, D., Rose, K. M., Korzekwa, K., Scheufele, D. A. and Xenos, M. A. (2016). ‘The case of #arseniclife: Blogs and Twitter in informal peer review’. Public Understanding of Science , p. 096366251664980. https://doi.org/10.1177/0963662516649806 .

Zaval, L., Keenan, E. A., Johnson, E. J. and Weber, E. U. (2014). ‘How warm days increase belief in global warming’. Nature Climate Change 4 (2), pp. 143–147. https://doi.org/10.1038/nclimate2093 .

Authors

Sara K. Yeo (Ph.D., University of Wisconsin-Madison) is an Assistant Professor in the Department of Communication and an affiliate with the Global Change and Sustainability Center and the Environmental Humanities Program at the University of Utah. Her research interests include science communication, public opinion of STEM issues, and information seeking and processing. In addition to her training in science communication, Dr. Yeo is trained as a bench and field scientist and holds a M.S. in Oceanography from the University of Hawai’i at Mānoa. E-mail: sara.yeo@utah.edu .

Zachary J. Handlos (Ph.D., University of Wisconsin-Madison) is a Visiting Assistant Professor in the Department of Geography at Northern Illinois University. His research interests are in synoptic meteorology, tropical meteorology, and climate science literacy. His current research involves the investigation of the large-scale environments conducive to the vertical superposition of the polar and subtropical jet streams within the Northern Hemisphere, especially within the West Pacific. E-mail: zachary.handlos@eas.gatech.edu .

Alexandra Karambelas (Ph.D., University of Wisconsin-Madison) is a Postdoctoral Research Fellow at The Earth Institute of Columbia University. Using her background in atmospheric and environmental sciences, Dr. Karambelas’ research uses air quality models and observations to assess connections between energy-sector anthropogenic emissions, ambient particulate and gaseous pollutant concentrations, and human health impacts in India. She received her Ph.D. in Environment and Resources from the University of Wisconsin-Madison. E-mail: ak4040@columbia.edu .

Leona Yi-Fan Su (Ph.D., University of Wisconsin-Madison) is an Assistant Professor at the Department of Communication at the University of Utah. Her research interests focus on the interplay between new media and society, particularly in the context of science and the environment, and on how the new media influence public opinion and understanding. E-mail: leonayifansu@gmail.com .

Kathleen M. Rose (M.S., Ohio State University) is a doctoral student in the Department of Life Sciences Communication at the University of Wisconsin-Madison. Rose’s research focuses on public opinion and understanding of controversial scientific and environmental issues. Her recent research relates to public engagement with science. E-mail: kmrose@wisc.edu .

Dominique Brossard (Ph.D., Cornell University) is Professor and Chair in the Department of Life Sciences Communication and an affiliate at the Robert & Jean Holtz Center for Science and Technology Studies, the Center for Global Studies, and the Morgridge Institute for Research at the University of Wisconsin-Madison. Her research agenda focuses on the intersection between science, media, and policy. E-mail: dbrossard@wisc.edu .

Kyle S. Griffin (M.S., University of Albany, SUNY) is a Ph.D. student in Atmospheric and Oceanic Sciences at the University of Wisconsin-Madison. His Ph.D. work focuses on identifying variability in the North Pacific jet and the driving factors behind such variability. E-mail: kylegriffin00@gmail.com .

Endnotes

1 We distinguished retweets from original posts in our analysis; approximately equivalent proportions were retweets in both monitors (climate change: 41 percent, global warming: 37 percent). Since we quantified Twitter discourses to which users are exposed in aggregate, the question of whether posts are original or retweets, while interesting, is not the focus of the current work.

2 Keywords for the climate change and global warming monitors are (“climate change” OR “#climatechange” OR “#climate #change”) and (“global warming” OR “#globalwarming” OR “#global #warming”), respectively.