1 Introduction

Political attention towards science communication, public engagement, citizen science, or open science has increased tremendously over the past decades. These labels symbolize a sociopolitical program that pursues the opening of science to society [Weingart, Joubert & Connoway, 2021]. The underlying assumption is that it is important to give non-scientific actors broad access to scientific findings and insights into scientific knowledge production to inform social and political decision-making and to influence scientific agenda setting but also to generate interest in science to legitimize its public funding [cf. Bauer, 2017]. As both a condition and a consequence of these developments, an increasing scientism, i.e. an increasing orientation and reference towards science in society has been observed [Collins, 2014]. Kahan, Scheufele and Hall Jamieson [2017] refer to “science in context” to describe the increasing penetration of public discourse with scientific content in which science (communication) has turned into a part of everyday life. This can be illustrated by different developments. For example, Albæk, Christiansen and Togeby [2003] and Summ and Volpers [2016] show that journalistic reporting increasingly refers to scientific topics and experts over time. Moreover, scientific organizations and scientists themselves use online and social media to engage with publics beyond the scientific community [Entradas et al., 2020; Jünger & Fähnrich, 2020]. In addition, publicly visible actors such as NGOs or influencers relate to science to strengthen their argument and increase public attention to their goals [Yearley, 2014]. Finally, user-generated communication related to science takes place on various social media platforms — Reddit’s science related forum r/science has over 29 million subscribers and can be considered the world’s largest science communication forum. Overall, the described developments and related changes in the science society-interface have been enabled and shaped by the digital transformation of public communication [Friedland, Hove & Rojas, 2006; Friemel & Neuberger, 2021]. As a consequence, potentially anyone can now access scientific findings and work and contribute to conversations about science. Crowd formats such as Wikipedia or Plagiarism Wikis indicate that the boundaries between scientific and lay communication become blurred [Arroyo-Machado, Torres-Salinas, Herrera-Viedma & Romero-Frías, 2020]. Whereas science communication by users on social media platforms such as Reddit could be regarded as a strong trend toward the fulfillment of the political aspiration for the “democratization” of science [Chilvers & Kearnes, 2020], there are also concerns regarding a shift in the societal order of knowledge [Neuberger et al., 2021]. Especially, the losing influence of traditional intermediaries such as journalists has been often regarded as a threat towards public communication quality — also in the context of science communication [Fähnrich, Weitkamp & Kupper, 2023; Massarani, Entradas, Fernandes Neves & Bauer, 2021]. These concerns are rooted in normative ideas of democratic discourse and the functional role that is attributed to journalism such as ensuring diversity of content, applying standardized workings and norms to assure discourse quality (e.g. such as the use of reliable sources), and presenting multiple perspectives and critique to enable qualified opinion formation [Neuberger, 2018]. Against this backdrop, it has been doubted that user-generated content, i.e. published content produced by persons outside the realm of professional routines of journalism and/or science [Naab & Sehl, 2016], can compensate for the decline of science journalism and professional science communication. However, there is few evidence of the actual nature of user communication in science-related discourse. It is thus an empirical question which patterns user-generated science communication exhibits, and to what extent it approaches normative discourse standards [Jönsson & Örnebring, 2011].

The online platform Reddit is well suited to explore this question, because the forum offers interaction opportunites that illustrate the formation and spread of popular and controversial content [Jasser, Garibay, Scheinert & Mantzaris, 2022]. r/science can be regarded as a well-established example of the politically fostered and digitally enabled “democratization” of science communication. Founded in 2005, Reddit allows users to post and link content in a broad range of thematic forums (so-called subreddits). While science is being discussed in many different subreddits (such as r/Covid19 for pandemic-related scientific publications), we will focus on Reddit’s r/science which has over 27 million subscribers and covers science more generally. On Reddit, posts can be commented and rated by fellow users; content is moderated based on subreddit guidelines. Reddit is thus a social “micro-cosmos” that allows for some dynamics of user-generated science communication to be traced. Against this backdrop, we are particularly interested in the topics that are negotiated and receive special attention, in the sources that users refer to, and in the level of controversy that is observable in the discussions. In detail, our study aims at answering the following three research questions:

  • How does science communication on r/science develop over time?

  • From which sources does the content on r/science stem from and how are these sources evaluated?

  • Which topics receive attention on r/science, how much do different topics initiate debates?

To respond to these questions, the paper starts with a literature review that summarizes the limited state of the art on user-generated science communication. We will show that this research has focused on different aspects of online science communication but less on communication patterns on a more general level. Moreover, Reddit — although highly attended — has hardly been the focus of science communication research, yet. We will therefore outline the specifics of our study in more detail. We will then describe our research design and methodology. Our empirical study draws on data that entail 694.147 Reddit posts from May 2007 to October 2018 and that we explore in the context of computational analyses (esp. topic modeling and content analysis). We will present our results and discuss the findings against the overall idea of the democratization of science, outline the limitations of our study, and hint at future research.

2 Literature review: discourse dynamics of science communication online

2.1 User-generated science communication

Science communication online has been broadly researched in recent years from very different perspectives [Dudo, 2015; Peters, Dunwoody, Allgaier, Lo & Brossard, 2014]. From a rather normative perspective, questions of interactivity and participation have been at the core of science communication literature. Against this backdrop, research has discussed the participatory potential of science communication online with many options for direct interventions from the public [Bucchi & Trench, 2016]. Direct online participation in this manner has been described as “communication between and among publics as well as the communication back and forth between experts and publics” [Trench, 2008, p. 128]. In the same perspective, frameworks have been developed to map public participation in the communication process [cf. Trench, 2008; for an overview Fähnrich, 2017]. For instance, the public participation model by Rowe and Frewer [2005] includes dialogue between ‘sponsors’ on the one side, e.g., a scientific organization or policy actors, and the public on the other side, in contrast to one-way communication reaching from sponsor to the public or consultation in the reverse direction. Another framework by Bucchi [2009] describes the mode of knowledge co-production that is a democratic understanding of communicating scientific research where besides experts non-experts are also responsible for knowledge production. Research focusing on the popular Reddit format “Ask me Anything” (AMAs), where experts answer questions from Reddit users [Hara, Abbazio & Perkins, 2019; Kloepper & Pyzdek, 2015], follows this focus on expert user-exchange and adds to scientists‘ contributions and motivations to the scientific discourse on Reddit. In contrast, the open culture of Reddit allows users without academic and professional backgrounds to share and discuss scientific results on their own and to challenge scientific findings or scientists on the platform.

Opportunities for further user engagement become evident in creating “subreddits”, which makes the platform a dynamic community with opportunities to develop in structure over time [e.g. P. Singer, Flöck, Meinhart, Zeitfogel & Strohmaier, 2014]. The science subreddit (r/science) offers a platform for participative and open science communication defined by an online environment, where scientists as well as other science communicators interact and therefore contribute to collective knowledge [cf. Metcalfe, Gascoigne, Medvecky & Nepote, 2022]. The structure of reddit serves this purpose by providing community based features such as liking, commenting and information linking [cf. Medvedev, Lambiotte & Delvenne, 2019].

User comments follow different dynamics leading to differences in community-building effects. On YouTube, user-generated-content can be more popular than professionally created content [Welbourne & Grant, 2016]. On Reddit, commenting by users who are strongly represented in discussion forums is evaluated as more controversial by others [Matias, 2019a]. There is also evidence that comments on r/science written by users new to the community are more likely to hurt guidelines and to be removed by moderators [Matias, 2019a].

However, despite research on AMA sessions, studies that refer to r/science are rare. Against this backdrop, we aim at broadening the perspective and focus on Reddit as a forum for user-generated science communication. We thus do not focus our research on single formats but r/science in general to explore broader discourse dynamics for user-generated science communication.

2.2 Diversity of sources and quality evaluation in science communication

The online environment is characterized by a high heterogeneity of actors contributing to the production of science communication content [e.g. Fähnrich, 2021; Guenther & Weingart, 2016]. Among those are universities and independent research institutes, media outlets and journalists, industrial and health organizations, or NGOs. Those actors produce different kinds of science-related content and have different ways to bring their messages across [Davies & Horst, 2016]. Furthermore, science enthusiasts [Henderson, 2013], hackers, artists, and designers place their messages online [Horst, Davies & Irwin, 2016]. This diversity of science communication sources is also mirrored on Reddit which enables users to post and comment on scientific content based on various sources. However, compared to traditional journalistic media, social media platforms typically lack gatekeeping and review mechanisms which makes it difficult to control the quality of interactions [J. B. Singer, 2013] and — in the context of Reddit — the quality of sources of the content that is linked. Consequently, online discourse is often assumed to show a lack of objectivity or accuracy [Hansen, 2016; Holliman, 2004]. Science information online can threaten the credibility of public discourse [Scheufele & Krause, 2019] — a threat that has fostered calls for quality promotion in recent years [e.g. Mannino et al., 2021]. r/science aims at countering quality concerns through strict guidelines1 and the interventions of over 1,500 moderators2 that enforce the subreddit rules [Lynch, 2020]. In this manner, allowing or permitting content or announcing community rules, for example, to inform new users and prevent antisocial behavior can be observed as moderators’ main activities [Matias, 2019a]. But still, the science communication provided by users on Reddit shows differences with regard to the quality and trustworthiness of sources as there is content from journalistic media, scientific organizations, and scientists but also Wikipedia content [Moyer, Carson, Dye, Carson & Goldbaum, 2015] or content linked from other social media platforms that is questionable in terms of scientific accuracy. Little research has focused on the quality of sources linked by users on Reddit. For science blogs, there is some evidence that other blogs, but also traditional news media and academic sources are linked as references [Walejko & Ksiazek, 2010]. In the context of public responses to Covid-19, Gozzi et al. [2020] investigated differences in media resources, indicating that users’ activity on Reddit concentrates on daily health and protective behavior, in contrast to media reporting evoking more interest in politics and economics. Furthermore, research suggests that overall user activity in different subreddits is dynamic and can be affected by less user activity [Zhang, Keegan, Lv & Tan, 2021]. The question is how self-referential or broad (citing various sources) discussions on r/science can be characterized and which types of sources are applied the most.

A key aspect of conversations on Reddit is the up/downvote function; this function allows users to vote on both posts as well as comments and thus to contribute to a post’s/comment’s success. Research on public opinion formation suggests also for Reddit that general crowd effects become visible by voting and commenting [Horne & Adali, 2017]. The popularity of a topic is measured according to a ranking of attention (comments), the popularity of topics (upvotes), and the controversy of posts (down-and-upvote ratio). Whether and how often users interact as submitters (providing new comments) or commenters (discussing a topic) and receiving “karma” (ratio of negative and positive user’s reactions) [Peter, 2015] can also influence their position in the social network [Buntain & Golbeck, 2014]. If a post is upvoted highly, which is shown by its score (the result of upvotes/downvotes), it is also likely that more new comments are generated, which suggests opinion leadership [Leavitt & Clark, 2014]. This is especially the case among top-level commenters [Kilgo et al., 2016]. The finding that only a very small number of users actively contribute content to the r/science community illustrates this relation [Jones, Colusso, Reinecke & Hsieh, 2019]. As mentioned before, Reddit’s specific indicators show how popular sources are in the community which is linked to the quality evaluation of posts by users in terms of relevant criteria such as accessibility, relevance, or credibility [Dohle, 2018; Lacy & Rosenstiel, 2015]. We, therefore, are interested in crowd effects concerning the popular feature of the upvotes-downvotes ratio on Reddit.

2.3 Content and content assessment in science communication

Content-wise, the plurality of platforms and actors also reflects the diversity of scientific research. Different aspects of science are made salient in media, e.g. about the consequences of climate change [Bolsen, Palm & Kingsland, 2019] or biotechnology [Marks, Kalaitzandonakes, Wilkins & Zakharova, 2007]. Controversial science issues are by no means exclusively discussed by experts [Xu, Yu & Song, 2018]. Wang and Guo [2018] show, for example, that public discussion on Twitter played a leading role in framing genetically modified mosquitoes compared to journalistic online news media. Science platforms for citizen science often have a specific thematic focus (e.g. air pollution, water quality, biodiversity) [Liu, Dörler, Heigl & Grossberndt, 2021]. In contrast, scientific discussions that are embedded in Reddit’s online posts are more diverse, for example by employing health information [Bachl, 2016] or relating to chemistry or environmental science [e.g. Jones et al., 2019]. Content on r/science likely reflects current scientific controversies as moderation guidelines for submissions specify that linked scientific findings should not be older than six months (date of publication) [Reddit, 2022].

Especially for science content, it can be assumed that scientific articles or statements by scientific institutions are linked to evoke interest and to underline scientific arguments for certain issues. Concerning specific topics on Reddit, few studies investigated their prevalence for science issues. The most searched health issues on Reddit can be summed up under discussions about diet and exercise and topics on mental health [Record, Silberman, Santiago & Ham, 2018]. Moreover, it is assumed that Reddit provides different thematic aspects and contexts on science compared to other platforms, e.g. as it has been shown for microblogging on Twitter [Büchi, 2017]. First findings of a study by Jones et al. [2019] that analyzed the topics most commonly discussed on r/science found medicine, technology, and biology as the most prominent disciplines. Furthermore, the most common fields of research were social sciences, health, and epidemiology [Jones et al., 2019]. Relating to the discourse of science communication quality [Fähnrich et al., 2023], the coverage of different scientific fields and topics on Reddit should ideally be diverse to reflect the scientific discourse in society as a whole. In our research, we are therefore interested in investigating broad and narrow thematic patterns of r/science. Recently, an analysis of the AMA sessions on r/science showed that social cues differ between subject areas. For example provocative “trolling” is more represented in discussions on astronomy than on environmental science [Tang, Abbazio, Hew & Hara, 2021]. Besides commenting, trends and controversies in discussions of scientific subfields become visible in Reddit’s upvote-downvote function that allows users to express their opinion about content. Yet, there is no research on levels of controversy of posts for different thematic fields on r/science. Moreover, evidence on the long term development is sparse.

3 Method

3.1 Data collection

To respond to our research questions we collected all r/science posts and metadata between October 2007 and May 2018 via the complete Reddit datasets [Baumgartner, Zannettou, Keegan, Squire & Blackburn, 2020] that are available via the cloud storage and data analysis site Google BigQuery. Missing metadata3 was collected via RedditAPI (Python PRAW library that allows access to Reddit’s API).

Overall, the dataset resulted in n = 694, 147 posts with metadata (median score: 1; ØScore: 87.20; median amount of comments: 0, Ø: 12.18). All in all, of the whole data set (691.254 posts), most of posts show one (21%) or no comment (56%).

We thus used a subset of data (“relevance”) that included posts with more than five comments (n = 86, 882). Reddit has a scale of controversy for comments which is computed by the proportion of up and downvotes and the undefined number of general votes. Given that we did not have access to the complete number of votes per thread we estimated controversy votes by up-downvote-ratio and number of comments. A second subset (“controversy”) added posts with an up-downvote-ratio lower than 0.6 (1 = complete approval, 0 = complete refusal), resulting in n = 12, 995 posts.

3.2 Data analysis

We employed partially automated content analysis and topic modeling. Categories were developed with an inductive approach. For detecting the most common sources that were referred to in r/science, we standardized URLS at the domain level and derived brands. For example, different domains of Yahoo were coded as product-aggregate platforms and domains of media such as huffingtonpost.com as journalistic media. We then manually coded the top 320 brands, the average agreement across all categories and coders was 95% (rα = .95). To investigate the most important topics on r/science we used topic modeling based on post titles. To apply categories, we derived inductive coding of labels and disciplines of those terms mentioned in the headings of Reddit posts. Therefore, we employed the R package spectral/STM [Roberts, Stewart, Tingley & Airoldi, 2013; Roberts, Stewart & Airoldi, 2016].

4 Results

4.1 Activity levels

We will first concentrate on general user activity on r/science (RQ1). Overall, there were 694,147 posts on r/science and 86,882 posts with more than five comments between October 2007 and May 2018.

There were in total 192,021 users contributing to posts on r/science. Apart from these registered users, 146,412 user accounts had been deleted. Like other studies on Reddit’s user activity [Jones et al., 2019; Kilgo et al., 2016], we found that a small number of users shows a large amount of activity. Data shows that the top 100 users are responsible for 47,063 Posts which is 9.62% of all posts. The average mean posts/user is moderate (median = 2.85).

Figure 1 shows the distribution of posts on r/science in the given timeframe. In general, the activity on r/science has been increasing since the early years of Reddit from 2008 to 2012 with a peak in 2013 and 2014. The growth of posts since 2011 can be potentially explained by the closing of r/reddit.com which was a prominent subreddit for general content and has influenced the growth of other more thematic subreddits [Olson, 2013].

PIC

Figure 1: Chronological distribution of all posts on r/science between October 2007 and May 2018 (n = 694, 147 posts; subset: n = 86, 882).

From 2015 to 2018 user activity has declined noticeably most likely due to new moderation guidelines that aimed at fostering more quality by making it harder to post content on the subreddit. One incident that might have promoted this development was that volunteer moderators of subreddits went on a strike for half a day.4 The “Reddit blackout” became popular in the press for moderators demanding better conditions, which was answered by Reddit’s management with an attempt at cooperation [Matias, 2015]. In 2015 Reddit widened its anti-harassment policy which resulted in the banning of inadequate subreddits [The Associated Press, 2015]. Reacting to discussions about increasing censorship, r/science published transparency reports in 2016 to point to their moderation decisions [Reddit, 2016].

To detect which posts are most discussed and therefore rated the most controversial, we included posts with an up-downvote-ratio of < 0.6 (1 = 100% agreement, 0 = complete disagreement) in a dataset (n = 12, 995 posts). The cutoff point was chosen as threads above 0.6 in our dataset usually have either a high number of upvotes and are very popular or little to no engagement. An up-downvote-ratio of 1 indicated that posts did not receive any attention and remained at the standard score of 1 which was common in the dataset. Notably, if there were more than five comments, a post on average was rated more positively than with fewer comments. We also used a separate dataset for analysis consisting of posts with more than 10 comments (n = 4, 783 posts). Overall, the up-downvote-ratio on r/science increased from 2009–2010 with a slight drop in 2012 where the frequency sank and was increasing again from 2012–2018 (n = 694, 147).

4.2 Sources of content

For answering research question 2 we will outline sources that posted comments on r/science. The sources were coded by inductive category formation5 for a subsample of 1,000 sources. For the subset with at least five comments per post (n = 86.882) there is a pattern where homepages like self.science (so self-posts like AMAs) followed by phys.org and bbc.co.uk were mentioned most. As a next step, we analyzed the controversy of sources (defined as > 5 comments; ratio < 0.6).6 Concerning the number of posts by sources, the mass media (3.637 posts), self-posts (1.730 posts), blogs (848 posts), and social media (778 posts) are most relevant (see Table 1). We found that posts citing the mass media were most common and held an up-downvote-ratio of .50 (Ø14.85 comments). Self-posts seem to be more discussed (Ø24.6 comments) and controversial, since the up-downvote-ratio is .46. Official websites appear in fairly few posts (n = 144), but reach the attention of users (Ø24.35 comments), though not rated as overall controversial (0.50) by users on average. In contrast, mere controversy can be seen in posts relating to social media and product-aggregates, with both showing an up-downvote-ratio of .46 (see Table 1).

PIC
Table 1: Sources most referred to on r/science in the dataset (Subset > 5 comments; < 0.6 up-downvote-ratio; n = 12.995 Posts).

4.3 Topics and disciplines

Furthermore, we were interested in the scientific topics and disciplines that are dominating the discourse on r/science (see RQ3). Overall, we identified 37 different topics for posts with five or more comments (n = 86, 821).7 As Figure 2 shows, relevant scientific topics include health-related issues such as diseases and risk-related research. Another important topic that we extracted refers to environmental topics like energy and climate change and its conditions and consequences. Furthermore, gender-related discussions score high. Not surprisingly, self-referential content on Reddit is also of importance, most notably AMA sessions.

Topic-wise, we can sum up for RQ 3 that the discipline of cultural studies received the lowest up-downvote-ratio (.47), and thus can be considered the most controversial in the sample, also shown by a high amount of discussion and controversy referring to gender issues (see Figure 3). Also, the discipline of life sciences and health-related topics receive controversial ratings and are discussed regularly (.47 controversy, 18.19 av. comments).

PIC

Figure 2: Scientific topics extracted from r/science from posts with five or more comments and their average upvote score (n = 86, 821).

PIC

Figure 3: Controversy, frequency, and popularity of topics (Subset 2, > 5 comments, ratio < 0.6; n = 12.995).7

5 Discussion

Changes in science communication practice demand investigations of patterns from user-generated communication online. The platform Reddit and its subsection r/science allow users to engage in public discourse about scientific content. Specific features like commenting and voting would allow for a distinct science communication agenda on r/science. Drawing form long term empirical evidence on science reporting, prominent disciplines featured in newspapers are medicine, environment, technology and biology [Clark & Illman, 2006; Elmer, Badenschier & Wormer, 2008]. Our results indicate that posts on r/science follow a comparable agenda. It should be noted that our results have limitations concerning preconditions for data collection. The method of topic modeling, while viable in this context, can be imprecise, and it is possible that we missed smaller academic fields. Based on our findings we can say that the disciplines of natural and life sciences are important and, topicwise, climate change and genetics as well as issues such as gender or health dominate the discussion on r/science. Especially the popularity of the latter could be based in news values such as sensationalism or personal concern — however it would need further investigation of Reddit users to come to a better understanding of these topic and agenda setting dynamics. Moreover, systematic analysis of news platforms and Reddit would be needed to investigate further if Reddit has an “own agenda” or shows parallels to the representation of topics in science journalism.

We have found different characteristics of user-generated science communication that indicate a certain level of quality self-control, for example, evident by users’ commenting and voting actively on content. Moreover journalistic and scientific publications play a constant role as sources for posts on r/science. Prominent sources on Reddit that link to social media and self-posts are perceived as more controversial than those from mass media and science, although differences can be considered small. As other studies suggest [e.g. Gozzi et al., 2020], there is the presumption of an “information flow” between Reddit and traditional media sources or social media.

Compared to journalistic (online) media, participation on Reddit is user-centric and therefore validated after publishing [Reddit, 2022], which holds the risk of providing inaccurate science-related information. Active users of Reddit may interpret scientific results by incorporating their own views, which can both be seen as a chance and risk for public discourse [e.g. Toepfl & Piwoni, 2015]. For r/science, we showed that over the last years users’ activity reveals variation in coverage which can be potentially explained by adopted moderation criteria. These targeted interventions also regulate the quality of submissions. Our data allow us to draw some limited conclusions about the use of (scientific) evidence, given that big media outlets and platforms are often consulted, whereas scientific institutions or journals receive moderate citations. Case studies of specific subreddits report that moderator interventions such as banning content or quarantining8 subreddits show effects on user traffic or preventing antisocial behavior [Chandrasekharan, Jhaver, Bruckman & Gilbert, 2020; Seering, Wang, Yoon & Kaufman, 2019].

Further research might detect how controversial science content could be classified and perceived by users, as well as conducting user surveys about expectations on moderator interventions. An open question is which characteristics of scientific topics are essential for users’ reactions, such as commenting and upvoting. It would be valuable to find out whether there are specific factors that influence users’ contribution to a discussion. In line with research about user comments [e.g. Kaiser, 2017; Ziegele, 2016] and message framing of online science communication [e.g. Wang & Guo, 2018], it could be possible that for example controversy or negativity and personalization drive interactivity on r/science.

Concerning crowd effects on r/science, the analysis of the content of comments would provide deeper insights on platform specific properties. As shown for the topic of climate change videos on YouTube, discussions might provide reference to scientific facts, but also expressing approval or disagreement [e.g. Shapiro & Park, 2015]. Also, the tone of scientific discussions differs between issues, as uncivil language is less common for health or environmental news than for politics or economics [Coe, Kenski & Rains, 2014]. Similar patterns can be stated for discussions on Twitter on climate change issues, where related communication shows a small incidence of polarized opinions with evidence of incivility or sarcasm [e.g. Anderson & Huntington, 2017]. Considering that r/science exhibits considerably stricter commenting policies than the social platforms mentioned before, it is open to investigation whether polarising comments are as uncommon as expected on r/science.

There might also be differences language-wise concerning content. Hubner and Bond [2022] showed that experts use more complex language when sharing scientific information compared to non-experts. The interplay between message characteristics of posts or comments and the source of information can provide interesting insights into whether there are “opinion leaders” for specific topics. In addition, this can be connected to the question of what is crucial for the popularity of posts. Is it text or visuals of content and sources that predict access to discussions better, or are there specific sentiment features that are relevant in this context? Those factors can also be of relevance in terms of credibility and quality evaluation of Reddit posts.

Despite the limitations of our study and the further research needs outlined so far, we hope that this contribution can shed some light on user-generated science communication online. Communication modes on Reddit can be classified as dialogical, e.g., the AMA’s format between scientists and users, and highly co-productive for general posting in the subreddit that was under investigation. Hopefully, our analysis of r/science can contribute to a better understanding of the complex science-society interface online and may provide fresh ideas for the continuous discussion on perspectives for participation and science communication in the digital media environment.

References

Albæk, E., Christiansen, P. M. & Togeby, L. (2003). Experts in the mass media: researchers as sources in Danish daily newspapers, 1961–2001. Journalism & Mass Communication Quarterly 80 (4), 937–948. doi:10.1177/107769900308000412

Anderson, A. A. & Huntington, H. E. (2017). Social media, science, and attack discourse: how Twitter discussions of climate change use sarcasm and incivility. Science Communication 39 (5), 598–620. doi:10.1177/1075547017735113

Arroyo-Machado, W., Torres-Salinas, D., Herrera-Viedma, E. & Romero-Frías, E. (2020). Science through Wikipedia: a novel representation of open knowledge through co-citation networks. PLoS ONE 15 (2), e0228713. doi:10.1371/journal.pone.0228713

Bachl, M. (2016). Online health information seeking in Europe: do digital divides persist? Studies in Communication and Media 5 (4), 427–453. doi:10.5771/2192-4007-2016-4-427

Bauer, M. W. (2017). Kritische Beobachtungen zur Geschichte der Wissenschaftskommunikation. In H. Bonfadelli, B. Fähnrich, C. Lüthje, J. Milde, M. Rhomberg & M. S. Schäfer (Eds.), Forschungsfeld Wissenschaftskommunikation (pp. 17–40). doi:10.1007/978-3-658-12898-2_2

Baumgartner, J., Zannettou, S., Keegan, B., Squire, M. & Blackburn, J. (2020). The Pushshift Reddit dataset. arXiv: 2001.08435

Bolsen, T., Palm, R. & Kingsland, J. T. (2019). Counteracting climate science politicization with effective frames and imagery. Science Communication 41 (2), 147–171. doi:10.1177/1075547019834565

Bucchi, M. (2009). Beyond technocracy: science, politics and citizens. doi:10.1007/978-0-387-89522-2

Bucchi, M. & Trench, B. (2016). Science communication and science in society: a conceptual review in ten keywords. TECNOSCIENZA: Italian Journal of Science & Technology Studies 7 (2), 151–168. Retrieved from http://www.tecnoscienza.net/index.php/tsj/article/view/277

Büchi, M. (2017). Microblogging as an extension of science reporting. Public Understanding of Science 26 (8), 953–968. doi:10.1177/0963662516657794

Buntain, C. & Golbeck, J. (2014). Identifying social roles in Reddit using network structure. In WWW ’14 Companion: Proceedings of the 23rd International Conference on World Wide Web, 7th–11th April 2014 (pp. 615–620). Seoul, Korea. doi:10.1145/2567948.2579231

Carson, B. (2015). Reddit’s popular ‘ask me anything’ feature is down after a key employee is gone. Insider. Retrieved from https://www.businessinsider.com/reddits-ama-subreddit-down-after-victoria-taylor-depature-2015-7

Chandrasekharan, E., Jhaver, S., Bruckman, A. & Gilbert, E. (2020). Quarantined! Examining the effects of a community-wide moderation intervention on Reddit. arXiv: 2009.11483

Chilvers, J. & Kearnes, M. (2020). Remaking participation in science and democracy. Science, Technology, & Human Values 45 (3), 347–380. doi:10.1177/0162243919850885

Clark, F. & Illman, D. L. (2006). A longitudinal study of the New York Times Science Times section. Science Communication 27 (4), 496–513. doi:10.1177/1075547006288010

Coe, K., Kenski, K. & Rains, S. A. (2014). Online and uncivil? Patterns and determinants of incivility in newspaper website comments. Journal of Communication 64 (4), 658–679. doi:10.1111/jcom.12104

Collins, H. (2014). Are we all scientific experts now? Cambridge, U.K.: Polity Press.

Davies, S. R. & Horst, M. (2016). The changing nature of science communication: diversification, education and professionalisation. In Science communication: culture, identity and citizenship (pp. 79–101). doi:10.1057/978-1-137-50366-4_4

Dohle, M. (2018). Recipients’ assessment of journalistic quality. Digital Journalism 6 (5), 563–582. doi:10.1080/21670811.2017.1388748

Dudo, A. (2015). Scientists, the media, and the public communication of science. Sociology Compass 9 (9), 761–775. doi:10.1111/soc4.12298

Elmer, C., Badenschier, F. & Wormer, H. (2008). Science for everybody? How the coverage of research issues in German newspapers has increased dramatically. Journalism & Mass Communication Quarterly 85 (4), 878–893. doi:10.1177/107769900808500410

Entradas, M., Bauer, M. W., O’Muircheartaigh, C., Marcinkowski, F., Okamura, A., Pellegrini, G., … Li, Y.-Y. (2020). Public communication by research institutes compared across countries and sciences: building capacity for engagement or competing for visibility? PLoS ONE 15 (7), e0235191. doi:10.1371/journal.pone.0235191

Fähnrich, B. (2017). Wissenschaftsevents zwischen Popularisierung, Engagement und Partizipation. In H. Bonfadelli, B. Fähnrich, C. Lüthje, J. Milde, M. Rhomberg & M. S. Schäfer (Eds.), Forschungsfeld Wissenschaftskommunikation (pp. 165–182). doi:10.1007/978-3-658-12898-2_9

Fähnrich, B. (2021). Conceptualizing science communication in flux — a framework for analyzing science communication in a digital media environment. JCOM 20 (03), Y02. doi:10.22323/2.20030402

Fähnrich, B., Weitkamp, E. & Kupper, J. F. (2023). Exploring ‘quality’ in science communication online: expert thoughts on how to assess and promote science communication quality in digital media contexts. Public Understanding of Science. doi:10.1177/09636625221148054

Friedland, L. A., Hove, T. & Rojas, H. (2006). The networked public sphere. Javnost — The Public 13 (4), 5–26. doi:10.1080/13183222.2006.11008922

Friemel, T. N. & Neuberger, C. (2021). Öffentlichkeit als dynamisches Netzwerk. In M. Eisenegger, M. Prinzing, P. Ettinger & R. Blum (Eds.), Digitaler Strukturwandel der Öffentlichkeit: historische Verortung, Modelle und Konsequenzen (pp. 81–96). Wiesbaden, Germany: Springer.

Gozzi, N., Tizzani, M., Starnini, M., Ciulla, F., Paolotti, D., Panisson, A. & Perra, N. (2020). Collective response to the media coverage of the COVID-19 pandemic on Reddit and Wikipedia: mixed-methods analysis. Journal of Medical Internet Research 22 (10), e21597. doi:10.2196/21597. arXiv: 2006.06446

Guenther, L. & Weingart, P. (2016). A unique fingerprint? Factors influencing attitudes towards science and technology in South Africa. South African Journal of Science 112 (7/8), #2016-0093. doi:10.17159/sajs.2016/20160093

Hansen, A. (2016). The changing uses of accuracy in science communication. Public Understanding of Science 25 (7), 760–774. doi:10.1177/0963662516636303

Hara, N., Abbazio, J. & Perkins, K. (2019). An emerging form of public engagement with science: Ask Me Anything (AMA) sessions on Reddit r/science. PLoS ONE 14 (5), e0216789. doi:10.1371/journal.pone.0216789

Henderson, M. (2013). The geek manifesto: why science matters. London, U.K.: Corgi Books.

Holliman, R. (2004). Media coverage of cloning: a study of media content, production and reception. Public Understanding of Science 13 (2), 107–130. doi:10.1177/0963662504043862

Horne, B. D. & Adali, S. (2017). The impact of crowds on news engagement: a Reddit case study. Proceedings of the International AAAI Conference on Web and Social Media 11 (1), 751–758. doi:10.1609/icwsm.v11i1.14977. arXiv: 1703.10570

Horst, M., Davies, S. R. & Irwin, A. (2016). Reframing science communication. In U. Felt, R. Fouché, C. A. Miller & L. Smith-Doerr (Eds.), The handbook of science and technology studies (4th ed., pp. 881–907). Cambridge, MA, U.S.A.: MIT Press. Retrieved from https://research.cbs.dk/en/publications/reframing-science-communication

Hubner, A. Y. & Bond, R. (2022). I am a scientist… Ask Me Anything: examining differences between male and female scientists participating in a Reddit AMA session. Public Understanding of Science 31 (4), 458–472. doi:10.1177/09636625211048775

Jasser, J., Garibay, I., Scheinert, S. & Mantzaris, A. V. (2022). Controversial information spreads faster and further than non-controversial information in Reddit. Journal of Computational Social Science 5 (1), 111–122. doi:10.1007/s42001-021-00121-z. arXiv: 2006.13991

Jones, R., Colusso, L., Reinecke, K. & Hsieh, G. (2019). r/science: challenges and opportunities in online science communication. In CHI ’19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 4th–9th May 2019. Glasgow, U.K. doi:10.1145/3290605.3300383

Jönsson, A. M. & Örnebring, H. (2011). User-generated content and the news. Journalism Practice 5 (2), 127–144. doi:10.1080/17512786.2010.501155

Jünger, J. & Fähnrich, B. (2020). Does really no one care? Analyzing the public engagement of communication scientists on Twitter. New Media & Society 22 (3), 387–408. doi:10.1177/1461444819863413

Kahan, D. M., Scheufele, D. A. & Hall Jamieson, K. (2017). Introduction: why science communication? In K. Hall Jamieson, D. M. Kahan & D. A. Scheufele (Eds.), The Oxford handbook of the science of science communication (pp. 1–11). doi:10.1093/oxfordhb/9780190497620.013.1

Kaiser, J. (2017). Public spheres of skepticism: climate skeptics’ online comments in the German networked public sphere. International Journal of Communication 11, 1661–1682. Retrieved from https://ijoc.org/index.php/ijoc/article/view/5557

Kilgo, D. K., Yoo, J. J., Sinta, V., Geise, S., Suran, M. & Johnson, T. J. (2016). Led it on Reddit: an exploratory study examining opinion leadership on Reddit. First Monday 21 (9). doi:10.5210/fm.v21i9.6429

Kloepper, L. & Pyzdek, A. (2015). Reddit Science AMA: using “the front page of the internet” to share your knowledge with the world! The Journal of the Acoustical Society of America 137 (4_Supplement), 2367. doi:10.1121/1.4920602

Lacy, S. & Rosenstiel, T. (2015). Defining and measuring quality journalism. Rutgers University School of Communication and Information. Retrieved August 12, 2021, from http://mpii.rutgers.edu/wp-content/uploads/sites/129/2015/04/Defining-and-Measuring-Quality-Journalism.pdf

Leavitt, A. & Clark, J. A. (2014). Upvoting hurricane Sandy: event-based news production processes on a social news site. In CHI ’14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 26th April–1st May 2014 (pp. 1495–1504). Toronto, Canada. doi:10.1145/2556288.2557140

Liu, H.-Y., Dörler, D., Heigl, F. & Grossberndt, S. (2021). Citizen science platforms. In K. Vohland, A. Land-Zandstra, L. Ceccaroni, R. Lemmens, J. Perelló, M. Ponti, … K. Wagenknecht (Eds.), The science of citizen science (pp. 439–459). doi:10.1007/978-3-030-58278-4_22

Lynch, K. S. (2020). Fans as transcultural gatekeepers: the hierarchy of BTS’ Anglophone Reddit fandom and the digital East-West media flow. New Media & Society 24 (1), 105–121. doi:10.1177/1461444820962109

Mannino, I., Bell, L., Costa, E., Di Rosa, M., Fornetti, A., Franks, S., … Zollo, F. (2021). Supporting quality in science communication: insights from the QUEST project. JCOM 20 (03), A07. doi:10.22323/2.20030207

Marks, L. A., Kalaitzandonakes, N., Wilkins, L. & Zakharova, L. (2007). Mass media framing of biotechnology news. Public Understanding of Science 16 (2), 183–203. doi:10.1177/0963662506065054

Massarani, L., Entradas, M., Fernandes Neves, L. F. & Bauer, M. W. (2021). Global science journalism report 2021: working conditions and practices, professional ethos and future expectations. SciDev.Net. Retrieved from https://www.scidev.net/wp-content/uploads/Global-Science-Journalism-Report-2021.pdf

Matias, J. N. (2015). What just happened on Reddit? Understanding the moderator blackout. Social Media Collective. Retrieved from https://socialmediacollective.org/2015/07/09/what-just-happened-on-reddit-understanding-the-moderator-blackout/

Matias, J. N. (2019a). Preventing harassment and increasing group participation through social norms in 2,190 online science discussions. Proceedings of the National Academy of Sciences 116 (20), 9785–9789. doi:10.1073/pnas.1813486116

Matias, J. N. (2019b). The civic labor of volunteer moderators online. Social Media + Society 5 (2). doi:10.1177/2056305119836778

Medvedev, A. N., Lambiotte, R. & Delvenne, J.-C. (2019). The anatomy of Reddit: an overview of academic research. In F. Ghanbarnejad, R. Saha Roy, F. Karimi, J.-C. Delvenne & B. Mitra (Eds.), Dynamics On and Of Complex Networks III: machine learning and statistical physics approaches (pp. 183–204). doi:10.1007/978-3-030-14683-2_9

Metcalfe, J., Gascoigne, T., Medvecky, F. & Nepote, A. C. (2022). Participatory science communication for transformation. JCOM 21 (02), E. doi:10.22323/2.21020501

Moyer, D., Carson, S., Dye, T., Carson, R. & Goldbaum, D. (2015). Determining the influence of Reddit posts on Wikipedia pageviews. Proceedings of the International AAAI Conference on Web and Social Media 9 (5), 75–82. doi:10.1609/icwsm.v9i5.14700

Naab, T. K. & Sehl, A. (2016). Studies of user-generated content: a systematic review. Journalism 18 (10), 1256–1273. doi:10.1177/1464884916673557

Neuberger, C. (2018). Journalismus in der Netzwerköffentlichkeit. In C. Nuernbergk & C. Neuberger (Eds.), Journalismus im Internet: Profession — Partizipation — Technisierung (pp. 11–80). doi:10.1007/978-3-531-93284-2_2

Neuberger, C., Weingart, P., Fähnrich, B., Fecher, B., Schäfer, M. S., Schmid-Petri, H. & Wagner, G. G. (2021). Der digitale Wandel der Wissenschaftskommunikation. Berlin-Brandenburgische Akademie der Wissenschaften. Berlin, Germany. Retrieved from https://edoc.bbaw.de/opus4-bbaw/frontdoor/index/index/year/2021/docId/3526

Olson, R. S. (2013). Retracing the evolution of Reddit through post data. Dr. Randal Olson’s personal blog. Retrieved from http://www.randalolson.com/2013/03/12/retracing-the-evolution-of-reddit-through-post-data/

Peter, J. (2015). Visualizing Reddit: exposing user communication patterns through data visualization on Reddit.com. Blucher Design Proceedings 2 (2) 7º Congresso Internacional de Design da Informação, 1668–1674. doi:10.5151/designpro-CIDI2015-congic_65

Peters, H. P., Dunwoody, S., Allgaier, J., Lo, Y.-Y. & Brossard, D. (2014). Public communication of science 2.0: is the communication of science via the “new media” online a genuine transformation or old wine in new bottles? EMBO Reports 15 (7), 749–753. doi:10.15252/embr.201438979

Record, R. A., Silberman, W. R., Santiago, J. E. & Ham, T. (2018). I sought it, I Reddit: examining health information engagement behaviors among Reddit users. Journal of Health Communication 23 (5), 470–476. doi:10.1080/10810730.2018.1465493

Reddit (2016). First transparency report for /r/science. Retrieved from https://www.reddit.com/r/science/comments/43g15s/first_transparency_report_for_rscience/

Reddit (2021). Quarantined subreddits. Retrieved from https://reddit.zendesk.com/hc/en-us/articles/360043069012-Quarantined-Subreddits

Reddit (2022). r/science. Submission rules. Retrieved from https://www.reddit.com/r/science/wiki/rules/

Roberts, M. E., Stewart, B. M. & Airoldi, E. M. (2016). A model of text for experimentation in the social sciences. Journal of the American Statistical Association 111 (515), 988–1003. doi:10.1080/01621459.2016.1141684

Roberts, M. E., Stewart, B. M., Tingley, D. & Airoldi, E. M. (2013). The structural topic model and applied social science. In Advances in Neural Information Processing Systems Workshop on Topic Models: Computation, Application, and Evaluation. Retrieved from https://wcfia.harvard.edu/publications/structural-topic-model-and-applied-social-science

Rowe, G. & Frewer, L. J. (2005). A typology of public engagement mechanisms. Science, Technology, & Human Values 30 (2), 251–290. doi:10.1177/0162243904271724

Scheufele, D. A. & Krause, N. M. (2019). Science audiences, misinformation, and fake news. Proceedings of the National Academy of Sciences 116 (16), 7662–7669. doi:10.1073/pnas.1805871115

Seering, J., Wang, T., Yoon, J. & Kaufman, G. (2019). Moderator engagement and community development in the age of algorithms. New Media & Society 21 (7), 1417–1443. doi:10.1177/1461444818821316

Shapiro, M. A. & Park, H. W. (2015). More than entertainment: YouTube and public responses to the science of global warming and climate change. Social Science Information 54 (1), 115–145. doi:10.1177/0539018414554730

Singer, J. B. (2013). User-generated visibility: secondary gatekeeping in a shared media space. New Media & Society 16 (1), 55–73. doi:10.1177/1461444813477833

Singer, P., Flöck, F., Meinhart, C., Zeitfogel, E. & Strohmaier, M. (2014). Evolution of Reddit: from the front page of the internet to a self-referential community? In WWW ’14 Companion: Proceedings of the 23rd International Conference on World Wide Web, 7th–11th April 2014 (pp. 517–522). Seoul, Korea. doi:10.1145/2567948.2576943

Summ, A. & Volpers, A.-M. (2016). What’s science? Where’s science? Science journalism in German print media. Public Understanding of Science 25 (7), 775–790. doi:10.1177/0963662515583419

Tang, Y., Abbazio, J. M., Hew, K. F. & Hara, N. (2021). Exploration of social cues in technology-mediated science communication: a multidiscipline analysis on ‘Ask Me Anything (AMA)’ sessions in Reddit r/science. JCOM 20 (07), A04. doi:10.22323/2.20070204

The Associated Press (2015, June 10). Reddit removes 5 groups after creating harassment policy. The New York Times. Retrieved from https://web.archive.org/web/20150612114033/http://www.nytimes.com/aponline/2015/06/10/business/ap-us-reddit-subreddit-bans.html

Toepfl, F. & Piwoni, E. (2015). Public spheres in interaction: comment sections of news websites as counterpublic spaces. Journal of Communication 65 (3), 465–488. doi:10.1111/jcom.12156

Trench, B. (2008). Towards an analytical framework of science communication models. In D. Cheng, M. Claessens, T. Gascoigne, J. Metcalfe, B. Schiele & S. Shi (Eds.), Communicating science in social contexts: new models, new practices (pp. 119–135). doi:10.1007/978-1-4020-8598-7_7

Walejko, G. & Ksiazek, T. (2010). Blogging from the niches. Journalism Studies 11 (3), 412–427. doi:10.1080/14616700903407429

Wang, W. & Guo, L. (2018). Framing genetically modified mosquitoes in the online news and Twitter: intermedia frame setting in the issue-attention cycle. Public Understanding of Science 27 (8), 937–951. doi:10.1177/0963662518799564

Weingart, P., Joubert, M. & Connoway, K. (2021). Public engagement with science — origins, motives and impact in academic literature and science policy. PLoS ONE 16 (7), e0254201. doi:10.1371/journal.pone.0254201

Welbourne, D. J. & Grant, W. J. (2016). Science communication on YouTube: factors that affect channel and video popularity. Public Understanding of Science 25 (6), 706–718. doi:10.1177/0963662515572068

Xu, Q., Yu, N. & Song, Y. (2018). User engagement in public discourse on genetically modified organisms: the role of opinion leaders on social media. Science Communication 40 (6), 691–717. doi:10.1177/1075547018806526

Yearley, S. (2014). Environmentalists as communicators of science: advocates and critics. In M. Bucchi & B. Trench (Eds.), Routledge handbook of public communication of science and technology (2nd ed., pp. 113–124). doi:10.4324/9780203483794

Zhang, J. S., Keegan, B. C., Lv, Q. & Tan, C. (2021). Understanding the diverging user trajectories in highly-related online communities during the COVID-19 pandemic. Proceedings of the International AAAI Conference on Web and Social Media 15 (1), 888–899. doi:10.1609/icwsm.v15i1.18112. arXiv: 2006.04816

Ziegele, M. (2016). Nutzerkommentare als Anschlusskommunikation: Theorie und qualitative Analyse des Diskussionswerts von Online-Nachrichten. doi:10.1007/978-3-658-12822-7

Authors

Dr. Jonas Kaiser is an Assistant Professor for Journalism at Suffolk University and Faculty Associate at the Berkman Klein Center for Internet & Society at Harvard University. He is an inaugural member of the Spotify Safety Advisory Council. Jonas’ research is located at the intersection of computational social science and public sphere theory and includes topics such as algorithm, digital journalism, mis- and disinformation, and science communication.
@JonasKaiser E-mail: jkaiser@cyber.harvard.edu

Dr. Birte Fähnrich is Adjunct Professor at the Institute for Media and Communication Studies at Freie Universität Berlin. Before, she held a Postdoc-position at the Berlin-Brandenburg Academy of Sciences and Humanities, and was Principle Investigator at Zeppelin University for the EU-funded project RETHINK. Her research focusses on digital science communication, public and political engagement, and university communication. Since November 2021, Birte is also employed as a senior policy officer at the German Federal Ministry of Education and Research.
@birte_faehnrich E-mail: birte.faehnrich@fu-berlin.de

Laura Heintz is research associate and PhD student in the Institute for Publizistik at Johannes Gutenberg University Mainz. Her research focusses on User-Generated-Content and Science-Society-relations and persuasive media effects, especially at the intersection of science communication, health, risk and technologies.
@LauraHeintz7 E-mail: Lheintz@uni-mainz.de

Endnotes

1On r/science comments have to be based on scientific findings less than 6 months old, therefore, expression of opinion without evidence is deleted by moderators [Reddit, 2022].

2Most subreddit volunteers apply actively for moderator positions, while previous moderation experience is often expected [Matias, 2019b].

3Including date, headings, linked domains, up-and-downvotes, and number of comments.

4The trigger for this intervention was that Victoria Taylor, an employee of the subreddit Ask Me Anything, was fired [Carson, 2015].

5Those categories included journalistic mass media, scientific journals, websites of scientific organizations, blogs, websites of government institutions, product aggregates/platforms, social media, self-posts originating from Reddit.com, other websites, or miscellaneous.

6Referring to the subset with > 5 comments; < 0.6 up-downvote-ratio; n = 12.995 Posts.

7Several Reddit posts that were part of our sample were not long enough for topic modeling (e.g., consisted of enough words after text preparation to be considered useful) and were thus removed from the corpus.

7The number of analyzed posts reflect the subset of posts in our sample that fit our criteria for controversy.

8Those subreddits are not prohibited by the content policy, but “average Redditors may nevertheless find content highly offensive or upsetting” [Reddit, 2021].