1 Introduction
Most science communicators would say they serve the community, but what do we mean by that word? In our discipline and profession, the term ‘community’ is frequently used in the singular generic, in a similar way to ‘the public’ or ‘society’. If pluralised, it often denotes groups of people (or small regions) who might be of interest to communicate with on some specialised outreach or consultation projects, but inherently only of specific, localised significance. Communities are rarely seen to be a standard organising principle for science communication activities. Nor are they routinely seen as the ideal level at which to focus science communication efforts. In this paper, we seek to challenge those norms and propose re-centring communities within science communication.
While sociological studies foundational to science communication engaged with communities in deep ethnographic detail [e.g. studies in Irwin and Wynne, 1996 ], recent high profile science communication research papers barely mention communities. For example, in a 2013 special issue of PNAS devoted to ‘the science of science communication’, all papers focused on the individual, psychological level or the mass, societal level, usually only using the word ‘community’ in the singular, or more commonly using it to refer to the ‘scientific community’. The word was neither used in the editorial [Fischhoff and Scheufele, 2013 ] nor in editor Scheufele’s [ 2013 ] contribution, despite its title ‘Communicating science in social settings’. Evelend and Cooper’s contribution to the issue proposed an integrated model of communication influence on beliefs, but it overtly focused on individual factors, stating they would leave ‘for future theorizing the role of factors such as network structures and community-level influences’ [Eveland and Cooper, 2013 , p. 14093]. Dietz’s paper focused on public deliberation and identified the importance of what he called ‘community expertise’ [Dietz, 2013 , p. 14084], but did so cursorily and illustrated the concept with a society-level example about ‘members of the public’. A paper by Kahan [ 2015 ] on the same topic (‘the science of science communication’) used the word ‘communities’, but it did not engage with its meanings for science communication. Kappel and Holmen’s [ 2019 ] taxonomy of science communication aims mentioned communities only in the context of ‘audiences’ understanding local environments. For a body of literature framed by its authors as summarising the key evidence-based principles of science communication, the idea of communities is conspicuous by its absence.
1.1 Communities as a priority in allied fields
Yet in other fields, there is a growing, if belated, understanding of the centrality of communities to any science-society relationship or enterprise. Biomedical researchers have slowly acknowledged the lack of human diversity in genetic studies and clinical trials, and when seeking to increase that diversity, found the most successful way to recruit wary and mistrustful research participants is to build long term, meaningful relationships with communities [Bentley, Callier and Rotimi, 2017 ; Hughson et al., 2016 ; Oh et al., 2015 ]. This is particularly the case when researchers have sought to increase diversity in ethnic heritage studies, only to realise members of target ethnic groups harbour deep-seated mistrust of Western science and medicine for a range of reasons, including awareness of Western scientists’ past unethical actions towards ethnic minorities. To navigate these factors, researchers proposed (among other measures) ensuring research teams are diverse and include core members belonging to the communities of interest; conducting recruitment and research within community accessible spaces; and involving communities in research design and general communication about the research field [Bentley, Callier and Rotimi, 2017 ; Hughson et al., 2016 ; Oh et al., 2015 ]. In other words, researchers should place communities at the forefront of their endeavours.
In a more general sense, successful communication outside the Western mainstream is frequently community-oriented rather than pitched at individual or mass levels, and is communicated by community members within their own communities. This includes health communication with First Peoples on the continents of Australia and Africa, for whom the community level is one of the most important and common levels for discussing issues, building knowledge and making decisions [Finlay, Raman et al., 2021 ; Bagamoyo College of Arts et al., 2002 ; Chandler et al., 2015 ; Finlay and Wenitong, 2020 ; Junyent and Rasekoala, 2019 ; Levy, 2015 ]. The growing field of knowledge brokering is similarly predicated on building interpersonal relationships, in this case primarily between researchers and policy-makers. Such relationships are essential for research to be applied in decision-making, particularly in high stakes areas such as environmental management [Cvitanovic et al., 2017 ; Michaels, 2009 ]. This is a specific kind of community-oriented science communication, where the communities of interest are government departments, research institutes, and other organisations.
1.2 Lessons for science communicators
This work reveals the critical importance of deep, interpersonal relationship building at the level of shared identity — community — for forging the trust that enables meaningful conversations to take place. Some science communicators concerned about public information overload, lack of public trust in experts, the influence of fake news and social media bots may seek a one-size-fits-all, whole of society solution to change the state of affairs. Yet the evidence from other fields tells us there is rarely such a thing, and deep change often comes at the community level, where people can discuss, deliberate, challenge, question, reconsider and converse about matters at length with trusted others, or at least with people they understand and are mutually co-invested in. Social change is connected to a sense of self-efficacy, which on political matters means addressing the profound disenfranchisement and a lack of social power many people face, often from years or centuries of marginalisation, exploitation and oppression [Hardina, 2006 ; Rusch, Walden and DeCarlo Santiago, 2020 ]. The detail of such matters is best addressed at the community level, even if changing structural oppression also requires action at the broader level of the nation state.
This also demonstrates the unique, central role to be played by communicators who are already part of communities within which, and with whom, they are communicating. The science communication sector will benefit substantially if professional bodies, educators, trainers, consultancies and employers more actively invite, foster and promote diversity within our ranks because of the unique networks people are part of. Of course, some diversity in ethnicity, culture, language, gender, sexuality, class, religion and disability is already present among science communicators, at least to an extent, but its deep value and importance seems inadequately understood and often celebrated only at the superficial level of acknowledging its existence. This superficial measure aside, science communication remains profoundly exclusionary in complex ways that prohibit greater diversity and perpetuate marginalisation, as numerous authors have recently noted [Finlay, Raman et al., 2021 ; Roberson and Orthia, 2021 ; Brown, Roche and Hurley, 2020 ; Canfield et al., 2020 ; Dawson, 2019 ; Márquez and Porras, 2020 ; Orthia, 2020 ; Rasekoala, 2020 ]. Much more work needs to be done to redress this, and it will likely go hand-in-hand with a communities-oriented approach because of the deep engagement that it entails. Polk and Diver [ 2020 ] have demonstrated some success in this by centring equity for marginalised communities in communications framing. Wenzel [ 2020 ] advocates for community-centred journalism built on interpersonal relationships and intimate knowledge of shared place for similar, equity-based reasons.
In this paper, we argue that as science communicators, we must attune ourselves to the community level in more profound ways, and with the concerted attention to diversity that implies. This is necessary if we want our impact to be lasting — whether we want to change attitudes and behaviours on controversies relevant to science, to foster democratic voice in policy or public governance of science, or simply to promote rich and vibrant exchange of ideas among people. We first review previous literature from the science communication research corpus, identifying three existing models of community-oriented science communication. We then present some recent Australian examples from public health communication, air pollution management and science centre inclusivity, which further elaborate the models and illustrate the value of community-centred approaches. In our conclusion, we draw together emergent lessons and suggest ways forward.
2 Previous science communication studies focused on communities
To identify existing literature on this topic, we searched the Scopus database for the words ‘community’ or ‘communities’ in all years, limiting our search to the four main science communication journals: International Journal of Science Education Part B: Communication and Public Engagement , Journal of Science Communication , Public Understanding of Science , and Science Communication . The approximately 300 returned hits were manually refined to 37 after selecting papers that meaningfully engaged with the concept of non-academic ‘communities’ in their abstract and full text. Studies using a single community as a convenient study site, or using ‘community’ as a synonym for ‘public’, were excluded. Nine of those remaining concerned communities’ attitudes or communication preferences, while 28 detailed science communication activities and programs. The full list is referenced in supplementary material.
Within the 37 papers, the working definition of ‘community’ was almost always geographic, and sometimes further defined by common demographics, identities, experiences, professions or interests. These definitions are in concert with studies of communities in other fields [e.g. Mills, 2004 ; Ragin et al., 2008 ; Simon, 2016 ]. Face-to-face interactions, or sometimes intensive online interactions, are often implied in definitions of community [Duchsherer et al., 2020 ; Mills, 2004 ], suggesting that building and maintaining interpersonal relationships over time is core to sustaining community. An active, multi-directional, sustained communication culture in fact seems to be a core principle for building and defining communities. As a result, Kim, Cho and Song [ 2019 , p. 40] note community engagement is ‘historically and socially situated’, and each communication culture will operate differently. In addition, Roth and Lee [ 2002 ] use a community example to contend that phenomena such as science literacy are inherently collective, and socially and physically situated, not properties of individuals. This inter-relationship of knowledge, communication and communities suggests communities should be a prime focus for science communication activities.
Among the 28 program-detailing studies, we identified three models of existing community-oriented science communication, which we labelled neighbourly , problem-solving and brokering . The models complement rather than overlap familiar concepts such as one-way, dialogue or participatory science communication, any of which may be incorporated into community-oriented activities at different points. The same is true for ‘traditional citizen science’ or ‘community-based participatory research’; examples of these may appear in any of the three models, though the former is most likely to coincide with neighbourly science communication [e.g. Roger and Klistorner, 2016 ] and the latter with problem-solving [e.g. Hoover, 2016 ]. The primary difference between our three models is their priority: brokering science communication is primarily concerned with serving the community’s interests, while neighbourly approaches tend to serve the interests of science, and problem-solving approaches prioritise practical solutions to a problem.
Neighbourly programs are not unusual among science communication outreach activities, and many more examples than the five we found would likely have appeared in our literature search if they had used the word ‘communities’ in their abstract. Neighbourly programs have a community-centred focus only in the mundane sense that offline science communication activities are inherently local to somewhere. For example, members of one university department characterised themselves as serving the local community because they organised forums city residents could attend, and encouraged dialogue between residents and researchers [Ward, Howdle and Hamer, 2008 ]. Organisers of a ‘Nerd Nite’ event took science communication to a city pub, ‘to bring science to the target audience instead of expecting the target audience to go to places of science’ [Tan and Perucho, 2018 , p. 823]. While undoubtedly an important aspect of science communication, this approach is relatively weakly community-oriented because science communicators may engage in interpersonal conversations with local residents, but they do not specifically set out to build and maintain sustained long-term relationships with specific groups of people. Neighbourly aims are typically broad, to promote ‘engagement with science’ or similar, and while neighbourly science communicators are identifiable because they are affiliated with science-related institutions, we cannot necessarily identify other communication partners. That said, such programs may be the starting point for relationship-building with community groups. To promote greater community inclusion, some neighbourly programs have also worked with existing community organisations [Canovan, 2020 ].
Problem-solving science communication, in contrast, concerns specific risks to the local environment or to community members’ health and safety. Problem-solving activities are strongly community-oriented for strategic or principled reasons, and seek a practical outcome of policy or social change on an issue. They differ in whether they are initiated by community members [e.g. Sannazzaro, 2016 ] or by external scientific or technical authorities [e.g. Yli-Kauhaluoma and Hänninen, 2014 ], though some programs initiated by external authorities become community-driven once long-term, two-way relationships are built with existing community networks [e.g. Boyer, Roth and Wright, 2009 ]. An essential component of this transformation is community members’ ability to co-design the program based on their own experiences and priorities, and thus to commence co-producing its future iterations. Indeed, problem-solving programs frequently will not gain traction if they are imposed from outside because of community members’ desire to protect local autonomy, including in modes of communication and decision-making [Griffin and Dunwoody, 1997 ; Putsche et al., 2017 ]. Kim [ 2012 ] argued that even global problems such as climate change can only be solved at the community level, with people working together to co-design solutions to it as a shared practical problem. Conversely, a weak sense of community may lead to failed community-oriented ventures when imposed from outside [Garland, 1999 ]. These are key reasons for supporting a genuinely community-embedded approach to science communication [Ofori-Parku, 2018 ]. However, problem-solving programs can drift away from a community orientation when competing interests are involved. For example, a Colombian science centre developed a program to work with local residents living on a garbage dump to raise awareness of health risks and to redevelop the area under community control. The program was successful in raising awareness and redeveloping the area, but government relocation policies left community members in equally poor conditions elsewhere, prompting the study’s author to recommend that science centres involved in community programs must consider the big picture carefully and adapt to supporting communities in new ways [Aguirre, 2014 ].
Brokering programs share the diffuse aim of ‘STEM engagement’ with neighbourly science communication, but they operate from within communities to enhance communities’ opportunities for engagement. In this model, science communicators who share an identity with the target community, or members of the community who are specifically trained, act as brokers , matching community members to relevant science communication activities and resources. They may go further to co-design novel science communication initiatives with other community members. Brokering programs may consist of individual brokers [e.g. Allen et al., 2020 ], community-located facilities such as knowledge rooms [e.g. Streicher, Unterleitner and Schulze, 2014 ], camps for people from particular Indigenous or ethnic communities [e.g. Cheeptham et al., 2020 ] or technologies enabling community access to science-related information [e.g. Coleman, 2012 ]. Science communicators involved with implementing these programs emphasise the importance of being open to community interests and needs, tailoring activities and facilities to community norms, and welcoming community members who are less interested as well as the enthusiastic. Having a particular community lead their own communication journey, rather than engaging with communities to achieve a preconceived agenda, is what fundamentally differentiates brokering from neighbourly and problem-solving science communication.
Of the 28 papers studying specific programs, 18 fit the problem-solving model, which parallels well-established approaches to community change in other fields. Brokering science communication (5 papers) is the most novel, most community-oriented of the three models, and we suggest researchers and practitioners invest more in it. In the next section, we describe three recent examples from Australia that illustrate the value of community-oriented science communication under these two models. We start with two problem-solving approaches: programs for communicating health information with ethnic minority communities; and a case study of an environmental health problem solved by community-based engagement in a rural town. Our third example concerns a co-designed brokering approach to better welcoming local teenagers within a science centre.
3 Examples of community-oriented science communication
3.1 Science and health communication for ethnic minority communities
The need to effectively communicate scientific information to communities has become more apparent and pressing during COVID-19, considering the disproportionate impact of the pandemic on various minority communities [Finlay and Wenitong, 2020 ; Grills and Butcher, 2020 ; Tai et al., 2021 ]. There is a need to move from a ‘deficit’ or negative model of science communication, wherein minority groups need to be ‘talked to’ about negative attributes that they should modify or practices they must adopt, to a more positive and engaged mode, where the aspects of a community’s behaviour that can help in addressing a health threat are acknowledged [Airhihenbuwa et al., 2020 ]. Moreover, the content of scientific messages and the means by which they are communicated require tailoring to account for differences in culture, values, literacy, and concept perception [Scrimshaw, 2019 ]. Health communication needs to go beyond translating information intended for the general public and conveying it through usual online, media, and print channels. Instead, communities need to be engaged before, during, and after the onset of a pandemic to build trust and develop appropriate communication strategies and channels [Crouse Quinn, 2008 ]. Scientific communication for communities must be done with communities: coordinating with community leaders to sensitively relay information and model desirable practices for limiting infection spread; and working closely with in-community organizations [Van Bavel et al., 2020 ] to ensure that the key messages reach the most marginalised, disenfranchised, and vulnerable community members.
There have been successful efforts to engage with communities for communicating various forms of health information, lessons which can be used in designing and conducting effective communication strategies for minority groups during a pandemic. A good example of health communication for culturally and linguistically diverse (CALD) communities is the Pink Sari project [Macnamara and Camit, 2017 ]. Its purpose is to identify and overcome challenges and barriers to effective communication with CALD communities, with the goal of persuading 50-to-74 year-old women from Indian and Sri Lankan backgrounds in New South Wales, Australia to regularly undertake mammograms, or breast cancer screening. The project began with formative research, establishing a steering group with representatives from refugee health service providers and breast cancer screening clinics servicing areas with relatively large Indian and Sri Lankan migrant populations. As part of its formative research, the group also performed a global literature review on cancer detection programmes for CALD communities, surveys and focus groups among Indian and Sri Lankan women, and a cultural competency study in a breast screening clinic. From the findings on cultural beliefs of Indian and Sri Lankan women about breast cancer and their concerns regarding screening, the team developed health communication strategies focused on establishing community partnerships, identifying community champions, planning and designing programs collaboratively with the community, and having native speakers write information materials. The project then implemented a range of activities ranging from co-creating a logo, launching a website and Facebook page, conducting community forums and information sessions, marching in cultural parades, and holding a fashion show and photo exhibition. Through these efforts, they have managed to engage with more than 10,000 women of Indian or Sri Lankan backgrounds. In the year the project was implemented, there was also an 8% increase in the total number of New South Wales Indian and Sri Lankan women aged 50–69 having a mammogram [Macnamara and Camit, 2017 ].
For the current COVID-19 pandemic, there have been some efforts by health behaviour change scientists to engage with CALD communities. Wild et al. [ 2020 ] discuss some challenges in communicating COVID-19 information to minority communities in Melbourne, Australia, which were identified through dialogue events they initiated. These include a lack of: information translated into all spoken languages in Melbourne; contextualised health messages; engagement with CALD groups for design and evaluation of informational materials; trusted messengers and CALD voices in the government and health departments; and accessible communication channels. Their work has highlighted the importance of going beyond simply translating COVID-19 health information, and instead ensuring that there is partnership with community leaders to integrate context into the translation, account for multiple dialects, and address misconceptions regarding COVID-19 tests. They have also underscored the critical role of religious and faith leaders in CALD communities in promoting and modelling desired behaviours, in addition to providing options for attending religious ceremonies online. CALD community leaders should also be engaged, given their familiarity with the communication platforms commonly used by community members and their ability to reach out to other members by phone or online videos. Scientific and medical communication should also be sensitive enough so as not to single out communities as the likely source of an outbreak, in order to prevent racism and stigma and to ensure that community members seek testing. Finally, it is vital to create a national advisory body for CALD communities that will not only support successful communication but also ensure that voices of new migrant groups, particularly those without established networks and representation, are heard.
Although COVID-19 is a global problem, a communities-oriented problem-solving approach involving co-design principles is a critical part of managing it, especially in communities and regions that are disproportionately affected. Methods and insights from the Pink Sari project and the community engagement work of Wild et al. [ 2020 ] can serve as bases for communicating critical COVID-19 information to other minority communities, ensuring that they are positioned not just as recipients, but also as co-creators and co-disseminators of health information.
3.2 Problem-solving through co-design of air quality monitoring systems
In 2015, Kahan exhorted science communication be adopted as the ‘new political science’, needed by ‘mature liberal democracies…suited to the distinctive challenge of enabling citizens to reliably recognise the enormous stock of knowledge that their freedom and diversity make possible’ [p. 10]. Yet science communication still does not seem to provide mechanisms for communities to recognise and apply their enormous stock of knowledge. Nor do communities seem to be considered collaborators or co-deliverers of science communication initiatives. If communities were involved in co-design of science communication, what might that look like?
The concept of co-design can be applied to a broad range of fields, from literal design through to addressing social and economic issues [Szebeko and Tan, 2010 ]. At heart, co-design involves the people who will be the end users of a product, service or policy. They are involved throughout the development process as genuine collaborators [Sanders and Stappers, 2008 ]. One example of co-design between scientists and community members is that of the Environmental Protection Agency (EPA) in Victoria, Australia after the Hazelwood Mine incident.
On 9 February, 2014, a fire started at the Hazelwood Power Station, in Morwell in Victoria’s Latrobe Valley, caused by embers from nearby bushfires spotting into the Hazelwood open cut brown coal mine [Teague, Catford and Petering, 2014 ]. This type of mine is particularly susceptible to fire, and once a fire starts within one, it is difficult to extinguish. The fire in the Hazelwood mine burned for 45 days and covered the town of Morwell in smoke and ash for most of that time, creating both an environmental and a public health emergency, with vulnerable members of the community advised to leave [Teague, Catford and Petering, 2014 ]. Feedback from community members highlighted that the air quality information provided during the fire was not easy for them to understand, which added frustration and contributed to a breakdown of trust in the government response to the situation [EPA, 2017 ].
In the aftermath of the mine fire, inquiries and environmental monitoring assessments were implemented to inform and improve state responses to similar emergencies in the future [State of Victoria, 2014 ]. The EPA conducted assessments of air quality to determine if the fire created any ongoing changes. Air quality data were collected from mid-February 2014 until May 2015, with data compared across the sampling period and with historical data [EPA, 2015 ]. Draft reports of the environmental monitoring program were shared with Latrobe Valley community members who asked for clarification of certain specifications, graphs and the standards of air quality used in reporting. One of the questions asked during the community consultation process was what lessons the EPA had learned from the Hazelwood mine fire experience. Aside from changes in technical monitoring and emergency response and management systems, a key difference in process and procedure was community engagement and collaboration [EPA, 2015 ]. This builds on the mine fire inquiry report, which specifically recommended community engagement in order to use ‘community-based information and local knowledge to make more informed decisions’ [State of Victoria, 2014 , p. 23].
One of the ways this manifested was in the community-assisted development of an air quality monitoring system. Calling it a citizen science project, air scientists and local experts from EPA Victoria worked with over 30 community members to design the monitoring network [EPA, 2020 ]. The system consists of a range of different relocatable sensors, fixed monitoring stations and video cameras to monitor signs of visible air pollution, like smoke [State of Victoria, 2018 ]. The resulting system, implemented in 2018, is adaptable to changing circumstances with air quality results publicly available [State of Victoria, 2018 ]. The information community members wanted to know about their air quality was embedded into the network design, allowing them to access information in a format that they could easily understand and providing them with the sense of creating something that would help keep their families safe and healthy [EPA, 2020 ].
3.3 Science centres brokering co-design with local teenagers
Science centres and museums have long been a science communication domain where community involvement is paramount. They are inherently public facing and hence need to position communities centrally — and not just as visitors to their institutions. As with the two other cases, co-design processes are also increasingly being used by science centres as a way to ensure exhibitions and other programs are relevant to specific communities. Although historically museums have employed a deficit-oriented approach, where a knowledgeable few decided what is relevant to the masses, more participatory methodologies have emerged in museums over the past two decades, with community co-design the pinnacle. Moreover, co-design can be a method to address exclusion of specific communities — a key problem for science centres [Dawson, 2019 ]. In her book, The Art of Relevance , Nina Simon [ 2016 ] sums up the approach:
Instead of designing programming and then seeking out audiences for it, we identify communities and then develop or co-create programs that are relevant to their assets, needs, and values. ( http://www.artofrelevance.org/2018/04/18/needs-assets-2/ .)
As discussed in the Introduction, understanding a group’s values and shared identity is key to defining a specific community, and to crafting relevant science communication for it. Recent research conceptualises relevance as a continuum of increasing personal meaningfulness [Priniski, Hecht and Harackiewicz, 2018 ], moving from (1) personal association (connecting to something of personal value), to (2) personal usefulness (connecting to a personal goal), and finally (3) identification (connecting to a person’s identity). Priniski and colleagues [ 2018 ] argue that identification is most likely to lead to motivation — a hypothesis that has been demonstrated in science communication and science centres [Walker, 2012 ] — however, creating relevance that connects with an individual’s identity is the most challenging. Crafting communication that establishes personal association or even usefulness is relatively straightforward once you understand an audience; however, understanding someone’s identity, and which identity is most prominent in a given context [Oyserman, 2007 ], is significantly more complex and personal.
Extrapolating from individual relevance to what is relevant to a community thus requires a deep understanding of the key aspects of identity that are shared. For this reason, science centres typically work with a representative group of community members using co-design methods that reveal shared identity such as focus groups, boards or advisory groups. These collaborative approaches present a way for the community to express their shared identity and hence what is most relevant, which in turn influences design. Co-design also creates a forum where the community’s needs and — critically — also their assets can influence design, aspects stressed by practitioners in science communication, museum studies and community development [Mathie and Cunningham, 2003 ; Nel, 2018 ; Simon, 2016 ; Walker et al., 2020 ].
The recent exhibition Beyond Perception hosted by Melbourne’s science centre Scienceworks is an illuminating case study of how co-design can be used to create relevant programming with a specific community that feels excluded from the science centre. The co-design process involved creating a representative group of young teenagers aged 13–15 years in Melbourne. The group met monthly 21 times as the exhibition was designed, first establishing why they felt excluded, then going on to propose exhibition ideas and give feedback on content, aesthetics and all aspects of the exhibition [Museums Victoria, 2018b ]. The basis of the teenage community’s exclusion was having to share a space with young children and families, so the final exhibition was displayed in a separate, bespoke designed area of the science centre with racy aesthetics and dark lighting. The design leveraged varied parts of teenagers’ shared identity, including their prioritisation of social experiences (e.g. including lounge areas) and their strong sense of agency and self-determination. As such, the exhibition is non-linear, self-guided, open-ended, is careful not to talk down to or patronise, and has no instruction panels [Museums Victoria, 2018a ; Perkins, 2018 ]. The co-design also resulted in place-based relevance, focussing on science and scientists from the Melbourne region. Finally, there were appeals to relevance and identity that may appear superficial for an outsider but are a fundamental part of the teenage identity: an area to charge mobile phones. The result was a place where teenagers felt included and where they found both the content, context and methods of communication relevant to them.
This is an example of how a brokering approach might work for a science communication institution based in a large city, though it was limited by needing to have some form of exhibition as the end point and being located at the institution’s site. Nonetheless, to a significant extent it allowed community members to design the program to meet their needs. Further exploration of brokering -type models will be important in future to find out what further ideas are possible in this sphere.
4 Discussion and conclusions
Because they are premised on relationship-building, communities-oriented approaches to science communication tend to be more complex than allowed for by our existing theoretical terminology (e.g. deficit, dialogue, citizen science, framing etc). Rather, they build on those concepts and their associated practices in a process of continual relationship negotiation and maintenance. This is particularly the case for problem-solving and brokering approaches, which are more deeply community-oriented than neighbourly approaches. Future work may map familiar theoretical concepts onto examples of community-oriented relationship-building to better understand how such relationships function and unfold. Given the diversity of communities, and the tailoring required to build relationships within and with them, this work is unlikely to produce the definitive ‘roadmap’ to effective community engagement. Rather, researchers and practitioners must recognise the complex and difficult work required and must operate with a more heterogeneous literature.
However, it may be possible to produce basic principles for community engagement in science communication, based on insights from genomics research recruitment, community health communication and knowledge brokering, as highlighted in the Introduction. These include:
- Committing to long-term relationship building.
- Acknowledging communities are all different, and what works for one community may not work for another.
- Having science communicators who come from within communities, or share an identity with prospective community partners.
- Working with, rather than against, a community’s cultural norms, communication conventions and decision-making processes.
- Physically situating programs within communities’ geographic space.
Using insights from the three case studies of science communication research and science communication communities literature, we may add some principles:
- Community-oriented science communication works vastly better when driven by communities themselves, not outsiders.
- Programs can become more community-oriented if external science communicators commence working with existing community networks, and transfer power to community members once the project is underway.
- Science communicators must be responsive to community interests, needs and priorities, in many cases working with communities without bringing their own agenda.
- We must welcome, and maintain relationships with, not just community members who are greatly interested in science, but also with those who have little interest.
- We must be savvy to vested interests exploiting our community-oriented approach, especially those that serve ends not in the target community’s interests.
Undoubtedly, future studies will further refine and extend these lists, while maintaining the principle of recognising community heterogeneity.
We must persist in community-oriented science communication given its potential benefits. First, to the extent that community boundaries are at least partly defined by sustained communication cultures and shared knowledge cultures, any community-oriented communication efforts that gain traction are likely to have a lasting and meaningful impact. Second, communities have more power and resources to solve problems and make change than individuals, while remaining under the direct control of individuals — something that larger, more powerful collectives such as nations or global corporations do not offer. Third, a ‘communities approach’ is likely essential for redressing science communication’s current exclusionary and inequitable culture.
Given the socially situated nature of knowledge, the efficacy of acting locally, and the primary importance of meaningful equity and inclusion, a ‘communities orientation’ for science communication seems an obvious imperative for any re-examination and re-orientation of our field.
References
-
Aguirre, C. (2014). ‘Science Centers. Which role can they play to participate in a city social reconstruction?’ JCOM 13 (02), C04. https://doi.org/10.22323/2.13020304 .
-
Airhihenbuwa, C. O., Iwelunmor, J., Munodawafa, D., Ford, C. L., Oni, T., Agyemang, C., Mota, C., Ikuomola, O. B., Simbayi, L., Fallah, M. P., Qian, Z., Makinwa, B., Niang, C. and Okosun, I. (2020). ‘Culture matters in communicating the global response to COVID-19’. Preventing Chronic Disease 17, E60. https://doi.org/10.5888/pcd17.200245 .
-
Allen, S., Kastelein, K., Mokros, J., Atkinson, J. and Byrd, S. (2020). ‘STEM Guides: professional brokers in rural STEM ecosystems’. International Journal of Science Education, Part B 10 (1), pp. 17–35. https://doi.org/10.1080/21548455.2019.1700317 .
-
Bagamoyo College of Arts, Tanzania Theatre Centre, Mabala, R. and Allen, K. B. (2002). ‘Participatory action research on HIV/AIDS through a popular theatre approach in Tanzania’. Evaluation and Program Planning 25 (4), pp. 333–339. https://doi.org/10.1016/S0149-7189(02)00044-7 .
-
Bentley, A. R., Callier, S. and Rotimi, C. N. (2017). ‘Diversity and inclusion in genomic research: why the uneven progress?’ Journal of Community Genetics 8, pp. 255–266. https://doi.org/10.1007/s12687-017-0316-6 .
-
Boyer, L., Roth, W.-M. and Wright, N. (2009). ‘The emergence of a community mapping network: coastal eelgrass mapping in British Columbia’. Public Understanding of Science 18 (2), pp. 130–148. https://doi.org/10.1177/0963662507077509 .
-
Brown, A., Roche, J. and Hurley, M. (2020). ‘Engaging migrant and refugee communities in non-formal science learning spaces’. JCOM 19 (04), R01. https://doi.org/10.22323/2.19040601 .
-
Canfield, K. N., Menezes, S., Matsuda, S. B., Moore, A., Mosley Austin, A. N., Dewsbury, B. M., Feliú-Mójer, M. I., McDuffie, K. W. B., Moore, K., Reich, C. A., Smith, H. M. and Taylor, C. (2020). ‘Science communication demands a critical approach that centers inclusion, equity, and intersectionality’. Frontiers in Communication 5, 2. https://doi.org/10.3389/fcomm.2020.00002 .
-
Canovan, C. (2020). ‘Sharing the pi: are incentives an effective method of attracting a more diverse science festival audience?’ International Journal of Science Education, Part B 10 (3), pp. 217–231. https://doi.org/10.1080/21548455.2020.1753126 .
-
Chandler, C., Fairhead, J., Kelly, A., Leach, M., Martineau, F., Mokuwa, E., Parker, M., Richards, P. and Wilkinson, A. (2015). ‘Ebola: limitations of correcting misinformation’. The Lancet 385 (9975), pp. 1275–1277. https://doi.org/10.1016/S0140-6736(14)62382-5 .
-
Cheeptham, N., Mahara, S., Antoine, M., Insuk, C. and Loy, K. (2020). ‘Aboriginal youth summer camp in science and health science: a Western Canadian university review of 10 years of successes and learning’. International Journal of Science Education, Part B 10 (3), pp. 204–216. https://doi.org/10.1080/21548455.2020.1748743 .
-
Coleman, A. (2012). ‘Towards delivering e-health education using Public Internet Terminals (PIT) systems in rural communities in South Africa’. JCOM 11 (04), A01. https://doi.org/10.22323/2.11040201 .
-
Crouse Quinn, S. (2008). ‘Crisis and emergency risk communication in a pandemic: a model for building capacity and resilience of minority communities’. Health Promotion Practice 9 (4_suppl), 18S–25S. https://doi.org/10.1177/1524839908324022 .
-
Cvitanovic, C., Cunningham, R., Dowd, A.-M., Howden, S. M. and van Putten, E. I. (2017). ‘Using social network analysis to monitor and assess the effectiveness of knowledge brokers at connecting scientists and decision-makers: an Australian case study’. Environmental Policy and Governance 27 (3), pp. 256–269. https://doi.org/10.1002/eet.1752 .
-
Dawson, E. (2019). Equity, exclusion and everyday science learning: the experiences of minoritised groups. London, U.K.: Routledge.
-
Dietz, T. (2013). ‘Bringing values and deliberation to science communication’. Proceedings of the National Academy of Sciences 110 (S3), pp. 14081–14087. https://doi.org/10.1073/pnas.1212740110 .
-
Duchsherer, A., Jason, M., Platt, C. A. and Majdik, Z. P. (2020). ‘Immunized against science: narrative community building among vaccine refusing/hesitant parents’. Public Understanding of Science 29 (4), pp. 419–435. https://doi.org/10.1177/0963662520921537 .
-
EPA (2015). Hazelwood recovery program air quality assessment — Morwell and surrounds, February 2014–May 2015. Publication 1601. Carlton, Australia: Environment Protection Authority Victoria. URL: https://www.epa.vic.gov.au/about-epa/publications/1601 .
-
— (2017). Hazelwood coal mine fire — Lessons learnt from responding to a large-scale brown coal open-cut mine fire. Publication 1651. Carlton, Australia: Environment Protection Authority Victoria. URL: https://www.epa.vic.gov.au/about-epa/publications/1651 .
-
— (2020). Latrobe Valley air monitoring co-design . URL: https://www.epa.vic.gov.au/for-community/get-involved/citizen-science-program/citizen-science-projects/latrobe-valley-air-monitoring-co-design (visited on 17th October 2020).
-
Eveland, W. P. and Cooper, K. E. (2013). ‘An integrated model of communication influence on beliefs’. Proceedings of the National Academy of Sciences 110 (Supplement 3), pp. 14088–14095. https://doi.org/10.1073/pnas.1212742110 .
-
Finlay, S. M., Raman, S., Rasekoala, E., Mignan, V., Dawson, E., Neeley, L. and Orthia, L. A. (2021). ‘From the margins to the mainstream: deconstructing science communication as a white, Western paradigm’. JCOM 20 (01), C02. https://doi.org/10.22323/2.20010302 .
-
Finlay, S. and Wenitong, M. (2020). ‘Aboriginal Community Controlled Health Organisations are taking a leading role in COVID-19 health communication’. Australian and New Zealand Journal of Public Health 44 (4), pp. 251–252. https://doi.org/10.1111/1753-6405.13010 .
-
Fischhoff, B. and Scheufele, D. A. (2013). ‘The science of science communication’. Proceedings of the National Academy of Sciences 110 (Supplement 3), pp. 14031–14032. https://doi.org/10.1073/pnas.1312080110 .
-
Garland, M. J. (1999). ‘Experts and the public: a needed partnership for genetic policy’. Public Understanding of Science 8 (3), pp. 241–254. https://doi.org/10.1088/0963-6625/8/3/308 .
-
Griffin, R. J. and Dunwoody, S. (1997). ‘Community structure and science framing of news about local environmental risks’. Science Communication 18 (4), pp. 362–384. https://doi.org/10.1177/1075547097018004005 .
-
Grills, N. and Butcher, N. (2020). ‘Better engaging culturally diverse communities during COVID-19’. Pursuit . URL: https://pursuit.unimelb.edu.au/articles/better-engaging-culturally-diverse-communities-during-covid-19 (visited on 13th October 2020).
-
Hardina, D. (2006). ‘Strategies for citizen participation and empowerment in non-profit, community-based organizations’. Community Development 37 (4), pp. 4–17. https://doi.org/10.1080/15575330609490192 .
-
Hoover, E. (2016). ‘“We’re not going to be guinea pigs;” Citizen science and environmental health in a Native American community’. JCOM 15 (01), A05. https://doi.org/10.22323/2.15010205 .
-
Hughson, J.-a., Woodward-Kron, R., Parker, A., Hajek, J., Bresin, A., Knoch, U., Phan, T. and Story, D. (2016). ‘A review of approaches to improve participation of culturally and linguistically diverse populations in clinical trials’. Trials 17, 263. https://doi.org/10.1186/s13063-016-1384-3 .
-
Irwin, A. and Wynne, B., eds. (1996). Misunderstanding science? The public reconstruction of science and technology. Cambridge, U.K.: Cambridge University Press. https://doi.org/10.1017/cbo9780511563737 .
-
Junyent, C. and Rasekoala, E. (2nd December 2019). ‘Interview with Elizabeth Rasekoala: spinning a web to change minds’. Métode . URL: https://metode.org/issues/entrevista-revistes/interview-with-elizabeth-rasekoala.html .
-
Kahan, D. (2015). ‘What is the “science of science communication”?’ JCOM 14 (03), Y04. https://doi.org/10.22323/2.14030404 .
-
Kappel, K. and Holmen, S. J. (2019). ‘Why science communication, and does it work? A taxonomy of science communication aims and a survey of the empirical evidence’. Frontiers in Communication 4, 55. https://doi.org/10.3389/fcomm.2019.00055 .
-
Kim, H.-S. (2012). ‘Climate change, science and community’. Public Understanding of Science 21 (3), pp. 268–285. https://doi.org/10.1177/0963662511421711 .
-
Kim, H., Cho, S. H. and Song, S. (2019). ‘Wind, power, and the situatedness of community engagement’. Public Understanding of Science 28 (1), pp. 38–52. https://doi.org/10.1177/0963662518772508 .
-
Levy, J. (23rd November 2015). ‘MTV Shuga — a multi-platform communication initiative achieving HIV behaviour change for adolescents in Africa’. The Communication Initiative Network . URL: http://www.comminit.com/global/content/mtv-shuga-multi-platform-communication-initiative-achieving-hiv-behaviour-change-adolesc (visited on 13th October 2020).
-
Macnamara, J. and Camit, M. (2017). ‘Effective CALD community health communication through research and collaboration: an exemplar case study’. Communication Research and Practice 3 (1), pp. 92–112. https://doi.org/10.1080/22041451.2016.1209277 .
-
Márquez, M. C. and Porras, A. M. (2020). ‘Science communication in multiple languages is critical to its effectiveness’. Frontiers in Communication 5, 31. https://doi.org/10.3389/fcomm.2020.00031 .
-
Mathie, A. and Cunningham, G. (2003). ‘From clients to citizens: asset-based community development as a strategy for community-driven development’. Development in Practice 13 (5), pp. 474–486. https://doi.org/10.1080/0961452032000125857 .
-
Michaels, S. (2009). ‘Matching knowledge brokering strategies to environmental policy problems and settings’. Environmental Science and Policy 12 (7), pp. 994–1011. https://doi.org/10.1016/j.envsci.2009.05.002 .
-
Mills, D. (2004). ‘Defining community: a critical review of ‘community’ in Family and Community History ’. Family and Community History 7 (1), pp. 5–12. https://doi.org/10.1179/fch.2004.7.1.002 .
-
Museums Victoria (2018a). ‘Digital design’. Premier’s Design Awards . URL: https://www.premiersdesignawards.com.au/entry/beyond-perception-exhibition/ (visited on 25th October 2020).
-
— (2018b). ‘Invisible science reveals STEM pathways for teens’. Museums Victoria . URL: https://museumsvictoria.com.au/media-releases/invisible-science-reveals-stem-pathways-for-teens/ (visited on 19th October 2020).
-
Nel, H. (2018). ‘A comparison between the asset-oriented and needs-based community development approaches in terms of systems changes’. Practice. Social Work in Action 30 (1), pp. 33–52. https://doi.org/10.1080/09503153.2017.1360474 .
-
Ofori-Parku, S. S. (2018). ‘Tacit knowledge and risk perceptions: Tullow Oil and lay publics in Ghana’s offshore oil region’. Public Understanding of Science 27 (2), pp. 197–213. https://doi.org/10.1177/0963662516685488 .
-
Oh, S. S., Galanter, J., Thakur, N., Pino-Yanes, M., Barcelo, N. E., White, M. J., de Bruin, D. M., Greenblatt, R. M., Bibbins-Domingo, K., Wu, A. H. B., Borrell, L. N., Gunter, C., Powe, N. R. and Burchard, E. G. (2015). ‘Diversity in clinical and biomedical research: a promise yet to be fulfilled’. PLoS Medicine 12 (12), e1001918. https://doi.org/10.1371/journal.pmed.1001918 .
-
Orthia, L. A. (2020). ‘Strategies for including communication of non-Western and indigenous knowledges in science communication histories’. JCOM 19 (02), A02. https://doi.org/10.22323/2.19020202 .
-
Oyserman, D. (2007). ‘Social identity and self-regulation’. In: Social psychology. Handbook of basic principles. Ed. by A. W. Kruglanski and E. T. Higgins. New York, NY, U.S.A.: Guilford Press, pp. 432–453.
-
Perkins, D. (2018). Avoiding the cringe when catering for teens . MuseumNext. URL: https://vimeo.com/270060487/ff7f4c3946 (visited on 29th October 2020).
-
Polk, E. and Diver, S. (2020). ‘Situating the scientist: creating inclusive science communication through equity framing and environmental justice’. Frontiers in Communication 5, 6. https://doi.org/10.3389/fcomm.2020.00006 .
-
Priniski, S. J., Hecht, C. A. and Harackiewicz, J. M. (2018). ‘Making learning personally meaningful: a new framework for relevance research’. The Journal of Experimental Education 86 (1), pp. 11–29. https://doi.org/10.1080/00220973.2017.1380589 .
-
Putsche, L., Hormel, L., Mihelich, J. and Storrs, D. (2017). ‘“You end up feeling like the rest of the world is kind of picking on you”: perceptions of regulatory science’s threats to economic livelihoods and Idahoans’ collective identity’. Science Communication 39 (6), pp. 687–712. https://doi.org/10.1177/1075547017730586 .
-
Ragin, D. F., Ricci, E., Rhodes, R., Holohan, J., Smirnoff, M. and Richardson, L. D. (2008). ‘Defining the “community” in community consultation for emergency research: findings from the community VOICES study’. Social Science & Medicine 66 (6), pp. 1379–1392. https://doi.org/10.1016/j.socscimed.2007.10.022 .
-
Rasekoala, E. (13th May 2020). Challenges and opportunities for transformation . In Ecsite webinar: Decolonising museums and science communication . URL: https://www.youtube.com/watch?v=CWxw0x7U5lw (visited on 13th October 2020).
-
Roberson, T. and Orthia, L. A. (2021). ‘Queer world-making: a need for integrated intersectionality in science communication’. JCOM 20 (01), C05. https://doi.org/10.22323/2.20010305 .
-
Roger, E. and Klistorner, S. (2016). ‘BioBlitzes help science communicators engage local communities in environmental research’. JCOM 15 (03), A06. https://doi.org/10.22323/2.15030206 .
-
Roth, W.-M. and Lee, S. (2002). ‘Scientific literacy as collective praxis’. Public Understanding of Science 11 (1), pp. 33–56. https://doi.org/10.1088/0963-6625/11/1/302 .
-
Rusch, D., Walden, A. L. and DeCarlo Santiago, C. (2020). ‘A community-based organization model to promote Latinx immigrant mental health through advocacy skills and universal parenting supports’. American Journal of Community Psychology 66 (3–4), pp. 337–346. https://doi.org/10.1002/ajcp.12458 .
-
Sanders, E. B.-N. and Stappers, P. J. (2008). ‘Co-creation and the new landscapes of design’. CoDesign 4 (1), pp. 5–18. https://doi.org/10.1080/15710880701875068 .
-
Sannazzaro, J. (2016). ‘Citizen cartography, strategies of resistance to established knowledge and collective forms of knowledge building’. Public Understanding of Science 25 (3), pp. 346–360. https://doi.org/10.1177/0963662514554757 .
-
Scheufele, D. A. (2013). ‘Communicating science in social settings’. Proceedings of the National Academy of Sciences 110 (Supplement 3), pp. 14040–14047. https://doi.org/10.1073/pnas.1213275110 .
-
Scrimshaw, S. C. (2019). ‘Science, health, and cultural literacy in a rapidly changing communications landscape’. Proceedings of the National Academy of Sciences 116 (16), pp. 7650–7655. https://doi.org/10.1073/pnas.1807218116 .
-
Simon, N. (2016). The art of relevance. Santa Cruz, CA, U.S.A.: Museum 2.0.
-
State of Victoria (2014). Hazelwood mine fire inquiry report. Victorian Government implementation and monitoring plan, October 2014. PP No. 384. Melbourne, Australia: Victorian Government.
-
— (2018). Clean air statement. Melbourne, Australia: Department of Environment, Land, Water and Planning.
-
Streicher, B., Unterleitner, K. and Schulze, H. (2014). ‘Knowledge rooms — science communication in local, welcoming spaces to foster social inclusion’. JCOM 13 (02), C03. https://doi.org/10.22323/2.13020303 .
-
Szebeko, D. and Tan, L. (2010). ‘Co-designing for society’. Australasian Medical Journal 3 (9), pp. 580–590.
-
Tai, D. B. G., Shah, A., Doubeni, C. A., Sia, I. G. and Wieland, M. L. (2021). ‘The disproportionate impact of COVID-19 on racial and ethnic minorities in the United States’. Clinical Infectious Diseases 72 (4), pp. 703–706. https://doi.org/10.1093/cid/ciaa815 .
-
Tan, S. Z. K. and Perucho, J. A. U. (2018). ‘Bringing science to bars: a strategy for effective science communication’. Science Communication 40 (6), pp. 819–826. https://doi.org/10.1177/1075547018808298 .
-
Teague, B., Catford, J. and Petering, S. (2014). Hazelwood Mine Fire Inquiry Report. PP No. 342. Melbourne, Australia: Board of Inquiry.
-
Van Bavel, J. J., Baicker, K., Boggio, P. S., Capraro, V., Cichocka, A., Cikara, M., Crockett, M. J., Crum, A. J., Douglas, K. M., Druckman, J. N., Drury, J., Dube, O., Ellemers, N., Finkel, E. J., Fowler, J. H., Gelfand, M., Han, S., Haslam, S. A., Jetten, J., Kitayama, S., Mobbs, D., Napper, L. E., Packer, D. J., Pennycook, G., Peters, E., Petty, R. E., Rand, D. G., Reicher, S. D., Schnall, S., Shariff, A., Skitka, L. J., Smith, S. S., Sunstein, C. R., Tabri, N., Tucker, J. A., van der Linden, S., van Lange, P., Weeden, K. A., Wohl, M. J. A., Zaki, J., Zion, S. R. and Willer, R. (2020). ‘Using social and behavioural science to support COVID-19 pandemic response’. Nature Human Behaviour 4 (5), pp. 460–471. https://doi.org/10.1038/s41562-020-0884-z .
-
Walker, G. J. (2012). ‘Motivational features of science shows’. Ph.D. Thesis. Canberra, Australia: Australian National University.
-
Walker, G. J., Bantsi, L., Bukhosini, S., Chikundi, K., Dusrath, A., Kafeero, M., Kamudu Applasawmy, B., Igadwa, K. M., Moswetsi, K., Rikhotso, S., Schwartz, M. J. and Tsie, P. (2020). ‘Models to build capacity for African science centres and science communication: needs and assets’. JCOM 19 (01), A05. https://doi.org/10.22323/2.19010205 .
-
Ward, V., Howdle, P. and Hamer, S. (2008). ‘You & your body: a case study of bioscience communication at the University of Leeds’. Science Communication 30 (2), pp. 177–208. https://doi.org/10.1177/1075547008324385 .
-
Wenzel, A. (2020). Community-centered journalism: engaging people, exploring solutions, and building trust. Urbana, IL, U.S.A.: University of Illinois Press.
-
Wild, A., Kunstler, B., Goodwin, D., Skouteris, H., Zhang, L., Kufi, M., Musse, F., Salim, W., Micallef, E., Asthana, M., Onyala, S., Al-Khafaji, M., Coase, D., Geronimo, M. A., Chew, E. and Mohideen, M. (2020). ‘Communicating COVID-19 health information to culturally and linguistically diverse (CALD) communities: the importance of partnership, co-design, and behavioural and implementation science’. MetaArXiv . https://doi.org/10.31222/osf.io/85h93 .
-
Yli-Kauhaluoma, S. and Hänninen, H. (2014). ‘Tale taming radioactive fears: linking nuclear waste disposal to the “continuum of the good”’. Public Understanding of Science 23 (3), pp. 316–330. https://doi.org/10.1177/0963662513503773 .
Authors
Lindy A. Orthia is an honorary senior lecturer at the Australian National University School of Sociology. Her research interests include history of science communication, science in popular fiction, and the intersections of science with ideologies of oppression such as scientism, Eurocentrism and heteronormativity. ORCID: 0000-0003-3544-857X. E-mail: lindy.orthia@anu.edu.au .
Merryn McKinnon is a senior lecturer in science communication at the Centre for the Public Awareness of Science, at the Australian National University. Her research explores the relationship between science, media and publics; and issues pertaining to intersectionality and inclusion in STEM. ORCID: 0000-0003-4808-0380. E-mail: merryn.mckinnon@anu.edu.au .
John Noel Viana is a postdoctoral fellow in Responsible Innovation in Precision Health at the Australian National Centre for the Public Awareness of Science, the Australian National University and the Responsible Innovation Future Science Platform, Commonwealth Scientific and Industrial Research Organisation. His research interests center on health communication, biomedical ethics, and science and technology studies; and he is currently exploring issues of equity, inclusivity, and diversity in precision health research. ORCID: 0000-0002-4004-7546. E-mail: john.viana@anu.edu.au .
Graham J. Walker is a lecturer in science communication at the Centre for the Public Awareness of Science (CPAS), the Australian National University. His current research and engagement investigates international capacity building, emotion and co-design in science communication, with a focus on science centres, science shows and hands-on approaches, and using these methods to engage with social and environmental issues. He also teaches in these areas. ORCID: 0000-0001-7462-8261, Twitter: @DrGrahams. E-mail: g.walker@anu.edu.au .
Supplementary material
Available at https://doi.org/10.22323/2.20030212 .