Access to high quality evaluation results is essential for science communicators to identify negative patterns of audience response and improve outcomes. However, there are many good reasons why robust evaluation linked is not routinely conducted and linked to science communication practice. This essay begins by identifying some of the common challenges that explain this gap between evaluation evidence and practice. Automating evaluation processes through new technologies is then explicated as one solution to these challenges, capable of yielding accurate real-time results that can directly feed into practice. Automating evaluation through smartphone and web apps tied to open source analysis tools can deliver on-going evaluation insights without the expense of regularly employing external consultants or hiring evaluation experts in-house. While such automation does not address all evaluation needs, it can save resources and equip science communicators with the information they need to continually enhance practice for the benefit of their audiences.
Search
1483 publications found
Search results
-
Date of publication Sep 29, 2015 Category: Commentary
-
Date of publication Sep 29, 2015 Category: Editorial
A question of (audience) reach
Taking the International Science in Popular Culture conference as a starting point, this editorial considers audiences for cultural products, considering the size of audiences (from blockbuster films, to intimate science slams), their pre-existing (or lack of pre-existing) interest in the subject and what this might offer the field of science communication.
-
Date of publication Sep 29, 2015 Category: Essay
Highlighting the value of impact evaluation: enhancing informal science learning and public engagement theory and practice
King et al. [2015] argue that ‘emphasis on impact is obfuscating the valuable role of evaluation’ in informal science learning and public engagement (p. 1). The article touches on a number of important issues pertaining to the role of evaluation, informal learning, science communication and public engagement practice. In this critical response essay, I highlight the article’s tendency to construct a straw man version of ‘impact evaluation’ that is impossible to achieve, while exaggerating the value of simple forms of feedback-based evaluation exemplified in the article. I also identify a problematic tendency, evident in the article, to view the role of ‘impact evaluation’ in advocacy terms rather than as a means of improving practice. I go through the evaluation example presented in the article to highlight alternative, impact-oriented evaluation strategies, which would have addressed the targeted outcomes more appropriately than the methods used by King et al. [2015]. I conclude that impact evaluation can be much more widely deployed to deliver essential practical insights for informal learning and public engagement practitioners.
-
Date of publication Sep 29, 2015 Category: Letter
A response to “Highlighting the value of impact evaluation: enhancing informal science learning and public engagement theory and practice”
Whilst welcoming Jensen’s response to our original paper, we suggest that our main argument may have been missed. We agree that there are many methods for conducting impact assessments in informal settings. However, the capacity to use such tools is beyond the scope of many practitioners with limited budgets, time, and appropriate expertise to interpret findings.
More particularly, we reiterate the importance of challenging the prevailing policy discourse in which longitudinal impact studies are regarded as the ‘gold standard’, and instead call for a new discourse that acknowledges what is feasible and useful in informal sector evaluation practice. -
Date of publication Sep 29, 2015 Category: Commentary
Beyond dissemination — science communication as impact
The drive for impact from research projects presents a dilemma for science communication researchers and practitioners — should public engagement be regarded only as a mechanism for providing evidence of the impact of research or as itself a form of impact? This editorial describes the curation of five commentaries resulting from the recent international conference
‘Science in Public: Research, Practice, Impact’. The commentaries reveal the issues science communicators may face in implementing public engagement with science that has an impact; from planning and co-producing projects with impact in mind, to organising and operating activities which meet the needs of our publics, and finally measuring and evaluating the effects on scientists and publics in order to ‘capture impact’.Beyond the dissemination of Earth Observation research: stakeholders’ and users’ involvement in project co-design
by Alba L'Astorina, Irene Tomasoni, Anna Basoni and Paola CarraraReflections on the impact of (playful) deliberation processes in contexts of responsible research and innovation
by Marjoleine G. van der Meij -
Date of publication Sep 29, 2015 Category: Commentary
Beyond the dissemination of Earth Observation research: stakeholders’ and users’ involvement in project co-design
Modern technology and innovation research needs to analyse and collect users’ requirements from the outset of the project’s design, according to the Responsible Research and Innovation (RRI) approach. Bringing in new services without involving end-users in the whole research process does not make for optimal results in terms of scientific, technological and economic impact. This commentary reports on research experience of stakeholder involvement and co-production in Italy, implemented in Earth Observation downstream services at regional level. It reports the participative approach and method adopted and the impacts and benefits derived.
-
Date of publication Sep 29, 2015 Category: Commentary
Moving beyond the seductive siren of reach: planning for the social and economic impacts emerging from school-university engagement with research
In the past 25 years school-university partnerships have undergone a transition from ad hoc to strategic partnerships. Over the previous two-and-a-half-years we have worked in partnership with teachers and pupils from the Denbigh Teaching School Alliance in Milton Keynes, UK.
Our aims have been to encourage the Open University and local schools in Milton Keynes to value, recognise and support school-university engagement with research, and to create a culture of reflective practice.
Through our work we have noted a lack of suitable planning tools that work for researchers, teachers and pupils. Here we propose a flexible and adaptable metric to support stakeholders as they plan for, enact and evaluate direct and meaningful engagement between researchers, teachers and pupils. The objective of the metric is to make transparent the level of activity required of the stakeholders involved — teachers, pupils and researchers — whilst also providing a measure for institutions and funders to assess the relative depth of engagement; in effect, to move beyond the seductive siren of reach. -
Date of publication Sep 29, 2015 Category: Article
Narrative risks in science writing for the lay public
The narrative method of presenting popular science method promises to extend the audience of science, but carries risks related to two broad aspects of story: the power of narrative to impose a compelling and easily interpretable structure on discrete events and the unpredictability and mystique associated with story.
-
Date of publication Aug 25, 2015 Category: Essay
What is the “science of science communication”?
This essay seeks to explain what the “science of science communication” is by doing it. Surveying studies of cultural cognition and related dynamics, it demonstrates how the form of disciplined observation, measurement, and inference distinctive of scientific inquiry can be used to test rival hypotheses on the nature of persistent public conflict over societal risks; indeed, it argues that satisfactory insight into this phenomenon can be achieved only by these means, as opposed to the ad hoc story-telling dominant in popular and even some forms of scholarly discourse. Synthesizing the evidence, the essay proposes that conflict over what is known by science arises from the very conditions of individual freedom and cultural pluralism that make liberal democratic societies distinctively congenial to science. This tension, however, is not an “inherent contradiction”; it is a problem to be solved — by the science of science communication understood as a “new political science” for perfecting enlightened self-government.
-
Date of publication Aug 19, 2015 Category: Essay
How to do mass media publicity for a neglected disease. Lessons from Tsetse and Trypanosomiasis in Kenya
The prioritization of neglected diseases in the policy making framework requires heightened advocacy [WHO, 2006]. Mass media positive publicity is among approaches that can be used to achieve this. This paper discusses practical use of mass media to do publicity and advocacy for a neglected disease and its vector. It uniquely presents online links to the analyzed newspaper and television news and opinion articles on tsetse and Trypanosomiasis. The paper shares entry points into mass media advocacy from a lessons learned perspective and notes the importance of understanding how the mass media works in order to achieve advocacy of neglected diseases using sleeping sickness as a case study.