King et al. [2015] argue that ‘emphasis on impact is obfuscating the valuable role of evaluation’ in informal science learning and public engagement (p. 1). The article touches on a number of important issues pertaining to the role of evaluation, informal learning, science communication and public engagement practice. In this critical response essay, I highlight the article’s tendency to construct a straw man version of ‘impact evaluation’ that is impossible to achieve, while exaggerating the value of simple forms of feedback-based evaluation exemplified in the article. I also identify a problematic tendency, evident in the article, to view the role of ‘impact evaluation’ in advocacy terms rather than as a means of improving practice. I go through the evaluation example presented in the article to highlight alternative, impact-oriented evaluation strategies, which would have addressed the targeted outcomes more appropriately than the methods used by King et al. [2015]. I conclude that impact evaluation can be much more widely deployed to deliver essential practical insights for informal learning and public engagement practitioners.
Search
1460 publications found
-
Sep 29, 2015 Essay
-
Sep 29, 2015 Commentary
Evaluating impact and quality of experience in the 21st century: using technology to narrow the gap between science communication research and practice
Access to high quality evaluation results is essential for science communicators to identify negative patterns of audience response and improve outcomes. However, there are many good reasons why robust evaluation linked is not routinely conducted and linked to science communication practice. This essay begins by identifying some of the common challenges that explain this gap between evaluation evidence and practice. Automating evaluation processes through new technologies is then explicated as one solution to these challenges, capable of yielding accurate real-time results that can directly feed into practice. Automating evaluation through smartphone and web apps tied to open source analysis tools can deliver on-going evaluation insights without the expense of regularly employing external consultants or hiring evaluation experts in-house. While such automation does not address all evaluation needs, it can save resources and equip science communicators with the information they need to continually enhance practice for the benefit of their audiences.
-
Sep 29, 2015 Commentary
Ships, Clocks & Stars: the quest for impact
Between 2010 and July 2015, a group of researchers at the Department of History and Philosophy of Science, University of Cambridge and the National Maritime Museum were engaged in an Arts & Humanities Research Council-funded project “The Board of Longitude 1714–1828: Science, innovation and empire in the Georgian world”. The project team included a dedicated Public Engagement Officer whose role was to engage audiences with the outputs of the research project.
The National Maritime Museum celebrated the 300 th anniversary of the 1714 Longitude Act with a major exhibition, Ships, Clocks & Stars: The Quest for Longitude, which told the story of the 18th century quest for longitude, alongside a series of longitude-themed events. To commemorate the same anniversary, NESTA launched the 2014 Longitude Prize, a challenge to find a solution to today’s equivalent of the longitude problem, with the problem chosen by a public vote. Using these two examples as a case study, I explore how history of science helps science communication organisations engage people with science, and vice versa. -
Sep 29, 2015 Essay
RedPOP: 25 years of a Science Communication Network in Latin America
The Red de Popularización de la Ciencia y la Tecnología en América latina y el Caribe (RedPOP) (Latin American and Caribbean Network for the Popularization of Science and Technology) was created 25 years ago as an expression of a movement that started in the 1960s in favour of a scientific education. The purpose of this movement was to incorporate science into the general knowledge of the population by communicating science through different media, products and spaces such as museums and science centres. Since then, the movement has acquired considerable strength in Latin America and RedPOP has been a key factor to the development of this activity in the region, although several challenges still have to be addressed.
-
Sep 29, 2015 Article
Narrative risks in science writing for the lay public
The narrative method of presenting popular science method promises to extend the audience of science, but carries risks related to two broad aspects of story: the power of narrative to impose a compelling and easily interpretable structure on discrete events and the unpredictability and mystique associated with story.
-
Aug 25, 2015 Essay
What is the “science of science communication”?
This essay seeks to explain what the “science of science communication” is by doing it. Surveying studies of cultural cognition and related dynamics, it demonstrates how the form of disciplined observation, measurement, and inference distinctive of scientific inquiry can be used to test rival hypotheses on the nature of persistent public conflict over societal risks; indeed, it argues that satisfactory insight into this phenomenon can be achieved only by these means, as opposed to the ad hoc story-telling dominant in popular and even some forms of scholarly discourse. Synthesizing the evidence, the essay proposes that conflict over what is known by science arises from the very conditions of individual freedom and cultural pluralism that make liberal democratic societies distinctively congenial to science. This tension, however, is not an “inherent contradiction”; it is a problem to be solved — by the science of science communication understood as a “new political science” for perfecting enlightened self-government.
-
Aug 19, 2015 Essay
How to do mass media publicity for a neglected disease. Lessons from Tsetse and Trypanosomiasis in Kenya
The prioritization of neglected diseases in the policy making framework requires heightened advocacy [WHO, 2006]. Mass media positive publicity is among approaches that can be used to achieve this. This paper discusses practical use of mass media to do publicity and advocacy for a neglected disease and its vector. It uniquely presents online links to the analyzed newspaper and television news and opinion articles on tsetse and Trypanosomiasis. The paper shares entry points into mass media advocacy from a lessons learned perspective and notes the importance of understanding how the mass media works in order to achieve advocacy of neglected diseases using sleeping sickness as a case study.
-
Jul 24, 2015 Essay
“Queue up, you stupid!”: communicating about technology problems. An exploratory study of warning messages posted on machines in public places
Communication about technology has long been neglected within the field of science and technology communication. This visual exploratory study focuses on how users can communicate with and about technology in public places through warning signs posted on technological devices.
Three broad categories of messages have been identified: bad design, malfunctioning and disciplining users. By analyzing examples within each category, we suggest that studying these communicative situations can be a key to understanding how users are engaged in continuous, elaborate and sometimes even conflicting framing of technological devices (e.g. with regard to their purpose, appropriate uses, shifting boundaries between functioning/malfunctioning); how such framing, in turn, can be used to readjust/realign social behavior and organizational routines. -
Jul 09, 2015 Essay
Science journalism: the standardisation of information from the press to the internet
The standardisation and selectivity of information were characteristics of science journalism in the printed medium that the digital editions of journals have inherited. This essay explores this fact from the international perspective, with a special focus on the Spanish case.
-
Jun 11, 2015 Commentary
The blurred boundaries between science and activism
Science and activism are terms which are usually seen as quite separate. Yet, they are inextricably linked, even more so as techno scientific progress permeates contemporary society. The five commentaries in this series provide insights for a discussion about how the (apparent) separation between “value laden” activism and “value free” science is in fact very thin, and how science communication can play a key role in ensuring reflexivity and self criticism in science.