1 Introduction

Living Labs were conceived in the early 2000s as both a method and a device to capture in vivo needs, expectations, routines, and barriers of different stakeholders [Greve, De Vita, Leminen & Westerlund, 2021; Leminen & Westerlund, 2019]. Living labs are considered a format of participatory research as well as of collaborative technology and product development that creates and makes observable situations deemed similar to everyday life. But despite the enthusiasm for living labs, the growing attention and financial allocation, there is a lack of consensus on what may be considered a successful implementation of a living lab, its mode of operation, activities and claims. So far, there is an abundance of attempts to define living labs, but no binding standards and no methodological anchoring [Følstad, 2008; Schuurman, De Marez & Ballon, 2015].

Therefore, despite the keen interest and heavy investments into living labs, their epistemic underpinnings and conceptual grounding remain shaky. The many approaches and initiates, that are for instance connected in the European Network of Living Labs (ENoLL), do not follow a common idea or design, except the ambition to venture into the “real world” [ENoLL, 2022]. Moreover, little is known about the communicative and social processes happening at these sites and the ways participation is being configured. What is further missing is a critical view on the schemes and ambitions around public engagement and living labs which have been the focus of funding, especially in Europe, since 2006. The fact that living labs have not yet been researched in depth, nor that empirically supported guidelines for their establishment and maintenance exist, is a serious gap in science communication research. It becomes even more obvious and its closure more urgent in view of science policy efforts to pursue more intensive participatory science and science communication.

2 Studying Living Labs

The concept of “living labs” is enormously popular [Wershler, Emerson & Parikka, 2022]. Regardless of which idea living labs follow, the basic principle is the participatory involvement of stakeholder groups who are supposed to be different and more diverse than the actors usually employed or addressed in R&D projects. In essence, the aim is to create or use environments that are as “lifelike” as possible, in which people interact with new technologies and take an active role in innovation and design processes [Ogonowski, Ley, Hess, Wan & Wulf, 2013]. Accordingly, parallels with co-design, participatory design, and co-creation are close, with living labs being used in scientific as well as civic and industrial contexts. However, there is a lack of methodological foundation and scant reflection of the design and evaluation of participatory, user-centered approaches [Dalsgaard, Halskov & Iversen, 2016; Dutilleul, Birrer & Mensink, 2010]. These desiderata are, we argue, linked to four central problem areas that affect both the practice and the study of participatory science communication in living labs.

The first problem is insufficient user participation. In principle, participation reaches from the test-setting and usability trials of market-ready applications up to open-ended processes in which participants already take part in the brainstorming and development stages of an innovation or are involved in research concerns at an early stage. In the European open innovation context, living labs are often discussed as evaluation environments involving hundreds and thousands of informants, while co-design contexts emphasize more the local embedding and focus on smaller real groups of users and designers [Vanmeerbeek, Vigneron, Delvenne, Rosskamp & Antoine, 2015]. However, comparative studies show that actual co-design, i.e., an open-ended and early involvement of users in the innovation process and a mutual learning and interaction process between participants and facilitators, is formulated as a goal, but hardly ever actually achieved [Vanmeerbeek et al., 2015]. Interactions in living labs are numerous but mostly superficial, while broader participation is rarely achieved [Mulvenna et al., 2011].

Second, living labs, especially in industrial and scientific contexts, predominantly target members of a technology-interested, educated, and White male creative class [Ames et al., 2014; Halskov & Hansen, 2015; Harrington, Erete & Piper, 2019]. There is a claim to enable participation of broad civil society and vulnerable stakeholder groups — but this de facto rarely happens. In particular, people whose sociodemographic and cultural backgrounds differ from those of the operators are mostly poorly represented and miscast as a homogeneous, often deficient group [Vines, Clarke, Wright, McCarthy & Olivier, 2013]. The initiated sociotechnical innovation process is also often subject to an “innovation bias” [Greenhalgh, 2013], i.e., a one-sided preference for technological solutions over addressing social or cultural challenges. This innovation bias and the demographics of living labs create a skewed representation of societal stakeholders and needs — attention is paid to living lab-affine groups as well as secondary users (e.g., caregivers, not those in need of care) who may not be congruent with targeted end users [Cardullo, Kitchin & Di Feliciantonio, 2017]. However, the ability of participants to influence the process itself and, more importantly, the definition of the problem to be solved and the solution sought, is critical for consistent participation. Defining and reaching out to reference groups is thus a normative and political moment of participatory science [Vines et al., 2013].

Third, the mere attribute “participatory” obscures indispensable coordination processes and decisions to involve ands activate people [Vines et al., 2013]. It leaves out the specification of topics and methods, the synthesis of contributions and processes, and the making of decisions. The multitude of requirements runs counter to the ideal of maximal participation in which the interests, and concerns of stakeholders are prioritized. The promise of living labs to be open to topics, procedures and results requires forms of organization and coordination yet previous conceptions as well as scientific engagement with living labs miss the parameters under which these arenas of participatory science engagement and co-creation could operate. The same is true for the insufficiently defined roles of those running and initiating living labs.

Fourth, there is a lack of discussion of the conditions of active participation, which is mostly taken for granted. Even if participants are given the chance to influence the processes and outcomes of brainstorming, design and development, it remains unclear to what extent this outweighs the individual effort and can address the open question of who actually benefits from participation and in what way [Iversen, Halskov & Leong, 2010]. Thus, little attention is paid to the interests of those to be involved; even the success of living labs is mostly determined starting from the goals of the operators and sponsors, e.g., prototyping designs and iteratively optimizing technical products [Bratteteig & Wagner, 2016]. This not only overlooks the stakeholder groups that participatory approaches are supposed to focus on, but it is also questionable to what extent living labs can generate sustainable participation.

3 About this Special Issue

This special issue of JCOM addresses the lack of conceptualization and rigorous analysis of the paradigmatic foundations and practical frameworks of living labs. Unlike other publications on living labs, this special issue is not bound to a particular area of application but rather focuses on the communication and interaction happening there. It is interested in contributions that examine the ways living labs are constructed and operated so to fulfil the promise of open, active, and innovative public science engagement. Its articles query the underlying theories and normative assumptions of living labs, for instance regarding the varying notions of what makes for “productive” participation and “good” participants; it also involves thinking about other factors such a trust, agency, and expertise that come to bear upon the living lab experience. We also invited pieces that present and discuss methods for studying the public engagement and public participation aspects of living labs and what kinds of insights they help to generate.

This special issue furthermore provides a space to interrogate the key moments in the life cycle of living labs like the definition of problems and possible solutions, the identification of stakeholders and their needs, or the organization of their temporal order and social responsibilities. In particular, we have encouraged articles that take a comparative look at the public science communication aspects of living labs in different scientific or societal contexts.

Along these topics, this special issue allows us to scrutinize the merits and pitfalls of an omnipresent science communication enterprise. It makes us rethink and reorganize how living labs are set up and operated, and define standards for what constitutes successful and sustainable integration and public engagement with science. We have invited research articles as well as practice insights and essays that fall within the scope of JCOM.

In their contribution, Loes Witteveen, Jan Fliervoet, Dwina Roosmini, Paul van Eijk and Nurdahlia Lairing propose to a threefold framework to look at and compare living labs. The first dimension examines the environment of living labs, their material setup and situation as well as the characteristic focus. Second, they propose to turn to the activities and methods championed in a living lab, and third, they zoom in on the outcomes of a living lab. What is more, the authors stress that these are not stable elements but form part of a dynamic lifecycle. This complex framework is then applied to four living labs in Indonesia and the Netherlands.

In “Living labs contributions to smart cities from a quadruple-helix perspective,” Daniel Esashika, Gilmar Masiero, and Yohann Mauger explore the influence of living labs in smart cities. Applying a quadruple-helix model which focuses on government, industry, academia and the public as key stakeholders, they investigate knowledge production and diffusion within innovative ecosystems. The authors identify a crucial challenge: incorporating stakeholders in smart city project design and governance to balance its technological, political, and participatory elements. The study, focusing on three Brazilian living labs, employs semi-structured interviews with organizers and participants. The researchers highlight the significance of training and collaborative events within living labs, often overlooked in their traditional role as technology design/testing spaces. Their analysis reconstructs the interaction between the four stakeholder groups, and shows that events held in living labs are vital for connecting participants with other local actors. Furthermore, they reveal a significant discrepancy between the theoretical and actual roles participants play in these projects.

The contribution of Madlen Günther, Simone Martinetz, Josef F. Krems, and Bernd Bienzeisler provides a practical insight into a project to promote sustainable mobility conducted in Chemnitz, Germany, from 2019 to 2022. Within this context, “Living Lab” is understood as an experimental field on the periphery of the city. Following the requirements of the citizen-oriented approach of the study, the authors investigate three participation formats — on-site, direct mail, and online — which are compared regarding their influence on willingness to participate. Additionally, the evaluation tries to find predictors for participation satisfaction as well as for the impact of participation on the acceptance of urban transformation processes. The paper too deals with a matter of some concern for living labs as well as science communication in general. That is, how to reach not only already affine groups? This question seems to be even more important given the fact that Günther et al. show the positive influence of participation on acceptance, satisfaction, and behavioral intentions regarding urban transformation.

In “Co-Creativity in Living Labs: fostering parallel and Phygital co-learning and co-creation processes to transform food systems,” Sonia Massari, Dalia Mattioni, Francesca Galli, and Yuna Chiffoleau scrutinize the role of collaborative creativity, or “cocreativity”, within living lab research in agri-food systems. They question if creativity is fostered or undervalued in co-creation processes, and how it can be effectively monitored and measured. The authors suggest that the lack of emphasis on creativity in primary research settings could reflect a history of living labs prioritizing tangible outcomes, objectivity, and replicability. The study includes an analysis of different interpretations of the relationship between co-creation, co-production, and co-design. Through a case study in the food sector, they illuminate how co-creative activities require a balance of divergent and convergent processes of collaborative creativity, stressing that such collaboration must be carefully guided. They argue that collaborative learning is vital for the growth and maturity of living labs and propose it as a key topic for future research.

In their research article, Kit Braybrooke, Gaoli Xiao, and Ava Lynam describe and evaluate a new method they developed during the COVID-19 pandemic to share impressions of socio-spatial practices in Living Labs: participants exchanged photos and insights on WeChat about their everyday experiences in urban-rural Living Labs in China and Germany. The authors reflect critically on the limitations, biases and ethics of the method and “translate” them into generic design principles for future studies.

Adalberto Fernandes focusses on living labs as “facilities for prototyping and testing technologies”. Visual models being used in these contexts, he argues, often manifest existing power structures and predefined procedures. This becomes even more acute when interests of industrial stakeholders are involved. Based on an exploratory political-semiotic analysis, the author notes a common understanding of participants as “end-users” involved in a rather linear process of designing technology which ignores the power of dissensus, especially within political processes. Ultimately, Fernandes pleads for a cautious differentiation between industry-driven development and serious participatory approaches taking into account their particular strengths.

Another form of critique is offered by Dara Ivanova and Sabrina Huizenga who take issue with the strategic configuration of urban living labs. Discussing their experiences with urban living labs in Rotterdam they treat these spaces as “ontological objects” which not only invite the production of knowledge. On the contrary, the researchers found them to be the element of purposive “myth-making” that also worked to exclude certain groups of people.

Looking back at 4+ years of running a living lab, Christian Pentzold, Ingmar Rothe, and Andreas Bischof reflect on ideals of participation and inclusivity that undergird many living lab enterprises and place them in discourses around a public engagement with science, participatory design, and co-creation. Realizing such ambitious scheme is, they argue, challenging since it ultimately requires a kind of empowering hospitality and an ongoing commitment to social infrastructuring.

Finally, Andreas Hepp sets out from the observation that there is a widespread fascination with labs as places of experimentation and tinkering. As such, labs seem a pervasive form of organizing and locating not only scientific practice but technological and social endeavors. Following Hepp, the lab forms one such pertinent sort of everyday experimentation, next to the “space” (as in Makerspace or Hackerspace), and the meetup. They provide the habitat for pioneer communities that not only try new technologies but also probe new forms of social collaboration.

Acknowledgments

Funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) — Project-ID 4162288727 — SFB 1410).

References

Ames, M. G., Bardzell, J., Bardzell, S., Lindtner, S., Mellis, D. A. & Rosner, D. K. (2014). Making cultures: empowerment, participation and democracy — or not? In CHI ’14 extended abstracts on human factors in computing systems (p. 1087). doi:10.1145/2559206.2579405

Bratteteig, T. & Wagner, I. (2016). Unpacking the notion of participation in participatory design. Computer Supported Cooperative Work (CSCW) 25 (6), 425–475. doi:10.1007/s10606-016-9259-4

Cardullo, P., Kitchin, R. & Di Feliciantonio, C. (2017). Living labs and vacancy in the neoliberal city. Cities 73, 44–50. doi:10.1016/j.cities.2017.10.008

Dalsgaard, P., Halskov, K. & Iversen, O. S. (2016). Participation Gestalt: analysing participatory qualities of interaction in public space. In Proceedings of the 2016 CHI conference on human factors in computing systems (pp. 4435–4446). doi:10.1145/2858036.2858147

Dutilleul, B., Birrer, F. A. J. & Mensink, W. (2010). Unpacking European living labs: analysing innovation’s social dimensions. Central European Journal of Public Policy 4 (1), 60–85.

ENoLL (2022). ENoLL members catalogue. Retrieved from https://issuu.com/enoll/docs/enoll_member_catalogue

Følstad, A. (2008). Living labs for innovation and development of information and communication technology: a literature review. Electronic Journal of Organizational Virtualness 10, 99–131. Retrieved from http://hdl.handle.net/11250/2440026

Greenhalgh, T. (2013). Five biases of new technologies. British Journal of General Practice 63 (613), 425–425. doi:10.3399/bjgp13x670741

Greve, K., De Vita, R., Leminen, S. & Westerlund, M. (2021). Living Labs: from niche to mainstream innovation management. Sustainability 13 (2), 791. doi:10.3390/su13020791

Halskov, K. & Hansen, N. B. (2015). The diversity of participatory design research practice at PDC 2002–2012. International Journal of Human-Computer Studies 74, 81–92. doi:10.1016/j.ijhcs.2014.09.003

Harrington, C., Erete, S. & Piper, A. M. (2019). Deconstructing community-based collaborative design: towards more equitable participatory design engagements. Proceedings of the ACM on Human-Computer Interaction 3, 1–25. doi:10.1145/3359318

Iversen, O. S., Halskov, K. & Leong, T. W. (2010). Rekindling values in participatory design. In Proceedings of the 11th Biennial Participatory Design Conference (pp. 91–100). doi:10.1145/1900441.1900455

Leminen, S. & Westerlund, M. (2019). Living labs: from scattered initiatives to a global movement. Creativity and Innovation Management 28 (2), 250–264. doi:10.1111/caim.12310

Mulvenna, M., Martin, S., McDade, D., Beamish, E., Oliveira, A. D. & Kivilehto, A. (2011). TRAIL Living Labs survey: a survey of the ENOLL living labs. Ulster, U.K.: University of Ulster. Retrieved from https://pure.ulster.ac.uk/ws/portalfiles/portal/11317086/TRAIL-Living-Lab-Survey-2011.pdf

Ogonowski, C., Ley, B., Hess, J., Wan, L. & Wulf, V. (2013). Designing for the living room: long-term user involvement in a living lab. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1539–1548). doi:10.1145/2470654.2466205

Schuurman, D., De Marez, L. & Ballon, P. (2015). Living Labs: a systematic literature review. In Open Living Lab Days 2015. Retrieved from https://biblio.ugent.be/publication/7026155/file/7026171

Vanmeerbeek, P., Vigneron, L., Delvenne, P., Rosskamp, B. & Antoine, M. (2015). Involvement of end-users in innovation process. Retrieved from https://www.semanticscholar.org/paper/Involvement-of-end-users-in-innovation-processes%3A-a-Vanmeerbeek-Vigneron/23b817612fbcda689959eab719797570126844a5

Vines, J., Clarke, R., Wright, P., McCarthy, J. & Olivier, P. (2013). Configuring participation: on how we involve people in design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 429–438). doi:10.1145/2470654.2470716

Wershler, D., Emerson, L. & Parikka, J. (2022). Everything is a lab. In D. Wershler, L. Emerson & J. Parikka (Eds.), The lab book. Minneapolis, MN, U.S.A.: Minnesota University Press.

Authors

Caroline Wehrmann is an assistant professor in Science Communication at Delft University of Technology, The Netherlands.
E-mail: c.wehrmann@tudelft.nl

Christian Pentzold is professor and Chair of Media and Communications at Leipzig University, Germany.
@SocietiesHybrid E-mail: christian.pentzold@uni-leipzig.de

Ingmar Rothe is a research associate at Leipzig University, Germany.
@SocietiesHybrid E-mail: ingmar.rothe@uni-leipzig.de

Andreas Bischof is Juniorprofessor (assistant professor) at Chemnitz University of Technology, Germany.
@analog_a E-mail: andreas.bischof@hsw.tu-chemnitz.de