Jahrestagung 2024

International Conference
Scaling Sensing – Sensing Publics: Landscapes, and Borders, Homes and Bodies

University of Siegen, 13. – 15. November 2024
Obergraben 25, 57072 Siegen

About the conference

Scaling Sensing – Sensing Publics: Landscapes, and Borders, Homes and Bodies

The Collaborative Research Center „Media of Co-operation“ first annual conference of its third and final funding phase, explores the interplay between sensing and the public. Through the theme “Scaling Sensing – Sensing Publics. Landscapes, and Borders, Homes and Bodies” the conference examines the mutually constitutive dynamics of sensing practices and the publics they shape and are shaped by, through multi-perspective, interdisciplinary approaches to sensing practices in graduated, fragmented, and heterogenous public spheres. How are sensors and sensing practices shaped within different public realms? 

The pervasive integration of sensor technologies is fundamentally changing the way we perceive, sense, and produce knowledge. Technological sensors are capable of making their captured data visible and credible in ways human and environmental sensors cannot: they track movement, measure health data, and analyze built and grown environments. Thereby, they influence diverse settings, ranging from landscapes to cities, to homes and bodies. They both enhance and obscure bodily sensorial practices and intervene in their publicity and intersubjectivity. While sensor media might offer solutions to social, political, technological, medical, and environmental challenges, they also raise ethical and political concerns, such as privacy erosion, disconnection between sensory data and sensory experiences, controversial forms of surveillance, and the socio-technical diffusion of prejudices and various forms of bias. Thus, sensor data, their collection, analysis, and integration with other data formats, and within various social practices, groups of people, and institutions are constitutive not only of sensing but also of publicity and publicness. This conference aims to refine our understanding of the relationship between sensing and publics by examining collaboratively constituted sensors, media, and sensations across different research fields. Contributions present case studies from diverse disciplines and foreground practice in their theoretical stance, addressing the interplay between sensing and publics across four key domains:

  • Landscapes. Use of sensors in environmental settings, such as in cities, forests, waters, agricultural terrains, or resource management;
  • Borders. Sensing practices and control at physical and digital borders or within communities, such as in settings of migration, security,  and bureaucratic control;
  • Homes. Sensor applications in domestic spaces, such as smart home technologies, security, care, and design;
  • Bodies. Situated embodied sensing in social interaction, and the (dis)connections with wearable sensors, biometric identification, quantified and embodied self in social, religious, and health settings.

These four key domains represent different scales of publicness involved in sensing, but also a range of different sociopolitical and environmental contexts in which various forms of socio-technical sensing occur, distributed among multiple actors, including humans, machines, and the environment. 

To enhance interdisciplinary dialogue and debate, all contributions should engage with the broader issues of sensing and publicity that guide this conference and address the following questions:

  • How are sensing and sensing practices shaped within different public realms? 
  • Who and what is being sensed, by whom, and for what practical purpose? 
  • Which relationships are established between sensing, sensors, the sensed, and materiality/the environment? 
  • What happens to sensory data, how are they used and how might they be misused?
  • What are the ethical and political implications of distributed sensing? What happens to the intersubjectivity of sensing in embodied practices and technologically augmented practices?
  • What are the individual, social, ethical, political, and environmental consequences of interacting with sensing technologies?

Program

WEDNESDAY,   13. Nov.

Panel 1: Sensing Landscapes

This panel explores how the interaction between landscapes and different sensing practices (human, digital, and other-than-human) affects the use and interpretation of natural environments by various actors in different ecological and socio-political contexts. As part of the Earth’s surface, landscapes consist of geographic features, both natural and human-made. Mountains, plains, lakes, rivers, soils, and vegetation, as well as dams, fences, roads, bridges, and parks, not only constitute the spatial and physical dimensions of our world but also carry cultural narratives and beliefs, that shape personal and community identities. In particular, we highlight the tension between the natural characteristics of landscapes and human infrastructuring efforts. Humans modify and recast landscapes for a variety of reasons, by growing crops, caring for animals, building structures, mining, or mapping. At the same time, landscapes profoundly shape our ways of living and understanding the world. We conceptualize these human-landscape entanglements as spatial and material records of collective pasts, presents, and futures, that can be destructive, such as deforestation, pollution, extraction, and war, or constructive, such as conservation, protection, and reforestation initiatives. Rather than seeing landscapes as passive backdrops for human activity and imagination, we see them as active media that both influence and are influenced by sensing practices (including human senses, sensor technologies, but also sentinels and organisms). In doing so, this panel asks how these sensing practices affect our understanding and management of landscapes, and how landscapes, in turn, shape these sensing practices. 

Saadia Mirza (University of Chicago/ Sciences Po, Paris)

More than an instinct or reflex, sensing is a situated and experiential practice that exposes the many aesthetic and political parameters of human consciousness. The concept of landscape unravels a similar phenomenon – a view from somewhere that is constructed, discovered, and situated rather than pre-existing (Berque 2013, Karatani 1993). In geography, the cartographic classifications of landscape and its topology, terrain, topography, and territory are deeply tied to the evolution of ‘sensing’ as a technique and a method. Whether we speak of Humboldt’s use of the cyanometer for qualifying the exact blueness of the sky in the late 1700s, or the multispectral sensors of the 21st century to detect soil composition, knowledge of landscape has always relied on sensibilities – or sense-abilities – that are at once material and discursive. Moreover, these practices are embedded in historical, political, and cultural contexts with their own regimes of truth and judgment. However, these techniques and tools of sensing also reveal an ever more elusive idea of landscape where matter and meaning are as indistinguishable as the human and nonhuman agents that constitute it (Mirza 2023). In this keynote, I address how vibrations, resonances, bandwidths, and frequencies in more-than-human sensing systems create fluid impressions of materiality, boundaries, borders, terrain, and topography, expanding the consciousness of landscape. Since the declassification of remotely sensed data in the 1990s, various models of a single landscape have become possible, with sensors that exceed the limits of the human sensorium. Whether tracing historical migration routes, modeling new borders, simulating archaeological sites, or rendering the changing shape of coastlines, these advanced sensing practices offer new ways to re-map and rephrase the complex web of human-environment relations. I argue that by creating new sensory thresholds, these practices foster emergent rationalities that profoundly impact the social, political, and cultural understanding of the concept of landscape.

Dominik Schrey (University of Siegen)

In 1911, Georg Simmel described the high-Alpine realm of the glaciers as “the absolutely ‘unhistorical’ landscape” where all “associations with the human fate, which comes into being and passes away, are broken off, associations which in some way or other accompany all other landscapes.” However, when Simmel wrote these lines, the Alpine glaciers were already “envirotechnical landscapes” (Pritchard, 2011), making it difficult to draw a strict line between natural features and anthropogenic influences. Not only are they embedded in tourism infrastructure, energy production, and border regimes, but in the 19th century, the – already retreating – ice masses also became “sensing landscapes” that served as scientific indicators of environmental changes. Around 1900, for example, geologists discussed glaciers as “gigantic measuring instruments of nature’s own making” (Hagenbach, 1900), although this notion ultimately remained vague (Hupfer, 2019). This paper shows that the history of glaciology is largely about refining these “first-degree sensors” (Fuller/Weizman, 2021) using a variety of “second-degree” sensing practices (such as triangulation milestones, psychrometers, thermometrographs, and precipitation gauges), thereby reinventing the glaciers as laboratories of climate change. Using historical and contemporary examples, I explore glaciological sensing practices and their data, focusing on collaborative efforts between scientists and artists to shape public understanding of climate change.

Kathrin Friedrich (University of Bonn) 

Farming, and especially livestock farming, is a major factor in the transformation of landscapes, with a long history of infrastructuring land, natural resources, and human-animal interactions, through various types of physical barriers and fences. Nowadays, the fencing of livestock herds, such as cattle or goats, increasingly relies on sensor technologies, through virtual fencing. This remote, semi-automated practice uses GPS data, dedicated applications, and animal-attached sensors, forming a closed-loop sensing network to control livestock in various types of grazing areas. Rather than physically infrastructuring landscapes, virtual fencing relies on „digital landscapes,“ such as Google Maps, and is promoted as more flexible, less resource-intensive, and more sustainable than traditional fencing practices. This paper explores the promises of virtual fencing and their implications for landscape infrastructuring. By tracing examples of sensing infrastructures and fencing applications, it addresses how these media practices adapt landscapes for livestock farming and influence human and more-than-human sensing at various levels.

Akib Shahriar Khan (University of Siegen)

This paper explores the “landscape” through the lens of city streets. Streets and roads, as human-made landscapes, play a crucial role in shaping not only the flow of traffic but also the social dynamics within urban environments. The design and layout of urban landscapes can foster safety, accessibility, and community engagement or, conversely, contribute to congestion and conflict. For instance, well-designed streets with dedicated bike lanes, wide sidewalks, and clearly marked crosswalks encourage harmonious interactions among pedestrians, cyclists, and motorists, fostering a sense of shared space and mutual respect. With the rise of sensor technologies, wearable devices, automated vehicles, and smart infrastructures, a new era of sensing the urban landscape has begun. These technologies are creating a dynamic and responsive urban environment where people can collect data and sense and interact with their surroundings and fellow users. While existing research prioritizes the performance and safety of urban sensor technologies, their impact on social dynamics and traffic conditions remains underexplored. This paper presents a preliminary study that analyzes how the design and integration of sensor technologies affect human behavior on city streets and roads. By examining these interactions, we aim to shed light on the interplay between sensor technology, environmental design, social dynamics, and the perception and management of the urban landscape.

Opening keynote

David Howes, Concordia University, Montréal.

tba

THURSDAY,   14. Nov.

Panel 2: Sensing Borders

Borderscapes move across geographic landscapes and bureaucracies through bodies and virtual networks. Enforced through surveillance, they can materialize abruptly or fade into backgrounds, assembling publics, mobilizing memories, and anchoring practices of sur-/sousveillance and in-/exclusion. In current times of war, borderscapes are also defended by state and civilian actors, who use digital and sensor media to document and counteract destruction. The panel asks how human and more-than-human sensors relate to each other to constitute, surveil, dismantle, and negotiate borders and reconfigure security and sociopolitical paradigms.

Louise Amoore (Durham University) 

The deep border explodes and scatters biometric data so that they are no longer strictly connected to characteristics as such, but gather together with a multiplicity of data features in a deep learning model that renders all data as border data. Deep neural networks are now becoming intimately involved in the practices of borderwork and bordering, though my attention to the deep border is not the same thing as algorithms becoming instruments deployed at the border or becoming autonomous agents that displace human decisions at the border. Instead, deep learning is reordering what a border can mean, and how the boundaries of political community can be imagined. The deep border is written in and through machine learning models that make the world in their own image – as clusters of attributes that do not map to individual bodies, that are in fact unmoored from the weight and duress of bodies at the border, just as they are also able to actualize in any future body.


Valérie Schafer  (C2DH, University of Luxembourg) 

In 2003, UNESCO formally acknowledged born-digital heritage, setting a milestone for its preservation at an international scale. However, the landscape of born-digital archiving is fragmented, involving diverse practices, perimeters, collections, and stakeholders (Schafer et al., 2016) operating at several levels from an international one with Internet Archive to more targeted initiatives by researchers and the civil society, through national GLAMs. These entities, as well as researchers, increasingly grapple with the complexities of transnational circulation and studies and face significant challenges, for example analyzing the digital traces of the COVID crisis (Aasman et al., 2022). Institutional web archives often adhere to national borders. They are constrained by copyright laws and access restrictions, and collections may also face interoperability issues. This talk will therefore primarily explore the boundaries of web archives, whether related to access (such as in the archiving of social platforms), digital enclosures, legal frameworks, or the governance that shapes organizational structures. The intricate digital rights management, national jurisdictional limitations, and the technical barriers of archiving platforms reveal part of the multifaceted challenges in preserving born-digital heritage across borders. The second part of the presentation will delve deeper into some invisible barriers, addressing the dynamics of inclusion and exclusion within digital archiving. Highlighting initiatives like DocNow during the Ferguson unrest and the subsequent Black Lives Matter movement, or SUCHO for preserving Ukrainian cultural heritage online in times of war, this part considers ‚live archives’, underscoring the ongoing negotiations of borders and practices in times of crisis. Through these examples, we aim to shed light on efforts led by institutions, universities, or civil society to navigate and transcend the boundaries that define the archival landscape, promoting a more inclusive and comprehensive approach to digital heritage preservation, not without creating debates, needs for adaptation, and sometimes controversies

Christoph Borbach  (Universität Siegen) 

Taking into account the current consolidation of invisible borders in so-called “Virtual Fencing” in the context of smart farming, the presentation investigates flexibilizations in the channeling of the flow of animals, people, and signals in agriculture based on fencing techniques and materials. Fences as inconspicuous logistical media, largely neglected by media research, can be described as early interfaces that decided on the inclusion and exclusion of animals from (and to) certain terrains. Terrain modification and formatting through fencing technologies therefore structured geographical areas according to their own logics. The co-constitution of (farm) animal and (farm) technology is just as worthy of investigation as the advertising narratives of historically new forms of fencing, which repeatedly promised “precision” and “flexibility” in controlling the movement of animals.

Hendrik Bender and Max Kanderske (University of Siegen) 

Military drones have never cared for national borders. Indeed, the premise of models like the notorious Reaper and Predator, which have been explicitly designed to operate far outside domestic U.S. territory, has always been to enact violence on territories and people across borders. This changed in 2022, when the Bayraktar drone emerged as a symbol of Ukrainian resistance – a last-ditch defensive measure, employed within the besieged nation’s own air space. The Baryaktar quickly turned into a pop culture icon that circulated through social media via videos, songs, and memes. But its actual use on the battlefield soon got overshadowed by another type of drone, as the humble consumer drone, originally advertised as a peacetime entertainment technology by its manufacturers like DJI and Autel, got enlisted to patrol the shifting frontlines.

We argue that this move towards off-the-shelf consumer drones that do not depend on large-scale socio-technical infrastructures to function has given rise to new practices of wartime drone operation and modification that mark a decided shift from the use of earlier military drones. As depictions of drone violence circulate through social media platforms, entering our day-to-day media environments and eliciting international support for the war effort through crowdfunding schemes, consumer drone warfare extends far beyond the actual battlefield. Consequently, consumer drone warfare as a media event is characterized by the logic of social media platforms and targeted advertising that demands individual participation.

While drones are used as tools for enforcing or transgressing national borders, other boundaries get called into question by them. They blur the line between war- and peacetime aesthetics, between highly localized battlefields and global online spaces; and they produce graphic and intimate accounts of war that can act as a site for negotiating the legitimacy of the violence drones help to enact in the first place.

Food Court at the Siegen Mensa

Panel 3: Sensing Bodies

The panel is dedicated to the issue of how sensory practices and multisensoriality can be conceptualized and analyzed within social interactions. A double focus will be discussed, regarding embodied sensing in interaction and the interfaces between various technical-sensory and human actors. Drawing on interdisciplinary praxeological perspectives, notions like „embodiment“, „inter-corporality,“ and „body“ will be conceptually and empirically explored in their multimodal (linguistic and embodied) manifestations as well as socio-cultural and material situated ecologies. Different forms of (co)presence of the body/bodies will be considered, as produced through sensory practices, including different forms of multisensory perceiving and being perceived in everyday life, families, and institutions — within complex relationships between humans, things, animals, and digital media.

Lorenza Mondada, Anne Rawls, Christian Meyer, Philippe Sormani, Clemens Eisenmann 

This first part of Panel 3 will reflect on how multisensoriality is experienced in social interaction, within situated activities, and how it is eventually enhanced/(re)shaped/transformed by artefacts. It will discuss the public accountability of sensorial practices, regarding how bodies engaging in sensing interaction achieve together the intersubjectivity of their experience. This public accountability is established through the witnessability and shareability of sensorial practices, which are multisensorial, co-sensorial, and intercorporeal. Intersubjectivity is built through how participants engage in sensory practices and actions, and respond to each other: the panel will discuss different forms of (a)symmetric engagements and sequential environments in which sensoriality is experienced and negotiated by the participants. It will also discuss how intersubjectivity might also be normatively achieved, secured, and sometimes constrained by various material artifacts, and the way these artifacts intervene in the embodied practices of sensing. This slot will be articulated in three contributions to discuss how ethnomethodology, conversation analysis, and phenomenology approach various facets of sensoriality in interaction, such as sensing materiality, sensing the other, and how artifacts feature in sensorial practices.


Astrid Vogelpohl and Hoa Mai Trần (University of Siegen)

In this presentation, we draw upon empirical examples from the long-term camera ethnographic study „(Early) Childhood and Smartphone“, ongoing since 2016, to explore the cooperative entanglement of the human and technical sensorium in the context of digital games. Sensory experiences unfold in human and more-than-human bodies and generate new ways of being in the world and „ways of worldmaking“ (cf. Goodman 1978). With camera-ethnographic vignettes and fieldnotes, we will trace the interrelations between physical-analog and digital sensory practices in digital play and challenge assumptions about the separability of virtual and physical bodies. Our examination of how animated characters such as an injured owl or a thieving villager evoke emotions suggests that emotions are not simply a pre-conditioned response to a stimulus, but are mutually brought forth in more-than-human bodily practices. This observation leads us to ask: How and with which bodies do children interact and/or intra-act in digital play?

Jochen Lange and Farah Brandt  (University of Siegen)

The talk focuses ethnographically on practices and actions with specific, sensor-based media: Telepresence robots or avatars in primary schools. These devices take the place of a child in the classroom, who connects to the robot via tablet from home and operates it. Seeing and being seen, hearing and being heard, speaking and being spoken to as well as moving and being moved are challenged anew in everyday classroom practice. New human-technology figurations are emerging that enable spatially distributed sensory perception of individual pupils. Using empirical examples from an ongoing study on the use of this technology, we ask how presence and social interaction are shaped under such altered bodily and sensory conditions. To this end, we draw on praxeological and posthumanist discourses that question the boundaries and extensions of the body.

Second Keynote

Jürgen Streeck, University of Texas, Austin

tba

FRIDAY,   15. Nov.

Panel 4: Sensing Homes

With the development of smart home technologies, our understanding of home and domestic life is changing and previous boundaries between the private and public spheres are being challenged. Smart home technologies include various technologies such as robots, smart fridges, and voice assistants, most of which are equipped with sensors or operate using sensor data. Different user groups pursue different goals and purposes with sensor technologies in the home, e.g. monitoring one’s health is now a trend in many age groups, while fall prevention is mainly reserved for older citizens. It is often about control and safety, but always also about convenience, which is why sensors are increasingly found in our private environment to make our everyday lives and associated tasks easier. With this in mind, where does privacy begin and where does it end? The term ‘home’ refers to a personally appropriated and meaningful space that enables intimate relationships and serves as a protected place for individual fulfillment and retreat. Sensor technologies, e.g. IoT-connected devices such as smart speakers and cameras collect, store, and process personal data from such sanctity spaces, while such data practices of technology providers often disappear into the invisible, no longer perceptible to the user. This panel highlights (1) the complex dynamics of ‘home’ and perceptual practices by focusing on the intersection of embodied and technological forms of perception that shape individuals‘ interactions and sensemaking practices with their ‚home‘, and (2) current possibilities and desirable future scenarios of sensor-based support measures for a critical reflection and ethical validation of their design and implementation in private ‘homes’.

Mathias Funk (Eindhoven University of Technology)

When we were promised smart homes that sounded like a bright future solving for convenience, loneliness, elderly care, safety, democratization, and more. Alas, the homes are not smart, but full of things now. In this talk, we will take a journey from the early visions of home IoT to thing-centered design approaches and design research on the smart home. We will look beyond sensing and ubiquitous data collection, and develop a renewed vision of what an intelligence-augmented Everyday could be.

Gunnar Stevens (Universität Siegen/ Hochschule Bonn-Rhein-Sieg)

The private space is crucial for the well-being and freedom of the individual. Domestic privacy is particularly protected by law, which applies above all to state interference and commercial surveillance attempts. Usable Security helps users protect their privacy from these attempts. Yet, less is known about privacy norms and practices within the home. The spectrum of privacy issues within households is broad and diverse, ranging from everyday behaviors like password sharing to more concerning issues such as technology abuse and cyber-stalking. The talk aims to shed light on this overlooked topic, using a design lens on the complexities and nuances of privacy within the home.


Tim Moritz Hector & Niklas Strüver (Universität Siegen)

During the setup of voice assistants like Alexa or Siri in a domestic context, the assistants ask several questions about their future users like how many household members are there and which bank, music-streaming, Amazon, or Google account to connect. Thus, users are often faced with the task of defining their perceived living situation (e.g. family, shared flat) and fitting it into the predetermined options. In this process, digital technologies are adapted to households, and vice-versa, as users attempt to (infra-)structurate their smart home. 

The inquiry about the living arrangement can be interpreted as a moment of calling into question the seldom debated complex dynamics of ‘home’ and notions about (shared) perceptions within it. Based on recordings of the setup processes of smart speakers and an accompanying interview study, we examine how different users perceive, discuss, and define their (smart) living arrangements. We investigate how users reflect on their living situation based on these notions and how they attempt to find infrastructural workarounds (e.g. regarding privacy concerns) to make their arrangements fit while balancing the sensation of remaining in charge of shaping their daily life infrastructure.

Tanja Aal & Dennis Kirschsieper (Universität Siegen)

Telecare and telemedicine applications represent a special case of sensor-based smart home technologies, as intimate areas of the home and even the body are affected and large amounts of sensitive data are generated. In our presentation, we discuss desirable and less desirable scenarios of telecare and telemedicine in the private home based on expert interviews with professional caregivers, care scientists, and technology developers. In future scenarios, we focus firstly on the topics of autonomy and privacy, as understanding the technology and controlling data flows can be problematic, especially for older users. Secondly, we address the developments towards more community-based care in Germany and the connections between sensor technology in the private home and the local social environment, i.e. nursing services, doctor’s offices, neighbors, and the entire community in a broad sense.

Registration

Please register using the folowing survey.

 

Venue

University of Siegen
Campus Unteres Schloss
US-S 001 / 002
Obergraben 25
57072 Siegen