Collective Mobile Mapping @ Montpellier Danse

À l’occasion de l’ouverture de la 36e édition du festival Montpellier Danse, EnsadLab, idscenes et le festival vous conviait à faire l’expérience d’un dispositif interactif collectif et immersif inédit les jeudi 23 juin de 13h à 17h, vendredi 24 et samedi 25 juin de 11h à 17h, salle Béjart Agora (18 Rue Sainte-Ursule, Montpellier).

Montpellier Danse a accueilli, dans la salle Béjart de l’Agora, l’événement Collective Mobile Mapping Montpellier, réunissant les œuvres de Dominique Cunin et Christophe Domino sous forme de sessions alternées et complémentaires. Espace Puissance Espace, de Dominique Cunin, trouve son origine dans la projection immersive du modèle 3D d’un espace architectural sur lui-même.

Les spectateurs sont invités à contrôler collectivement cette grande image à l’aide de leurs smartphones.
Les murs bougent, on entre dans l’épaisseur et l’intimité du bâtiment. Centon Digital est un jeu de sens et de lecture, où le joueur sélectionne des mots ou des séquences de mots qui s’additionnent pour former un texte projeté. Tous les murs deviennent écran, la frontalité d’une projection « classique » disparaît pour laisser la place à une immersion du spectateur dans la projection textuelle, à une interactivité entre les joueurs eux-mêmes et avec la Salle Béjart.

Un projet idscènes, organisé par EnsadLab, le laboratoire de l’École nationale supérieure des Arts Décoratifs—Paris, Grande Image Lab, ESBA TALM-Le Mans et avec le concours de l’Esbama Montpellier.

Electrosound @ EDF Foundation

CoSiMa is represented in the Electrosound exhibition at the EDF Foundation with two small installations. One documents the participative concert Chloé ⨉ Ircam and the other is a downscaled version of Collective Loops.

The installation that refers to the participative concert we created with Chloé, is based on the same technical setup and music track as the Terminal installation and features 14 wall mounted smartphones. As in the concert and the Terminal installation, the public can connect to the installation to participate using their mobile devices.

electrosound-chloe-x-ircam

Collective Loops is shown in a reduced version with eight smartphones mounted on desk and a screen that replaces the floor projection.

electrosound-collective-loops

The exhibition also included the MO – Musical Objects that have been developed in the framework of one of CoSiMa’s predecessor projects, Interlude.

electrosound-interlude-mo

Overexposure / Surexposition v.2

An interactive public installation with smartphones, Palais de Tokyo, Paris, February 2016

Surexposition/Overexposure (v.2) is an interactive work bringing together a public installation and a smart phone application. On an urban square, a large black monolith projects an intense beam of white light into the sky. Visible all over the city, the beam turns off and on, pulsating in way that communicates rigor, a will to communicate, even if we don’t immediately understand the signals it is producing. On one side of the monolith, white dots and dashes scroll past, from the bottom up, marking the installation with their rhythm: each time one reaches the top of the monolith, the light goes off, as if the marks were emptying into the light. On a completely different scale, we see the same marks scrolling across the smartphone screens of the people in attendance, interacting with the work, following the same rhythm. Here, it is the flash of the smartphones that releases light in accordance with the coded language. Returning to the very essence of Morse, the messages are then transformed into a sound composition, broadcast by the installation, as well as by the public’s smartphones. Because these are in fact messages that are being sent—in Morse code, from everyone, to everyone and to the sky—and that we can read thanks to the super-titling that accompanies the marks. Using a smartphone, anyone can send a message, saying what they think and therefore presenting themselves, for a few moments, to everyone, to a community sharing the same time, the same rhythm. And we can take the pulse of an even larger community—on the scale of the city and in real time—through a map of mobile phone network use, projected onto the ground or visualized via smartphone.

From an individual device (smartphone) the size of a hand to a shared format on the scale of the city, a momentary community forms and transforms, sharing a space, a pace, the same data, following a type of communication whose ability to bring together through a sensory experience is more important than the meaning of the messages it transmits or their destination, which is lost in the sky.


(Photos: Samuel Bianchini)

Credits
An Orange/EnsadLab (the laboratory of the École Nnationale supérieure Supérieure des Arts Décoratifs, PSL Research University) project under the direction of Samuel Bianchini

in collaboration with Dominique Cunin (EnsadLab), Catherine Ramus (Orange Labs) and Marc Brice (Orange Labs), in the framework of a research partnership with Orange Labs, and Roland Cahen (sound design).

“Orange/EnsadLab” partnership directors: Armelle Pasco, Director of Cultural and Institutional Partnerships, Orange and Emmanuel Mahé, Head of Research, EnsAD

Project Manager (Orange): Abla Benmiloud-Faucher
IT Development (EnsadLab): Dominique Cunin, Oussama Mubarak, Jonathan Tanant
Graphic Design: Alexandre Dechosal (EnsadLab)
Sound Design: Roland Cahen
Sound engine development: Norbert Schnell (Ircam)
Voice samples recorded by choristers from Jazzalam
Lighting, Video Mapping and construction of the installation structure: idscènes
Mobile network data supply: Orange Flux Vision
Mobile network data processing: Cezary Ziemlicki (Orange)
SMS Server Development: Orange Applications for Business
Technical Assistant: Alexandre Saunier (EnsadLab)
Production Assistant: Élodie Tincq

Production: Orange
Executive Production: EnsadLab

The research and development for this work were carried out in association with the research project Cosima (“Collaborative Situated Media”), coordinated by Ircam and sponsored by the Agence nationale de la recherche (ANR) and participate in the development of Mobilizing.js (http://www.mobilizing-js.net), a programming environment for mobile screens, conceived by EnsadLab, aimed at artists and designers.
This version of Surexposition benefits from a partnership with idscènes and Ircam under the aegis of the Cosima project.

Collective Loops @ Forum Workshops

A second version of the Collective Loops installation has been shown during the Ircam Forum Workshops on November 25 and 26, 2015.

The installation features a collaborative version of a step sequencer that uses the visitor’s smartphones to produce sound. The sequencer is graphically represented by a circle of 8 sectors projected on the floor. The sectors light up in a clockwise motion following the beats of the sequence.

When the players connect to the installation through a web page, they choose an available sector, and thus, their step in the loop. The players can control the sounds (i.e. notes in a melody or bass line and percussion sounds) that are played on their smartphone at the corresponding beat of the sequence through a simple graphical interface on their smartphones. The selected sounds are also displayed in the corresponding sector of the circle on the floor.

Positioned around the circle, the players collaborate on creating melodies and rhythm patterns rendered through their smartphones.

The application uses a first complete version of the CoSiMa platform entirely based on web standards.

Design and development :
Ircam: Norbert Schnell, Jean-Philippe Lambert, Benjamin Matuszewski, Sebastien Robaszkiewicz
Orbe: Xavier Boissarie, Florent Dubois, Gregory Cieslik, Tomek Jarolim, Quentin Levigneron
EnsadLab: Samuel Bianchini, Dominique Cunin, Oussama Mubarak, Jonathan Tanant
ID Scènes: Christophe Aubry, Fabrice Auchere
NoDesign: Jean-Louis Frechin, Uroš Petrevski
ESBA TALM: Christophe Domino

Terminal @ Paris Musique Club

Terminal is an interactive installation that has been created in collaboration with Chloé and the Scale collective for the Paris Musique Club. The installation will be shown from October 24, 2015 to January 31, 2016 at the Gaité Lyrique.

The project transposes the musical elements and mobile interactions of the Chloé ⨉ Ircam concert into the situation of an exhibition.
The installation features a looped 15-minutes 4-channel music track staged in a 7-meters corridor with 21 smartphones aligned along the wall and luminous lines running on the floor.

Similar as in the concert, visitors can connect to the installation with their mobile devices to participate. At given passages of the music track, the participants are invited to play sound with touch and motion interfaces that appear on their mobile device. The graphical animations and sound of their device are echoed by one of the smartphones on the wall.

guiro-interfaces

Every now and then, waves of sound textures appear on the participants’ mobile devices. In addition, visitors can use a wall-mounted tablet to distribute sound textures over the smartphones on the wall. The light on the floor reacts on the music as well as the visitors’ interactions with the tablet.

Open House @ IRCAM

During IRCAM’s open house on June 6th, CoSiMa presented two different projects, Collective Loops and Woodland.


Collective Loops

Collective Loops is a collaborative version of an 8-step loop sequencer. When visitors access the webpage of the installation with their smartphone, they are automatically assigned to an available step in the sequence loop, and their smartphone plays a sound when it is their turn. The participants control the pitch of the sound through the inclination of their smartphones. The participants are invited to collaboratively create a melody of 8 pitches that circulates in a steady tempo over their smartphones.

A circular visualization of the sequencer is projected on the floor. The projection consists of a circle divided in 8 sections that light up in counterclockwise circular movement synchronized with the sounds emitted by the smartphones. Each section of the projection is further divided into 12 radial segments that display the pitch of the corresponding sequence step (i.e. controlled through the inclination of the participants smartphone).

The 8 first participants who connect to the sequencer have a celesta sound, the 8 following can play with a drum kit, the 8 last have a bass sound. All together, 24 players can create complex rhythmic and melodic patterns.


Woodland

Woodland is a very early stage prototype that aims at explaining how natural audio effects (such as reverb) are created in the natural environment. For this, we create a setting where each participant is a tree in a forest. At some point, a designated player “throws a sound” in the forest by swinging his / her smartphone upwards. After a few seconds of calculations, the sound falls on one tree; then we hear the first wave of resonances when the sound reaches the other trees; and so on recursively until the sound ultimately vanishes.

In order to make people understand what is going on, we can control several parameters of the simulation such as the speed of sound in the air, the absorbance of the air, the type of sound (with a hard or soft attack), etc. That way, if we set the parameters to be similar to the natural setting, we hear the same reverb as we would hear in a forest. But if for example we slow down the speed of sound, we can hear a very slow version of how this natural reverb is built, hearing each echo one by one.

This very first prototype was very promising, and further developments might include a visualization on the floor of the different sounds that bounce from trees to trees to create that reverb effect.

Overexposure / Surexposition @ Fête des Lumières

An interactive public installation with smartphones, Fête des Lumières, Lyon, décembre 2014

Overexposure is an interactive work bringing together a public installation and a smart phone application. On an urban square, a large black monolith projects an intense beam of white light into the sky. Visible all over the city, the beam turns off and on, pulsating in way that communicates rigor, a will to communicate, even if we don’t immediately understand the signals it is producing. On one side of the monolith, white dots and dashes scroll past, from the bottom up, marking the installation with their rhythm: each time one reaches the top of the monolith, the light goes off, as if the marks were emptying into the light. On a completely different scale, we see the same marks scrolling across the smartphone screens of the people in attendance, interacting with the work, following the same rhythm. Here, it is the flash of the smartphones that releases light in accordance with the coded language. Because these are in fact messages that are being sent—in Morse code, from everyone, to everyone and to the sky—and that we can read thanks to the super-titling that accompanies the marks. Using a smartphone, anyone can send a message, saying what they think and therefore presenting themselves, for a few moments, to everyone, to a community sharing the same time, the same rhythm. And we can take the pulse of an even larger community—on the scale of the city and in real time—through a map of mobile phone network use, which can be visualized on one side of the monolith or via smartphone.

From an individual device (smartphone) the size of a hand to a shared format on the scale of the city, a momentary community forms and transforms, sharing a space, a pace, the same data, following a type of communication whose ability to bring together through a sensory experience is more important than the meaning of the messages it transmits or their destination, which is lost in the sky.


(Photos: Samuel Bianchini)

Credits
An Orange/EnsadLab project

A project under the direction of Samuel Bianchini (EnsadLab), in collaboration with Dominique Cunin (EnsadLab), Catherine Ramus (Orange Labs/Sense), and Marc Brice (Orange Labs/Openserv), in the framework of a research partnership with Orange Labs

“Orange/EnsadLab” partnership directors: Armelle Pasco, Director of Cultural and Institutional Partnerships, Orange and Emmanuel Mahé, Head of Research, EnsAD

  • Project Manager (Orange): Abla Benmiloud-Faucher
  • IT Development (EnsadLab): Dominique Cunin, Oussama Mubarak, Jonathan Tanant, and Sylvie Tissot
  • Mobile network data supply: Orange Fluxvision
  • Mobile network data processing: Cezary Ziemlicki and Zbigniew Smoreda (Orange)
  • SMS Server Development: Orange Applications for Business
  • Graphic Design: Alexandre Dechosal (EnsadLab)
  • In situ installation (artistic and engineering collaboration): Alexandre Saunier (EnsadLab)
  • Lighting and construction of the installation structure: Sky Light
  • Wireless network deployment coordination: Christophe Such (Orange)
  • Communication: Nadine Castellani, Karine Duckit Claudia Mangel (Orange), Nathalie Battais-Foucher (EnsAD)
  • Mediation: Nadjah Djadli (Orange)
  • Project previsualization: Christophe Pornay
  • Assistant: Élodie Tincq
  • Message moderators: Élodie Tincq, Marion Flament, Charlotte Gautier
  • Production: Orange
  • Executive Production: EnsadLab

Research and development for this work was carried out in connection with the research project Cosima (“Collaborative Situated Media”), with the support of the French National Research Agency (ANR), and participates in the development of Mobilizing.js, a programming environment for mobile screens developed by EnsadLab for artists and designers