Projected visuals on stage have become a common element in contemporary dance performances. But they are often used only as a decorative element, disconnected from dancers; or merely shadowing what the dancers are doing on stage. Recent dance and technology projects such as Moving Digits (www.movingdigits.eu) have highlighted the importance of adding layers of meaning to dance performances through visuals. For example, this can be done by using visuals to reveal the choreographic thinking behind the dance piece, or to reveal otherwise non-visible information from the body of the dancer (e.g. biosignal data). 

STARTS.EE, art+science residency invites you to explore the use of biosignal data to create visuals in contemporary dance performance.

The goal of the project is to design a system that can collect biosignal data from the dancer, and use that data to generate visuals in a dance performance scenario. 

For example, biosignals such as muscle data (through EMG), heart rate (through ECG) and valence/arousal (through EDA) can be used to communicate the inner states of the dancer. These sensors are now widely available (also at the HCI group, TLU), and can be easy to implement in these scenarios. The resulting data can then be used to generate visuals, therefore creating more holistic experiences – where the dancer can communicate not just with his body movement, but also with the inner aspects of the body through those visuals. This can be particularly useful for dancers exploring somatic practices, and interested in the communication of somatic impressions with the aid of technology.

The outcomes of the project should include the working prototype and the protocol of the study where this prototype can be tested in a semi-controlled or in-situ environment. Ideally, the piloting of the study should be completed as well, including a public showing.

Availability. Your time and motivation to collaborate with an assigned residency partner on the proposed topic. The expected workload of the resident is ~160 h (i.e. equal to one month of full-time work). That workload can be stretched over a three-month period (i.e. maximum duration), starting at the end of October beginning of November 2021. The residents are expected to be physically present in Tallinn for the collaboration period and work face to face in the university premises if it is considered safe regarding the ongoing public health crisis.

Curiosity to explore the proposed topic on equal grounds with your residency partner, aiming for transdisciplinary collaboration where new knowledge is created for both participants.

Technical skills. From the Creative technologist, we expect technical skills such as signal processing knowledge, machine learning, and graphics programming. A basic level of technical skills will also benefit the artist applicant.

Documentation. The residency is a part of a research project and participants will be asked to provide regular feedback about the process for research purposes (in the format of diaries, interviews, workshops). The collaboration will also be documented for dissemination in (social)media (e.g. photos, videos, short interviews).