Rhodes, Chris;
(2022)
Membrana Neopermeable.
In:
Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2022).
University of Auckland / Waipapa Taumata Rau: Auckland, New Zealand.
Preview |
Text
6e17eaf5-835f-4be4-85b0-b0cf4552e013.pdf - Published Version Download (79kB) | Preview |
Abstract
Membrana Neopermeable is a composition for physical acoustic guitar, virtual guitar, mixed reality (MR) and live electronics. It seeks to investigate the potential of the latest developments in MR and machine learning (ML) technology when questioning the boundaries, and compositional opportunities, between physical and digital music instruments; here, the guitar. The piece is performed by interacting with both a physical acoustic guitar and a virtual guitar, where the latter ‘appears’ in the same physical space as the performer. This results in a format which is an interactive, MR, compositional experience, made possible through using: an Oculus Quest 2 head-mounted display (HMD - allowing digital overlays, when worn, to appear in the same physical space as the performer), Myo armband sensors worn on the arms (allowing the performer to make custom gestures within MR), the Unity game engine (hosting the Oculus Quest 2/Passthrough API, the standalone project application itself and allowing for C# scripting, physics mechanics, modelling and digital animation), Max 8 (to receive/process biometric information from the Myo armbands and using such biometric data to generate/manipulate sound materials in real-time), and finally Wekinator (to facilitate the ML of custom musical gestures made by the performer; processing and classifying performer biometric information during performance). Ultimately, through deconstructing the barriers between physical and virtual instrument performance/composition, this piece seeks to observe how future multimodal spaces can be used as compositional assets.
| Type: | Proceedings paper |
|---|---|
| Title: | Membrana Neopermeable |
| Event: | International Conference on New Interfaces for Musical Expression (NIME 2022) |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.21428/92fbeb44.6e17eaf5 |
| Publisher version: | https://nime2022.org/ |
| Language: | English |
| Additional information: | This is an Open Access paper published under a Creative Commons Attribution 4.0 International (CC BY 4.0) Licence (https://creativecommons.org/licenses/by/4.0/). |
| UCL classification: | UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Culture, Communication and Media UCL > Provost and Vice Provost Offices > School of Education UCL |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10154593 |
Archive Staff Only
 |
View Item |
