eprintid: 10154593 rev_number: 7 eprint_status: archive userid: 699 dir: disk0/10/15/45/93 datestamp: 2022-08-30 15:21:36 lastmod: 2022-08-30 15:21:36 status_changed: 2022-08-30 15:21:36 type: proceedings_section metadata_visibility: show sword_depositor: 699 creators_name: Rhodes, Chris title: Membrana Neopermeable ispublished: pub divisions: B14 divisions: J77 divisions: B16 divisions: UCL note: This is an Open Access paper published under a Creative Commons Attribution 4.0 International (CC BY 4.0) Licence (https://creativecommons.org/licenses/by/4.0/). abstract: Membrana Neopermeable is a composition for physical acoustic guitar, virtual guitar, mixed reality (MR) and live electronics. It seeks to investigate the potential of the latest developments in MR and machine learning (ML) technology when questioning the boundaries, and compositional opportunities, between physical and digital music instruments; here, the guitar. The piece is performed by interacting with both a physical acoustic guitar and a virtual guitar, where the latter ‘appears’ in the same physical space as the performer. This results in a format which is an interactive, MR, compositional experience, made possible through using: an Oculus Quest 2 head-mounted display (HMD - allowing digital overlays, when worn, to appear in the same physical space as the performer), Myo armband sensors worn on the arms (allowing the performer to make custom gestures within MR), the Unity game engine (hosting the Oculus Quest 2/Passthrough API, the standalone project application itself and allowing for C# scripting, physics mechanics, modelling and digital animation), Max 8 (to receive/process biometric information from the Myo armbands and using such biometric data to generate/manipulate sound materials in real-time), and finally Wekinator (to facilitate the ML of custom musical gestures made by the performer; processing and classifying performer biometric information during performance). Ultimately, through deconstructing the barriers between physical and virtual instrument performance/composition, this piece seeks to observe how future multimodal spaces can be used as compositional assets. date: 2022-07-01 publisher: University of Auckland / Waipapa Taumata Rau official_url: https://nime2022.org/ oa_status: green full_text_type: pub language: eng primo: open primo_central: open_green verified: verified_manual elements_id: 1972795 doi: 10.21428/92fbeb44.6e17eaf5 lyricists_name: Rhodes, Christopher lyricists_id: CRHOD07 actors_name: Flynn, Bernadette actors_id: BFFLY94 actors_role: owner full_text_status: public pres_type: paper series: International Conference on New Interfaces for Musical Expression (NIME) publication: NIME 2022 volume: 2022 place_of_pub: Auckland, New Zealand event_title: International Conference on New Interfaces for Musical Expression (NIME 2022) book_title: Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2022) citation: Rhodes, Chris; (2022) Membrana Neopermeable. In: Proceedings of the International Conference on New Interfaces for Musical Expression (NIME 2022). University of Auckland / Waipapa Taumata Rau: Auckland, New Zealand. Green open access document_url: https://discovery.ucl.ac.uk/id/eprint/10154593/1/6e17eaf5-835f-4be4-85b0-b0cf4552e013.pdf