Rhodes, Chris;
Allmendinger, Richard;
Jay, Caroline;
Climent, Ricardo;
(2023)
Towards Developing a Virtual Guitar Instructor through Biometrics Informed Human-Computer Interaction.
In:
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems.
ACM: New York, NY, USA.
Preview |
Text
Rhodes_ACM_2023_Paper__Preprint.pdf - Accepted Version Download (8MB) | Preview |
Abstract
Within the last few years, wearable sensor technologies have allowed us to access novel biometrics that give us the ability to connect musical gesture to computing systems. Doing this affords us to study how we perform musically and understand the process at data level. However, biometric information is complex and cannot be directly mapped to digital systems. In this work, we study how guitar performance techniques can be captured/analysed towards developing an AI which can provide real-time feedback to guitar students. We do this by performing musical exercises on the guitar whilst acquiring and processing biometric (plus audiovisual) information during their performance. Our results show: there are notable differences within biometrics when playing a guitar scale in two different ways (legato and staccato) and this outcome can be used to motivate our intention to build an AI guitar tutor.
| Type: | Proceedings paper |
|---|---|
| Title: | Towards Developing a Virtual Guitar Instructor through Biometrics Informed Human-Computer Interaction |
| Event: | CHI '23: CHI Conference on Human Factors in Computing Systems |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1145/3544549.3582738 |
| Publisher version: | https://doi.org/10.1145/3544549.3582738 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Deep learning, Biometrics, Musical performance, Guitar, Multimodal data, Game engines, EMG, HCI |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education UCL > Provost and Vice Provost Offices > School of Education > UCL Institute of Education > IOE - Culture, Communication and Media |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10169054 |
Archive Staff Only
 |
View Item |
