Bergstrom, I.; (2011) Soma: live performance where congruent musical, visual, and proprioceptive stimuli fuse to form a combined aesthetic narrative. Doctoral thesis , UCL (University College London).

Preview	PDF (Soma: live performance where congruent musical, visual, and proprioceptive stimuli fuse to form a combined aesthetic narrative) 1310143.pdf Download (7MB)
Preview	PDF (Soma: live performance where congruent musical, visual, and proprioceptive stimuli fuse to form a combined aesthetic narrative: Read Me file) 1310143_READ_ME.pdf Download (22kB)
	MP4 video (Soma: live performance where congruent musical, visual, and proprioceptive stimuli fuse to form a combined aesthetic narrative_01) 1310143_01_-_Maria_Louisa_-_First_video_for_survey.mp4 Download (169MB)
	MP4 video (Soma: live performance where congruent musical, visual, and proprioceptive stimuli fuse to form a combined aesthetic narrative_02) 1310143_02_-_Maria_Louisa_-_Second_video_for_survey_using_only_stereo_audio.mp4 Download (169MB)
	MP4 video (Soma: live performance where congruent musical, visual, and proprioceptive stimuli fuse to form a combined aesthetic narrative_03) 1310143_03_-_Triton_Leaves_Festival_submission.mp4 Download (205MB)
	MP4 video (Soma: live performance where congruent musical, visual, and proprioceptive stimuli fuse to form a combined aesthetic narrative_04) 1310143_04_-_Dark_Spaces.mp4 Download (194MB)
	MP4 video (Soma: live performance where congruent musical, visual, and proprioceptive stimuli fuse to form a combined aesthetic narrative_05) 1310143_05_-_Triton_Leaves_Alternate_version.mp4 Download (200MB)
	QuickTime Movie (Soma: live performance where congruent musical, visual, and proprioceptive stimuli fuse to form a combined aesthetic narrative_07) 1310143_07_-_Silent_Mix.mov Download (461MB)

Abstract

Artists and scientists have long had an interest in the relationship between music and visual art. Today, many occupy themselves with correlated animation and music, called 'visual music'. Established tools and paradigms for performing live visual music however, have several limitations: Virtually no user interface exists, with an expressivity comparable to live musical performance. Mappings between music and visuals are typically reduced to the music‘s beat and amplitude being statically associated to the visuals, disallowing close audiovisual congruence, tension and release, and suspended expectation in narratives. Collaborative performance, common in other live art, is mostly absent due to technical limitations. Preparing or improvising performances is complicated, often requiring software development. This thesis addresses these, through a transdisciplinary integration of findings from several research areas, detailing the resulting ideas, and their implementation in a novel system: Musical instruments are used as the primary control data source, accurately encoding all musical gestures of each performer. The advanced embodied knowledge musicians have of their instruments, allows increased expressivity, the full control data bandwidth allows high mapping complexity, while musicians‘ collaborative performance familiarity may translate to visual music performance. The conduct of Mutable Mapping, gradually creating, destroying and altering mappings, may allow for a narrative in mapping during performance. The art form of Soma, in which correlated auditory, visual and proprioceptive stimulus form a combined narrative, builds on knowledge that performers and audiences are more engaged in performance requiring advanced motor knowledge, and when congruent percepts across modalities coincide. Preparing and improvising is simplified, through re-adapting the Processing programming language for artists to behave as a plug-in API, thus encapsulating complexity in modules, which may be dynamically layered during performance. Design research methodology is employed during development and evaluation, while introducing the additional viewpoint of ethnography during evaluation, engaging musicians, audience and visuals performers.

Download activity - last month

Export as JSONXMLCSV

Download activity - last 12 months

Export as JSONXMLCSV

Downloads by country - last 12 months

Export as JSONCSVXML

Archive Staff Only

View Item