Exploring pitch and timbre through 3d spaces: Embodied models in virtual reality as a basis for performance systems design

Richard Graham, Brian Bridges, Christopher Manzione, William Brent

Research output: Contribution to journalConference articlepeer-review

5 Scopus citations

Abstract

Our paper builds on an ongoing collaboration between theorists and practitioners within the computer music community, with a specific focus on three-dimensional environments as an incubator for performance systems design. In particular, we are concerned with how to provide accessible means of controlling spatialization and timbral shaping in an integrated manner through the collection of performance data from various modalities from an electric guitar with a multichannel audio output. This paper will focus specifically on the combination of pitch data treated within tonal models and the detection of physical performance gestures using timbral feature extraction algorithms. We discuss how these tracked gestures may be connected to concepts and dynamic relationships from embodied cognition, expanding on performative models for pitch and timbre spaces. Finally, we explore how these ideas support connections between sonic, formal and performative dimensions. This includes instrumental technique detection scenes and mapping strategies aimed at bridging music performance gestures across physical and conceptual planes.

Original languageEnglish
Pages (from-to)157-162
Number of pages6
JournalProceedings of the International Conference on New Interfaces for Musical Expression
StatePublished - 2017
EventInternational conference on New Interfaces for Musical Expression, NIME 2017 - Copenhagen, Denmark
Duration: 15 May 201719 May 2017

Keywords

  • Embodied
  • Feature
  • Gesture
  • Mapping
  • Metaphor
  • Schemas
  • Spatialization
  • Timbre
  • Tracking

Fingerprint

Dive into the research topics of 'Exploring pitch and timbre through 3d spaces: Embodied models in virtual reality as a basis for performance systems design'. Together they form a unique fingerprint.

Cite this