We report research performed on gesture analysis and mapping to music. Various movements were rec... more We report research performed on gesture analysis and mapping to music. Various movements were recorded using 3D optical motion capture. Using this system, we produced animations from movements/dance, and generate in parallel the soundtrack from the dancer's movements. Prior to the actual sound mapping process, we performed various motion analyses. We present here two methods, both independent of specific orientation or location of the subject. The first deals with gestural segmentation, while the second uses pattern recognition.
This article reports on a project that uses unfettered gestural
motion for expressive musical pur... more This article reports on a project that uses unfettered gestural motion for expressive musical purposes. The project involves the development of, and experimentation with, software to receive data from a Vicon motion capture system, and to translate and map that data into data for the control of music and other media such as lighting. In addition to the commercially standard MIDI—which allows direct control of external synthesizers, processors, and other devices—other mappings are used for direct software control of digital audio and video. This report describes the design and implementation of the software, discusses specific experiments performed with it, and evaluates its application in terms of aesthetic pros and cons.
We report research performed on gesture analysis and mapping to music. Various movements were rec... more We report research performed on gesture analysis and mapping to music. Various movements were recorded using 3D optical motion capture. Using this system, we produced animations from movements/dance, and generate in parallel the soundtrack from the dancer's movements. Prior to the actual sound mapping process, we performed various motion analyses. We present here two methods, both independent of specific orientation or location of the subject. The first deals with gestural segmentation, while the second uses pattern recognition.
This article reports on a project that uses unfettered gestural
motion for expressive musical pur... more This article reports on a project that uses unfettered gestural motion for expressive musical purposes. The project involves the development of, and experimentation with, software to receive data from a Vicon motion capture system, and to translate and map that data into data for the control of music and other media such as lighting. In addition to the commercially standard MIDI—which allows direct control of external synthesizers, processors, and other devices—other mappings are used for direct software control of digital audio and video. This report describes the design and implementation of the software, discusses specific experiments performed with it, and evaluates its application in terms of aesthetic pros and cons.
Uploads
Papers by Jeff Ridenour
motion for expressive musical purposes. The project involves
the development of, and experimentation with, software to
receive data from a Vicon motion capture system, and to
translate and map that data into data for the control of music
and other media such as lighting. In addition to the
commercially standard MIDI—which allows direct control of
external synthesizers, processors, and other devices—other
mappings are used for direct software control of digital audio
and video. This report describes the design and
implementation of the software, discusses specific
experiments performed with it, and evaluates its application in
terms of aesthetic pros and cons.
motion for expressive musical purposes. The project involves
the development of, and experimentation with, software to
receive data from a Vicon motion capture system, and to
translate and map that data into data for the control of music
and other media such as lighting. In addition to the
commercially standard MIDI—which allows direct control of
external synthesizers, processors, and other devices—other
mappings are used for direct software control of digital audio
and video. This report describes the design and
implementation of the software, discusses specific
experiments performed with it, and evaluates its application in
terms of aesthetic pros and cons.