Here you will find information about my research into gesture and interactivity, including links to downloadable papers and software.

Overview

My work with disabled students at the University of California, Riverside gave rise over a long period to a number of research projects having to do with human/computer interaction. I have been especially interested in the expressive power of gesture and its application to interactive media performance. At IRCAM I developed a custom data glove that led to several musical projects (see the Glove Project) as well as research papers and presentations. Ongoing is my research with Vincent Hayward (see Collaborators) into haptic feedback systems and their use with gestural controllers.

PUBLISHED PAPERS:

“Reading Texts in Real Time: The Dramatic Voice in/of Interactive Media.” With Katherine Bergeron. Proceedings, Ninth Biennial Symposium on Arts and Technology, Connecticut College, February 2003. (download)

“Artistic Collaboration in an Interactive Dance and Music Performance Environment.” Digital Performance (Anomalie: Digital Arts, Vol. 2, 2002).
Also published in Crossings: Electronic Journal of Art and Technology (University of Dublin). Click here to read online article.

“Seine hohle form: Artistic Collaboration in an Interactive Dance and Music Performance Environment,” in Proceedings, COSIGN 2001: First International Conference on Computational Semiotics in Games and New Media.

"Typology of Tactile Sounds and their Synthesis in Gesture-Driven Computer Music Performance." With Vincent Hayward. On Trends in Gestural Control of Music CDROM, published by IRCAM, 2000. (download)

"jMax: An Environment for Real-Time Musical Applications." With Déchelle and Schnell. Published in Computer Music Journal, Fall 1999.

“Introducing MAX.” Proceedings, MSP Summer School in Japan, June 1999.

"ESCHER: a system for real-time development of composed instruments." With Wanderley and Schnell. Proceedings, IEEE "System, Man, and Cybernetics" Conference 1998.

"Latest evolutions of the FTS real-time engine: typing, scoping, threading, compiling." With Déchelle and Schnell. Proceedings, ICMC 1998, Ann Arbor, Michigan.

"jMax: a new JAVA-based editing and control system for real-time musical applications." With Déchelle and Schnell. Proceedings, ICMC 1998, Ann Arbor, Michigan.

"Instrumental Gesture Mapping Strategies as Expressivity Determinants in Computer Music Performance." With Wanderley and Dubnov. Proceedings, KANSEI conference, Genoa, Italy. 1997

“Introducing MAX.” Music and Computers. September 1996, pp. 32-42.


PRESENTATIONS:

"VR/TX Haptic Feedback System." Demonstration presented at NIME 2003, McGill University, May 2003. Co-presenters: Vincent Hayward, Mark Goldstein.

“COLLIDE: Alternate Controllers and Interactive Media.” Composer-in-residence lecture at Texas A&M University, April 2003.

"Composing for Interactive Systems." Composer-in-residence lecture at Central Michigan University, March 2002.

"Interactive Systems: Issues in Performance." Composer-in-residence lecture at "Music and Movement Summer Workshop," Pisa, Italy, July, 2001.

"Gesture, Expression and Computer Music Performance." Composer-in-residence lecture at the University of Illinois, Champagne-Urbana, May 2001.

Interactive Computer Music Performance." Composer-in-residence lecture at Stetson University, April 2000.

Gestural Controllers: Strategies for Expressive Application. With an Overview of Recent Research at IRCAM. Presented at Interval Systems, Palo Alto, California, July 1998.

“De nouveaux instruments: Making Music with Gestural Controllers.” Presentation given at the Academie d'Eté IRCAM, Paris, June 1998.

"Use of gestural controllers in real-time electronic performance", lecture/performance at the three-day "Portes ouvertes" festival, IRCAM, Paris, 1998.

"Gestural Controllers: Strategies for Expressive Application." SEAMUS 1998 National Conference, Dartmouth College, Hanover, New Hampshire, USA.

“ESCHER: a flexible FTS additive synthesis environment with applications to gestural control.” Presented at the Séminaire Interne - Recherche - January, 1998. With Norbert Schnell and Marcelo Wanderley.

“Capteurs de Geste et Applications Musicales.” With Marcelo M. Wanderley. Presented at the Journèe d'Ètude, Conservatoire National Supèrieur de Musique de Paris. Paris, November 1997.

“Les Capteurs Gestuels.” Presentation given at the Academie d'Eté IRCAM, Paris, June 1997.