Oscillatory Gestures and Discourse
Conference Paper
Overview
Identity
Additional Document Info
Other
View All
Overview
abstract
2003 IEEE. Gesture and speech are part of a single human language system. They are co-expressive and complementary channels in the act of speaking. While speech carries the major load of symbolic presentation, gesture provides the imagistic content. Proceeding from the established cotemporality of gesture and speech, we discuss our work on oscillatory gestures and speech. We present our wavelet-based approach in gestural oscillation extraction as geodesic ridges in frequency-time space. We motivate the potential of such computational cross-modal language analysis by performing a micro analysis of a video dataset in which a subject describes her living space. We demonstrate the ability of our algorithm to extract gestural oscillations and show how oscillatory gestures reveal portions of the discourse structure.
name of conference
2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698)