Instrumental Access to Natural Multimodal Discourse Conference Paper

abstract

• Human multimodal communicative behaviors form a tightly integrated whole. We have present a paradigm multimodal analysis in natural discourse based on a feature decompositive psycholinguistically derived model that permits us to access the underlying structure and intent of multimodal communicative discourse. We outline the psycholinguistics that drive our paradigm, the Catchment concept that facilitates our getting a computational handle on discourse entities, and summarize some approaches and results that realize the vision. We show examples of such discoursestructuring features as handedness, types of symmetry, gaze-atinterlocutor, and hand 'origos'. Such analysis is an alternative to the 'recognition of one discrete gesture out of stylized whole gesture models' paradigm.

name of conference

• IEEE International Conference on Multimedia and Expo, 2001. ICME 2001.

authors

• Quek, Francis

published proceedings

• IEEE International Conference on Multimedia and Expo, 2001. ICME 2001.

author list (cited authors)

• Quek, F.

citation count

• 0

complete list of authors

• Quek, Francis

publication date

• January 2001

publisher

• Institute of Electrical and Electronics Engineers (IEEE)  Publisher

published in

• Proceedings / IEEE International Conference on Multimedia and Expo. IEEE International Conference on Multimedia and Expo  Journal

Digital Object Identifier (DOI)

• 10.1109/icme.2001.1237779

International Standard Book Number (ISBN) 10

• 0769511988

start page

• 551

end page

• 554

URL

• http://dx.doi.org/10.1109/icme.2001.1237779