Interactive relevance search and modeling: support for expert-driven analysis of multimodal data Conference Paper uri icon

abstract

  • In this paper we present the findings of three longitudinal case studies in which a new method for conducting multimodal analysis of human behavior is tested. The focus of this new method is to engage a researcher integrally in the analysis process and allow them to guide the identification and discovery of relevant behavior instances within multimodal data. The case studies resulted in the creation of two analysis strategies: Single-Focus Hypothesis Testing and Multi-Focus Hypothesis Testing. Each were shown to be beneficial to multimodal analysis through supporting either a single focused deep analysis or analysis across multiple angles in unison. These strategies exemplified how challenging questions can be answered for multimodal datasets. The new method is described and the case studies' findings are presented detailing how the new method supports multimodal analysis and opens the door for a new breed of analysis methods. Two of the three case studies resulted in publishable results for the respective participants. 2013 ACM.

name of conference

  • Proceedings of the 15th ACM on International conference on multimodal interaction

published proceedings

  • Proceedings of the 15th ACM on International conference on multimodal interaction

author list (cited authors)

  • Miller, C., Quek, F., & Morency, L.

citation count

  • 3

complete list of authors

  • Miller, Chreston||Quek, Francis||Morency, Louis-Philippe

publication date

  • December 2013