Choreographic buttons: promoting social interaction through human movement and clear affordances Conference Paper uri icon


  • We used human movement as the basis for designing a collaborative aesthetic design environment. Our intention was to promote social interaction and creative expression. We employed off-the-shelf computer vision technology. Movement became the basis for the choreography of gestures, the development of gesture recognition, and the development of imagery and visualization. We discovered that the design of clear affordances is no less important in movement-based than in mouse-based systems. Through an integrated and iterative design process, we developed a new type of affordance, the choreographic button, which integrates choreography, gesture recognition, and visual feedback. Jumping, a quick movement, and crouching, a sustained gesture, were choreographed to form a vocabulary that is personally expressive, and which also facilitates automatic recognition.How can we evaluate socially motivated interactive systems? To create a context for evaluation, we held an integrated exhibition, party, and user study event. This mixing of events produced an engaging environment in which participants could choose to interact with each other, as well as with the design environment. We prepared a mouse-based version of the design environment, and compared how people experienced it with the movementbased system. Our study demonstrates that movement-based affordances promote social interaction. Copyright 2006 ACM.

name of conference

  • Proceedings of the 14th ACM international conference on Multimedia

published proceedings

  • Proceedings of the 14th ACM international conference on Multimedia

author list (cited authors)

  • Webb, A., Kerne, A., Koh, E., Joshi, P., Park, Y., & Graeber, R.

citation count

  • 7

complete list of authors

  • Webb, Andrew||Kerne, Andruid||Koh, Eunyee||Joshi, Pranesh||Park, YoungJoo||Graeber, Ross

editor list (cited editors)

  • Nahrstedt, K., Turk, M., Rui, Y., Klas, W., & Mayer-Patel, K.

publication date

  • January 2006