Extended Multitouch: Recovering Touch Posture and Differentiating Users using a Depth Camera Conference Paper uri icon

abstract

  • Multitouch surfaces are becoming prevalent, but most existing technologies are only capable of detecting the user's actual points of contact on the surface and not the identity, posture, and handedness of the user. In this paper, we define the concept of extended multitouch interaction as a richer input modality that includes all of this information. We further present a practical solution to achieve this on tabletop displays based on mounting a single commodity depth camera above a horizontal surface. This will enable us to not only detect when the surface is being touched, but also recover the user's exact finger and hand posture, as well as distinguish between different users and their handedness. We validate our approach using two user studies, and deploy the technique in a scratchpad tool and in a pen + touch sketch tool. Copyright 2012 ACM.

name of conference

  • Proceedings of the 25th annual ACM symposium on User interface software and technology

published proceedings

  • UIST'12: PROCEEDINGS OF THE 25TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY

altmetric score

  • 6.25

author list (cited authors)

  • Murugappan, S., Vinayak, .., Elmqvist, N., & Ramani, K.

citation count

  • 46

complete list of authors

  • Murugappan, Sundar||Elmqvist, Niklas||Ramani, Karthik

publication date

  • October 2012