Real-Time Continuous Action Detection and Recognition Using Depth Images and Inertial Signals Conference Paper uri icon

abstract

  • 2017 IEEE. This paper presents an approach to detect and recognize actions of interest in real-time from a continuous stream of data that are captured simultaneously from a Kinect depth camera and a wearable inertial sensor. Actions of interest are considered to appear continuously and in a random order among actions of non-interest. Skeleton depth images are first used to separate actions of interest from actions of non-interest based on pause and motion segments. Inertial signals from a wearable inertial sensor are then used to improve the recognition outcome. A dataset consisting of simultaneous depth and inertial data for the smart TV actions of interest occurring continuously and in a random order among actions of non-interest is studied and made publicly available. The results obtained indicate the effectiveness of the developed approach in coping with actions that are performed realistically in a continuous manner.

name of conference

  • 2017 IEEE 26th International Symposium on Industrial Electronics (ISIE)

published proceedings

  • 2017 IEEE 26TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE)

author list (cited authors)

  • Dawar, N., Chen, C., Jafari, R., & Kehtarnavaz, N.

citation count

  • 11

complete list of authors

  • Dawar, Neha||Chen, Chen||Jafari, Roozbeh||Kehtarnavaz, Nasser

publication date

  • June 2017