An AR system for monitoring arm movements for stroke patients

Virtual Reality (VR) and Augmented Reality (AR) are becoming mainstream and are finding applications in a variety of domains. Here, a framework of components used in a virtual augmented perception environment is described for a stroke rehabilitation application, which allows users to perceive and explore objects differently. The primary components of the AR system include a VR headset (Oculus Rift), a robust motion controller (LEAP motion controller), an associated VR driving software, and a camera system (Optotrak Certus 3D) that can track the motion of wireless infrared markers (IREDS) attached to the user's arm. A development software platform (Unity Game Engine) is used to create the virtual objects and scenarios for interaction, with the AR system providing the mechanism to enable the interaction with the virtual objects. The camera system is used in conjunction with the AR system for a comparative study on the perception of arm movement and imitation of specific arm actions. The data collected from the camera system enables comparison of accuracy and precision of the movements by analyzing parameters such as reaction time (RT), movement time (MT) and peak velocity (PV) by directly observing movements while the user performs the actions in the AR environment.

An AR system for monitoring arm movements for stroke patients Conference Paper