A dual-mode human computer interface combining speech and tongue motion for people with severe disabilities.
- Additional Document Info
- View All
We are presenting a new wireless and wearable human computer interface called the dual-mode Tongue Drive System (dTDS), which is designed to allow people with severe disabilities to use computers more effectively with increased speed, flexibility, usability, and independence through their tongue motion and speech. The dTDS detects users' tongue motion using a magnetic tracer and an array of magnetic sensors embedded in a compact and ergonomic wireless headset. It also captures the users' voice wirelessly using a small microphone embedded in the same headset. Preliminary evaluation results based on 14 able-bodied subjects and three individuals with high level spinal cord injuries at level C3-C5 indicated that the dTDS headset, combined with a commercially available speech recognition (SR) software, can provide end users with significantly higher performance than either unimodal forms based on the tongue motion or speech alone, particularly in completing tasks that require both pointing and text entry.
IEEE Trans Neural Syst Rehabil Eng
author list (cited authors)
Huo, X., Park, H., Kim, J., & Ghovanloo, M.
complete list of authors
Huo, Xueliang||Park, Hangue||Kim, Jeonghee||Ghovanloo, Maysam