For people with verbal or cognitive impairments, engaging in conversation can be tiresome and time-consuming, limiting their educational, social, and career opportunities. Livox is a pictogram-based alternative communication application that empowers people with a wide range of visual and motor impairments to engage in conversations. This project incorporated a ML and NLP-based classifier to detect specific questions and present the most relevant pictograms to users. Our newly introduced classifier reduced the time and effort required to communicate by 68.5% and 56.4%, respectively compared to the standard application. These results show that our work is a step towards making the world a more inclusive place for those who are nonverbal and have motor skill challenges.
Worcester Polytechnic Institute
Major Qualifying Project
All authors have granted to WPI a nonexclusive royalty-free license to distribute copies of the work, subject to other agreements. Copyright is held by the author or authors, with all rights reserved, unless otherwise noted.