Faculty Advisor

Neamtu, Rodica

Abstract

For people with verbal or cognitive impairments, engaging in conversation can be tiresome and time-consuming, limiting their educational, social, and career opportunities. Livox is a pictogram-based alternative communication application that empowers people with a wide range of visual and motor impairments to engage in conversations. This project incorporated a ML and NLP-based classifier to detect specific questions and present the most relevant pictograms to users. Our newly introduced classifier reduced the time and effort required to communicate by 68.5% and 56.4%, respectively compared to the standard application. These results show that our work is a step towards making the world a more inclusive place for those who are nonverbal and have motor skill challenges.

Publisher

Worcester Polytechnic Institute

Date Accepted

2020-03-04

Major

Computer Science

Project Type

Major Qualifying Project

Accessibility

Unrestricted

Advisor Department

Computer Science

Share

COinS