The primary goal of the Netravaad mobile app is to enable individuals with speech impairments to communicate using simple eye signs. The app utilizes the mobile device's front camera to detect the user's eye signs, converting these into words or sentences. The mobile app optimizes a deep learning (DL) model for eye sign detection by developing a new dataset for mobile use, enabling real-time interpretation of eye movements through an algorithm named "Sharani."
The app offers two language modes: English and Malayalam, each with two options. In English1 and Malayalam1, users can select from ten pre-defined words, while English2 and Malayalam2 offer sentence mode, alphabet, and word options for more flexible communication.