Nvidia presents Signs, the interactive platform for teaching signs language through AI

Nvidia has presented Signs an interactive platform promoted by artificial intelligence (AI) designed for Teach American sign language (ASL) to users, as well as create a PUBLIC BASIS that allows to develop more applications of AI that slow the barriers of communication with the sign language.

The AI ​​company has been associated with the American Society for Deaf Children and the creative agency Hello Monday To fight the communication gap between people with hearing or speech problems, promoting sign language learning and the development of accessible applications.

In this sense, Nvidia has announced its new interactive platform Signs that, promoted by AI, helps users to learn sign language, through varied libraries of ASL signs and a 3D avatar which shows how the signs have to be executed.

In this way, as the company explained in a statement on its website, the operation of the platform is based on the fact that the users show before the camera how they practice asl language And, on the other hand, Signs uses an AI tool to Analyze the images in real time and offer comments With corrections.

Currently, SIGNS provides a Initial set of 100 signs so that users can communicate “more effectively” with friends or family to use ASL. This data set is being validated by performers who speak fluentlyto guarantee the accuracy of each sign and ensure offer a visual dictionary and a “high quality” teaching tool.

Nvidia also intends Expand 400,000 video clips your signing librarywhich is equivalent to the representation of 1,000 words with signs. In addition, students of any level can contribute to the platform by adding specific words to help create an open source video data set for ASL and, thus, improve the teaching of this language.

Following this line, NVIDIA teams plan to use this data set for develop more AI applications that “break the communication barriers Among the deaf and listeners. ”

With this, the data may be used publicly as a resource to create accessible technologies, Including AI agents, digital applications and videoconference tools, according to the company.

On the other hand, although Signs currently focuses on the movements of the hands and fingers for each sign, the ASL language also uses facial expressions and head movements. In this regard, the Signs team “is exploring” how these non -manual signs “can be traced and integrate in future versions of the platform.”

Likewise, it is also working on the representation of other nuances, such as regional variations of language and jargon termsto enrich the ASL database.

With all this, it is expected that the SIGNS data set It is shared publicly to end of this year 2025. As for the platform, it is now available on its web version.

As stated in this regard, the executive director of the American society for deaf children, Cheri Dowling, “most deaf children are born from listening parents” and, therefore, offer family members “Accessible tools such as Signs” to start learning asl at an early age “It allows them to open a channel of Effective communication with children of only six or eight months of age. “