Digital NZSL library to boost access for Deaf New Zealanders

The National Foundation for Deaf and Hard of Hearing is partnering with Kara Technologies to launch a digital New Zealand Sign Language library. This initiative aims to improve accessible communication for those in the Deaf and hard of hearing community across New Zealand.

Digital translation

The digital library will feature more than 10,000 signs in New Zealand Sign Language (NZSL). Kara Technologies, a New Zealand-based technology firm, will build the database using motion-capture technology. This process records a Deaf person signing each word or phrase, allowing the company to create digital avatars that sign messages.

Unlike some global sign language tools, this project focuses specifically on NZSL. English is the second language for many in the Deaf community, and tools designed for American or Australian Sign Languages do not recognise NZSL's unique grammar and vocabulary. This distinction has made other digital translation tools challenging to use effectively for New Zealanders.

Community inclusion

The foundation has committed to making the library inclusive by incorporating well-known te reo Māori concepts used by the community. This approach is intended to promote greater cohesion between all three of New Zealand's official languages: NZSL, te reo Māori, and English.

"This is a vital project for our community to have equitable access to crucial information," said Natasha Gallardo, Chief Executive, National Foundation for Deaf and Hard of Hearing.

According to Kara Technologies, an estimated 4,500 Deaf people rely on NZSL as their primary language. The foundation cites 2023 census data indicating that more than 24,500 New Zealanders use NZSL to communicate with family, friends, or colleagues who are Deaf.

Technology process

Kara's patented motion-capture system involves 12 infrared cameras that map body movements while a person signs, with 72 data points on the hands alone. Each recorded sign is reviewed by a Deaf person for accuracy and cultural suitability. The AI system assigns parameters to each clip, including possible actions and emotional context, to enable natural transitions when building sentences.

The resulting data set is designed for different applications. The system supports fully automatic AI translations for short announcements, such as travel disruptions or local emergencies. For more complex information, such as legal or medical content, the company aims to use a hybrid approach, where AI translates the core content and a human reviews it. The avatars can also be used as picture-in-picture overlays during video presentations.

Deaf community feedback

The National Foundation for Deaf and Hard of Hearing and Kara Technologies are encouraging members of the Deaf community to review and comment on three prototype avatars. Feedback is being sought on aspects such as translation quality, clarity, avatar facial expressions, and the naturalness of signing.

Personal impact

Arash Tayebi, founder and Chief Executive of Kara Technologies, developed the avatar concept after his own experience of hearing loss from Meniere's Disease. Kara Technologies' Communication and Deaf Culture Manager, Grace Covey, has played a key role in building the initial translations. She has a cochlear implant and two children who are profoundly Deaf.

"My two children are profoundly Deaf. When I think about their future, I think about how to improve the world for them and give them access that I didn't have, how to remove the barriers I faced," said Covey.

The digital NZSL library is expected to be operational early next year. The platform aims to make information more accessible across New Zealand's Deaf and hard of hearing communities.