Communication between deaf patients and health professionals, who are not fluent in sign language, requires a human interpreter to translate the conversation. The Captar-Libras is a research and development project that seeks to facilitate communication between deaf people and health professionals without needing a human interpreter. This task is of great importance all over the world since there are millions of people in the world who use different variations of sign language to communicate. Therefore, Computer Vision, Artificial Intelligence, and Human-Computer Interface techniques are applied to develop a system capable of translating communication in both directions, focused on Brazilian Sign Language (Libras). As a result, the system will be able to convert videos of sign language speakers to text, as well as convert text to video in sign language, generating a photorealistic avatar that simulates a human interpreter.

 

Datasets


Captar-Libras Dataset

The dataset is still under construction. We show below a video and some images of the dataset setup.

Acknowledgment


This project is supported by Finep.

Technical Team



Thiago Luange Gomes

Researcher

Raphael Carmo Silva Nepomuceno

MsC Student

Paulo Henrique de Souza Coelho

MsC Student

Natalia Sales Santos

MsC Student

Maurício Ferrari Santos Corrêa

Technician

Ari Gonçalves da Silva Filho

Undergraduate Student

Bruno de Souza Lages

Undergraduate Student

Cauã Magalhães

Undergraduate Student

Maria Clara Ferreira

Undergraduate Student

Lucas Almeida Santos de Souza

Undergraduate Student

Brazilian Sign Language (Libras) Team




Elidéa Lúcia Almeida Bernardino

Associate Professor

Raniere Alislan Almeida Cordeiro

Associate Professor

Ana Kesia Gomes Lima

Libras Interpreter

Raiane Oliveira Gontijo Barros

Libras Interpreter

Pamela Alves Batista Caldeira

Libras Interpreter

Natália Najyme de Melo Afonso

Libras Interpreter

Ingrid Lorrayne Oliveira dos Reis

Libras Interpreter

Anne Rocha Marotta

Libras Interpreter

Rilberte Costa Ribeiro

Libras Interpreter

Daniésia Rocha dos Santos Lima

Libras Interpreter

Medical Team




Milena Soriano Marcolino

Medical Support

Luiza Marinho Motta Santa Rosa

Medical Support

Lucas Rocha Valle

Medical Support

Gabriela Teodora de Souza Sanches

Medical Support


Partners




Sebastião dos Santos Mesquita Junior

Entrepreneur Partner

Felipe Barros Silva

Entrepreneur Partner

Cleusangela Barros Meira Silva

Entrepreneur Partner

Former Members




Jéssica Luiza Ferreira Ramos

MsC Student

Diognei de Matos

Researcher

Vitor Andrade Almeida de Souza

PhD Student

Gabriel dos Santos Bezerra

Researcher-Developer

Eduarda Mendes Pinto Barbosa

Undergraduate Students

Ana Lucia Oliveira de Paula

Undergraduate Student

Lucca Fagundes Ramos de Oliveira

Medical Support

Felippe Veloso Marinho

Undergraduate Student

Lucas Almeida Amaral

Undergraduate Student