REAL TIME SIGN LANGUAGE TRANSLATOR

[Mohd-zia5beye7d]

This software would use artificial intelligence (AI) to translate sign language into text and vice versa, enabling real-time communication between mute and deaf individuals and those who do not know sign language.

I AM GOING TO BUILD 2 PROJECTS FOR MUTE DEAF AND BLIND PERSON.IF ANY ONE WANTS TO COLLABORATE PLEASE MAIL ME ON (PII Removed by Staff)

PROJECT NO 1:REAL TIME SIGN LANGUAGE MODULE

PROJECT NO2:IDE FOR BLIND PEPOLE

[QASIMALOUDAT]

Translations AI

[Mohd-zia5beye7d]

Yess it will be a translating software which will use ai to translate sign language to text and vice versa.it will help mute and deaf people.I trying to make it free and open-source so people who need it can get it free. My goal is to improve the life of people.and I believe that this software will help many people who are struggle daily.As many people don't know sign language.if you want to join the project pls contact me.

Thank you

Regards md zia

[QASIMALOUDAT]

مرحبا دكتور ضياء

اعلم ان مشروعك جميل جدا وهو يخدم  نوعيه من الناس الذين هم بحاجه الى رعايه وأرغب بالعمل هذا

شكرا لك

[JuanRodriguez]

Greetings, from the Universidad del Valle in Colobia we are carrying out a similar solution, so it would be interesting to exchange knowledge and even see the possibility of collaboration.

[Mohd-zia5beye7d]

Hello

I am excited to hear about your similar work at the Universidad del Valle. Exchanging knowledge and exploring collaboration possibilities sounds fantastic!".

[JuanRodriguez]

To summarize our progress, we have managed to model sign language, based on the morphological study carried out by several authors, where the morphological units are separated into simpler units, in order to classify and identify each sign individually.

With this previous study, it was proposed to design a convolutional model to extract these qualities from sign language and obtain a general pattern or footprint for each sign, in order to model the language with recurrent neural structures or Transformers.

Although our proposals could be sufficient, efficient and accurate, we have limitations for training the models due to the lack of computational power.

So it would be interesting to know what you have achieved and how you have solved the possible problems that have arisen.

[Mohd-zia5beye7d]

Hi Juan,

I'm writing a breif not on you on the progress of the real-time translation module and propose a meeting to discuss further advancements, particularly leveraging the potential of Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs).

As you know, I've utilized a hybrid neural network trained on a large dataset. This initial approach involved dividing each sign into smaller parts for analysis, and while it has shown promise, I'm always looking for ways to improve.

While the current model demonstrates potential, accuracy remains a crucial area for improvement. This is where exploring the strengths of CNNs and RNNs comes in

As I am always trying to improve the model.I have decided to redesign and develop system from Beginning.

I think we should have a meeting. If you want to join the project please feel free to Mail me and Tell me your preferred time where we can schedule the meeting .

Thanks 

Mohd Zia

[JuanRodriguez]

Greetings, sorry for the delay. I update you on the progress of these last few months. Efforts were devoted to a semiotic analysis of sign language to identify the key parameters of sign language and begin to propose a model design, based on the linguistic understanding of sign language.

The results have shown that it is necessary to measure more than one characteristic of CNN networks, to identify the spatiotemporal components and short- and long-term memory mechanisms.

Drawbacks were also identified due to the dimensional burden caused by this combination. Therefore, a large part of our efforts are dedicated to the implementation of a recurrent convolutional neural network. in order to achieve a new implementation of spatiotemporal convolutional networks.

To evaluate this proposal, we are proposing a classification tool to assist in sign language learning. A kind of interactive dictionary.

[pmoparthi]

Hello - Anything happening or progressed on these projects? I'm particularly interested in sign language translator project, of course, I can contribute towards other project too. I don't have much technical background other I have general programming experience and general understanding of AI and Gen AI. Not sure how and where I can help, but willing to.

[Mohd-zia5beye7d]

Hi Pmoparthi,

I'm excited to hear you're interested in contributing to the sign language translator project!.I can assure you that progress is being made and data collection and system design are crucial stages.

Given your general programming experience and understanding of AI, there are definitely ways you can contribute, even without deep technical expertise. Here are some possibilities:

Data Collection:

• Help recruit participants for data collection sessions, especially within specific demographics or sign language variations.
• Assist with organizing and labeling collected data (e.g., video recordings, sign annotations).
• Develop tools to streamline data collection and labeling processes.

System Design:

• Provide feedback on user interface and user experience (UI/UX) designs for the translator tool.
• Help brainstorm ideas for features and functionalities that would be beneficial for users.
• Research and summarize existing sign language translation projects and their approaches.

Thank you😊

[Neeraj888]

Thank you for working on this project. My sister-in-law is deaf and I wish to involve her more when we have family get togethers.  I’ve been trying to find an app that can be on everyone’s phone and translate what they are saying showing the name to her of who’s speaking. This would be many to many translation vs one to one. 
I’m not a programmer but would be happy to help if I can in some other way. 

[Mohd-zia5beye7d]

Hello Neeraj. It's my pleasure to work on such project. It will be a free and open source project. I am glad that you want to help. You can help me with data collection. please mail me on <PII removed by staff>

---

@Neeraj888 wrote:

Thank you for working on this project. My sister-in-law is deaf and I wish to involve her more when we have family get togethers.  I’ve been trying to find an app that can be on everyone’s phone and translate what they are saying showing the name to her of who’s speaking. This would be many to many translation vs one to one. 
I’m not a programmer but would be happy to help if I can in some other way. 

---

---

[NifengJack]

How's your realtime translator going, I am in need of this

[Mohd-zia5beye7d]

Till now it's going fine.It will take some time to be fully developed Because i don't have any teams I am developing it alone.and I have to also prepare for exams and other there are also other issues.But I will try my best to complete this project asap.

Thank you.

[NifengJack]

Do you have a demo for it now or can I become your participant in this project? I'm from New York University and I'm working on a project about how AI technology can be improved to help the deaf. I'm in need of your demo and I want to do an interview with the deaf and the organizer of the deaf community to complete my project as well as provide insights for your work. Additionally, could you please leave me your email if possible? Thank you so much!

[nimrah-waqar]

Those are fantastic projects with meaningful impact! Implementing a real-time sign language translation module and an IDE tailored for blind individuals could greatly improve accessibility and communication. Collaboration on such initiatives could lead to innovative solutions that benefit many people. Good luck with your projects!

[Mohd-zia5beye7d]

Hello nimrah!.

Your kind words are truly appreciated! There is a lot of potential in these projects to improve general access and communication. Your acknowledgment that the potential of each of them is huge serves only to increase my zeal and resilience in seeing them through. I am very hopeful about the revolutionary prospects on the way, looking at it from such a perspective. Thanks for your support!

[NifengJack]

Any one still here working for this project? Do you have a demo for it now or can I become your participant in this project? I'm from New York University and I'm working on a project about how AI technology can be improved to help the deaf. I'm in need of your demo and I want to do an interview with the deaf and the organizer of the deaf community to complete my project as well as provide insights for your work. Additionally, could you please leave me your email if possible? Thank you so much!

[Mohd-zia5beye7d]

Hello.

I am still working on this project.i am developing it alone so it will take some time. Unfortunately no demo is avialable right now.I will try to finish this project by the end of 2024.Can you please provide your email I will love to contact you and if you have any other social media handle i would love to contact you.  It will be free and open-source so that everyone can access this tool

[NifengJack]

Ok, my email adress is <PII removed by staff>, by the way, can you leave me yours email address? Thank you

[Gusur]

Hey. 
How are things going with this. Do you know when it will be anything to show or test ? 

[JuanRodriguez]

Greetings, from the Universidad del Valle, in Colombia. We are working on a similar proposal, which we approach from the linguistic understanding of the second articulatory component of sign language. Results that have led us to rethink how RNN networks are built and how to modify them for vision problems simply using CNN units.

At this moment we are evaluating this new atarabes proposal for the classification of sign language, for the design of an interactive dictionary to facilitate the learning of sign language.

[nitikab23]

I am interested in this project. Would love to collaborate together. 

[Mohd-zia5beye7d]

Hello I am extremely sorry for late reply. If you are really interested in collaborating please contact me at "(PII Removed by Staff)"

[JasperTY2020]

Hello! I’m interested in this project. I can be your human tester if you still need one? I’m deaf, my signs is from eastern Pennsylvania (there is local sign, like how there’s many spoken languages. There’s many signs, depending.)

[Mohd-zia5beye7d]

Certainly! Thank you for volunteering to be our human tester. Your willingness to contribute is greatly appreciated. Once the project is completed, we will reach out to you, and you can contact me at <PII removed by staff>. If you have any further questions or need assistance, feel free to ask. 😊

[Ayush82nwi2]

Hey! I've just seen your this post for contribution of open source. And completely amazed by everyone's effort. Pls let me know if i can also help. And is this project on github? And how can i see that. Thanks

[Mohd-zia5beye7d]

Thank you so much for your interest and enthusiasm! Currently, this project isn't on GitHub, but I'm planning to upload it by the end of 2024 or in January 2025, depending on how things progress. I appreciate your willingness to contribute, and I'll keep you updated as things move forward. Thanks again for your attention to this project!

[Ayush82nwi2]

Thanks for your response, We'll I request you if possible can you share this project with me, I am preparing for the Hackthon organised by government of India for students known as Smart India hackthon. in this if they like this project then they'll apply it on a large basis. which is extremely helpful for the Community. and be able to use for as many people as required. Thanks in advance

[shahid-rm-9625]

Hi this is Shahid R.M from Walchand College of Engineering and I am working on a similar idea in smart educational field which is going to shown in the SMART INDIA HACKATHON. Can u please share the project details with me so that we can get the idea of how it works and we can use it in our project

[QASIMALOUDAT]

نعم  سمارت انديا داخل في الهاكثون

اشكرك

[jessarinana]

I am interested in learning about this project.