PyCon UK 2023

SIGN-TO-TEXT:Unleashing the Power of Google AI for real time ASL transcription
09-24, 11:30–12:00 (Europe/London), Assembly Room

In this talk, we will delve into how leveraging Google's cutting-edge tools and frameworks, combined with Python, can revolutionize the way we bridge the communication gap between sign language users and the wider world.


Communication barriers between the deaf and hard-of-hearing community and the wider world have created significant challenges in effective interaction.However the good news is cutting-edge AI technologies can revolutionize the way we transcribe American Sign Language (ASL) and enable inclusive communication.

Using the power of Python libraries and Google's AI tools, including the Google Cloud Vision API for hand and finger tracking, TensorFlow for deep learning models, and AutoML for data scarcity challenges, I will demonstrate Sign_To_Text, a revolutionary system that transforms how sign language users connect with the world.

Witness live demonstrations as I seamlessly integrate Google AI technologies to translate fingerspelled letters in real time into textual representations, empowering individuals and fostering inclusive communication.


Is your proposal suitable for beginners? – yes

Vivian Ouma is a backend developer at USAID HealthIT project where she is responsible for developing the business logic,data pipelines and machine learning models.She is a computer science graduate and holds a number of certifications in data science ,solutions architect and DevOPs. She is also passionate about open source contributions and mentorships and works with organizations such as technovation and safaricom’s Women In Tech to initiate more ladies into tech.