PyCon Hong Kong 2024

PyCon Hong Kong 2024

Enhancing Web Image Accessibility for Visually Impaired Individuals with Gemini Pro Vision and Google Cloud Platform
2024-11-16 , LT7
Language: 漢語

Background

The inability of visually impaired individuals access image information due to the lack of adherence to W3C web accessibility initiatives by websites. Currently, about 60% of websites lack meaningful alternate text for their images. Moreover, it is unfeasible to retroactively add descriptive text to all existing websites manually.


GeProVis AI Screen Reader

GeProVis is an abbreviated term for Gemini Pro Vision, and my students have significantly enhanced the conventional Google ChromeVox Screen Reader by incorporating the robust capabilities of Google Gemini Pro Vision. This blog post will focus on the details of Google Cloud Platform (GCP). In brief, ChromeVox can extract the image source url and send it to GCP.

In this talk, we will explain the technical details of the Python Google Cloud Function in this project.

Tech Blog

https://medium.com/google-developer-experts/enhancing-web-image-accessibility-for-visually-impaired-individuals-with-gemini-pro-vision-and-07190b97fc38

Story

https://medium.com/google-developer-experts/hkiit-students-use-gemini-pro-vision-to-develop-ai-screen-reader-acace2a0f830

Hong Kong Google Cloud Summit 2024 GeProVis AI Screen Reader MD and GM, Google Hong Kong Michael Yue
https://youtu.be/VqSYB62xrz8

Awards

  • City I&T Grand Challenge 2024 - Innovation Award
  • Google GDSC 2024 Solution Challenge Global Top 100

Speakers:

Cyrus Wong - AWS ML Hero + Microsoft MVP - Azure AI + Google Developer Experts - GCP & AI/ML(GenAI)
https://www.linkedin.com/in/cyruswong/

Hin Pak Markus Tsang (曾憲柏) - HKIIT 雲端系統及數據中心管理高級文憑課程
https://www.linkedin.com/in/hin-pak-markus-tsang-%E6%9B%BE%E6%86%B2%E6%9F%8F-327949b8/

Kelvin Yiu - AWS Cloud Club Captain & HKIIT 雲端系統及數據中心管理高級文憑課程
https://www.linkedin.com/in/kelvin-yiu-9a25b1290/

黃俊彥是香港香港資訊科技學院(HKIIT)位於 IVE(李惠利)資訊科技系雲端系統及數據中心管理高級文憑的高級講師,擁有豐富的知識和專業技能。他熱衷於在各種媒體和活動中推廣雲端技術。由於他的專業知識和專業技能,他獲得亞馬遜雲端運算服務機器學習英雄、微軟Azure AI最有價值專家和Google雲端平台& AI/ML (GenAI)的Google開發者專家等著名榮譽稱號,是世上唯一能夠獲得IT業界三巨頭同時公認的專家。
Cyrus Wong is an accomplished senior lecturer who oversees the Higher Diploma program in Cloud and Data Centre Administration at the Hong Kong Institute of Information Technology (HKIIT) at IVE(Lee Wai Lee) in Hong Kong. He is a passionate advocate for the adoption of cloud technology across various media and events. With his extensive knowledge and expertise, he has earned prestigious recognitions such as AWS Machine Learning Hero, Microsoft MVP - Azure AI, and Google Developer Expert for Google Cloud Platform & AI/ML (GenAI).

Student studying cloud and data centre administration @HKIIT -IVE(LWL)

I am a tech enthusiast with hands-on experience in developing with Python and Golang, working on several cloud projects. Furthermore, I have a cybersecurity background and led a team to participate in numerous public cybersecurity competitions in Hong Kong during my high school studies.