2024-10-26 –, CLASS #4
Language: English
In this talk, I will explore the cutting-edge technology of Multimodal Retrieval Augmented Generation (MRAG) using Python. This innovative approach combines the power of natural language processing, computer vision, and machine learning to enhance the generation of text and images based on complex queries. We'll elaborate into how MRAG leverages large language models and retrieval systems to provide contextually rich and accurate outputs.
The session will cover:
- An introduction to MRAG and its applications
- Key components and architecture of MRAG systems
- How Python libraries and frameworks can be utilized to implement MRAG
- Real-world examples and use cases demonstrating the effectiveness of MRAG
- Live demo to build a basic MRAG system
- Best practices and challenges in deploying MRAG in production environments
By the end of this talk, attendees will have a solid understanding of how to harness the power of MRAG for enhanced text and image generation, providing richer and more relevant results in various applications.
Esther is an Associate Professor with more than ten years of research in Natural Language Processing, Machine Learning, Social Network/Media Analysis, and professional work experience in the computer software industry and machine learning. She is the Head of the Department of the Diploma of Information Systems and Bachelor of Professional Informatics Program at Institut Sains dan Teknologi Terpadu Surabaya (ISTTS).
Since 2023, Esther has been selected as a Google Developer Expert in Machine Learning. Her involvement began as the founder of Google Developer Group (GDG) Surabaya. And now, she is the GDG Surabaya organizer. She is also a Cloud Champion Innovator in AI / ML and one of the Google Dev Library Contributors. As an Associate Professor and Women Ambassador IEEE IES, Esther has over a decade of experience in community contributions and machine learning.
Esther has created projects in Machine Learning since 2006, mainly on Natural Language Processing and some in Computer Vision, and has published numerous papers in IEEE. She is also affiliated with several other professional groups, a volunteer of the Directorate of Research, Development, and Innovation at IAIS (Indonesia Artificial Intelligence Society), and a member of various machine learning organizations such as IEEE IES, Women in Engineering, IEEE ISTTS Student Branch Chancellor, Indonesian Association for Pattern Recognition, and Indonesia Association of Computational Linguistics. Recently, she's been selected as a Woman Ambassador for IEEE IES 2024. She’s also a partner researcher at the Science and Technology Center of Excellence, Institut Teknologi Sepuluh Nopember, and the School of Media Sciences, Tokyo University of Technology. She has hosted and participated in numerous national and international tech talks.