Sophia Soliven
Sophie Soliven is the Director of Operations for Edamama. She has over 9 years of experience in e-commerce, fintech, and retail. Over the years, she has also been sharing her knowledge and experience in both the local and the international scene.
Sessions
These last few years, we’ve seen a significant increase in the number of Generative AI-powered applications being developed by organizations and professionals globally. Due to the number of possible variations available when building these types of systems, companies often struggle to identify and implement the most effective approach. After a few weeks of running their Gen AI application, they start to encounter issues and challenges related to performance, scalability, and cost management.
In this session, we will discuss various best practices and strategies when building, scaling, and optimizing Generative AI systems. We'll tackle various challenges that organizations experience after they have deployed their first version of the Gen AI application and we'll discuss multiple optimization strategies to reduce costs and improve the application's performance.
Despite the significant increase in the number of Generative AI-powered applications being developed by companies and professionals globally, many organizations are unable to secure their deployed applications properly. One of the practical techniques to secure Gen AI systems along with self-hosted LLMs involves building a vulnerability scanner that checks for vulnerabilities such as prompt injection. In this session, we will discuss how to build a custom scanner to help teams identify security issues specific to their self-hosted LLMs.