2023-10-28 –, track 1
Streaming data processing is a type of data processing that deals wit continuously generated data and cannot be processed in its entirety. Streaming data processing is a challenging problem because it requires algorithms that can process data quickly and efficiently. In this talk, the speaker will share how to create streaming data pipelines easily by using Python libraries like Apache Beam.
Streaming data processing is a type of data processing that deals with data that is continuously generated and cannot be stored in its entirety. This type of data is often generated by sensors, machines, and other devices that collect data in real time. Streaming data processing is a challenging problem because it requires algorithms that can process data quickly and efficiently, while also being able to handle changes in the data stream.
In this talk, the speaker will start with an introduction to streaming data processing, including the different types of streaming data and the challenges of processing streaming data. After that, the speaker will discuss Python libraries for streaming data processing, such as Apache Beam, and how it helps solve the issue. The speaker will also highlight a case study of streaming data processing, such as real-time fraud detection. Finally, the session will end with answering audience questions.
After this talk, the audience will be able to:
- Understand the basics of streaming data processing
- Understand the characteristics and challenges of streaming data
- Use Python libraries for streaming data processing
- Apply streaming data processing to real-world problems
Thu Ya Kyaw is a Senior Developer Relations Engineer for Google Cloud. At Google, he helps to make learning, developing, deploying, and scaling applications on Google Cloud a delightful experience for everyone. He is also a curious person who enjoys sci-fi, fantasy, and documentaries. He is fascinated by the unknown and the possibilities of other worlds. He often wonders if aliens built the pyramids, or if we live in a simulated world.