Enhance Query Execution Visibility in OS with OpenTelemetry
2024-05-06 , Moskau

Explore Observability's core components: metrics, logs, traces with OpenTelemetry in Query Engine. Learn OpenTelemetry concepts and architecture. See how it enables comprehensive metric and trace collection, enhancing visibility into query execution for OpenSearch users.


OpenSearch users and business today seek for visibility and insights into execution of their queries. Due to the multi-phase and distributed nature of these queries, pinpointing resource utilization and time consumption, as well as identifying bottlenecks, becomes exceedingly complex.

Observability is the cornerstone of modern system monitoring and troubleshooting. In this session, we elucidate the pivotal role of observability in enhancing system reliability and performance. Delve into the three pillars of observability – Metrics, Logs, and Traces – gaining invaluable insights through real-world examples and use cases.

Embark on a journey through OpenTelemetry, the cutting-edge observability framework revolutionizing the landscape of monitoring and diagnostics. Understand the necessity of OpenTelemetry in modern distributed systems, unraveling its key concepts such as context propagation, signals, and instrumentations. Explore the robust architecture of OpenTelemetry and its seamless integration with OpenSearch components, paving the way for comprehensive end-to-end observability solutions.

Witness firsthand the practical application of OpenTelemetry within OpenSearch. Through insightful examples and code walkthroughs, learn how OpenTelemetry facilitates the effortless export of metrics and traces, offering unparalleled visibility into your OpenSearch clusters. Gain proficiency in leveraging OpenTelemetry to capture span and trace data, empowering you with actionable insights for optimizing system performance and reliability.

Key Takeaways:
This session is indispensable for Opensearch developers keen on augmenting their applications with robust metric and trace capabilities. OpenSearch users will gain invaluable insights into harnessing OpenTelemetry for exporting metrics and uncovering deeper insights into their clusters. By the end of the session, attendees will possess a comprehensive understanding of observability principles and the transformative potential of OpenTelemetry in driving actionable insights and enhancing system reliability.

I am a Senior Software Engineer in the AWS OpenSearch Core Search team. I am passionate about creating products and platforms from scratch and scaling them to handle extremely high volumes of data. In my free time I enjoy reading, playing pickleball and exploring new destinations.