David Venable
David is a senior software engineer working on observability in OpenSearch at Amazon Web Services. He is a maintainer on the Data Prepper project. Prior to working at Amazon, he was the CTO at Allogy Interactive - a start-up creating mobile-learning solutions for healthcare.
Sessions
We will discuss how you can use Data Prepper pipelines to improve ingestion into OpenSearch. We will focus on some of its features to persistent data during failures. We will also share suggestions to improve the performance of ingestion into your OpenSearch cluster.
Besides providing an overview of Data Prepper, this session will focus on how an observability solution from SAP utilizes Data Prepper and OpenSearch to enable the ingestion and analysis of OpenTelemetry data. Included are operational challenges we faced as well as our performance test results.