Mandes Schönherr
Dr. Mandes Schönherr is a data engineering specialist with years of experience in designing and implementing modern data solutions in various cloud environments. Originally from Germany, now based in Bern, he works as a cloud expert and architect at ELCA, one of Switzerland’s largest and most respected IT consulting company. With a strong background in high-performance computing as an application developer, analyst and performance optimization consultant, he holds a PhD in natural sciences, focusing on computational physics and chemistry. Dr. Mandes Schönherr combines deep technical expertise with hands-on experience across cloud platforms, data architecture, and advanced analytics to deliver robust, scalable solutions for clients in diverse industries.
Session
This interactive workshop introduces participants to Smart Data Lake Builder (SDLB), an open-source, metadata-driven Scala/Spark framework designed to help Data Engineers efficiently define, orchestrate, and optimize complex data pipelines. Through a combination of theory and hands-on exercises, attendees will learn how to design multi-layered data lake architectures, define data objects, actions, and connections, and implement transformations using SQL, Scala, or Python—all within a metadata-driven, configuration-first approach.
Participants will get practical experience by building a real-world data pipeline, leveraging SDLB’s features such as automated DAG generation, fail-fast and checkpoint/restart mechanisms, schema validation, data quality enforcement, and performance optimizations like partitioning and parallelization.