BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//pretalx//pretalx.com//pydata-amsterdam2026//speaker//XTWLRY
BEGIN:VTIMEZONE
TZID:CET
BEGIN:STANDARD
DTSTART:20001029T040000
RRULE:FREQ=YEARLY;BYDAY=-1SU;BYMONTH=10
TZNAME:CET
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
END:STANDARD
BEGIN:DAYLIGHT
DTSTART:20000326T030000
RRULE:FREQ=YEARLY;BYDAY=-1SU;BYMONTH=3
TZNAME:CEST
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
END:DAYLIGHT
END:VTIMEZONE
BEGIN:VEVENT
UID:pretalx-pydata-amsterdam2026-YMKPBU@pretalx.com
DTSTART;TZID=CET:20260911T115000
DTEND;TZID=CET:20260911T122000
DESCRIPTION:As data volumes grow exponentially\, data engineering teams fac
 e a critical dilemma: hardware costs steadily escalate\, yet migrating to 
 a more performant system often demands a prohibitively expensive rewrite o
 f existing workloads. How can organizations achieve orders-of-magnitude im
 provements in performance and drastic cloud cost reductions without touchi
 ng a single line of their legacy Apache Spark code?\n\nThis talk explores 
 the cutting-edge landscape of Spark modernization. We will evaluate two pr
 imary drop-in replacement strategies: Spark accelerators that inject highl
 y optimized physical operators via plugins\, and alternative server implem
 entations that leverage the Spark Connect protocol to bypass JVM inefficie
 ncies entirely. Attendees will look under the hood to see how modern techn
 ologies\, specifically the Rust programming language and the Apache Arrow 
 in-memory format\, power these massive performance leaps.\n\nFurthermore\,
  we will showcase a case study on running Python workloads (UDFs and custo
 m data sources) at unprecedented speeds within the Spark ecosystem\, demon
 strating how Rust and PyO3 can successfully eliminate the historical frict
 ion between Python and the JVM. \nThis talk is designed for data engineers
 \, ML engineers\, and data scientists handling intensive ETL or OLAP workl
 oads. The talk delivers actionable insights to bring modern\, high-perform
 ance data system innovations into production.
DTSTAMP:20260710T150459Z
LOCATION:Room 2 (350)
SUMMARY:Modernizing Spark: Performance Boost without Rewrite - Shehab Amin\
 , Santosh Pingale
URL:https://pretalx.com/pydata-amsterdam2026/talk/YMKPBU/
END:VEVENT
END:VCALENDAR