Mones Raslan
Mones is a Senior Applied Scientist at Zalando, where he builds large-scale predictive models for pricing — which requires thinking about forecast evaluation from a business perspective. He holds a PhD from TU Berlin on foundational properties of neural networks.
Session
How do you evaluate performance when you predict more than 10 million time series each day? While a good plot can be worth more than a thousand metrics for a single time series, with large-scale machine learning models implemented with LightGBM and PyTorch we have to resort to meaningful aggregations. We will share insights and learnings from the past 2 years of deploying and operating our article-level demand forecasting models at the pricing department of Zalando.
This talk moves beyond basic metrics to showcase the pitfalls of aggregated error measures and the best practices we’ve developed to keep our stakeholders informed and our models accurate.