conda-forge: supporting the growth of the volunteer-driven, community-based packaging project
2022-08-31 , HS 118

The conda-forge project is one of the fastest growing Open Source communities out there – and most data scientists have probably heard of it. In this talk we explain the inner workings of conda-forge, its relationship to conda and PyPI, and we will explain how everyone can package software with conda-forge.


The conda-forge project offers binary packages for Linux, macOS and Windows. It has greatly simplified software distribution for millions of users. As a volunteer-run Open Source project with build instructions for a plethora of software packages that are most often used in the multidisciplinary community of scientific computing, conda-forge has seen an unprecedented growth, not the least because of the success of Python in that field.

In this talk we’ll take a look at the past, present and future of the project and showcase a number of projects in the overarching conda ecosystem that help with scaling conda-forge.

The talk will go into detail how the conda-forge project is maintained by volunteers and where collaboration between participating organizations is a key aspect of shaping its future.
We will also answer the question “Why not just use PyPI and the Python packaging stack?” and show how easy it is to create and submit packages to conda-forge.


Domains

General-purpose Python, Open Source Library

Expected audience expertise: Domain

none

Expected audience expertise: Python

none

Abstract as a tweet

How does the conda-forge packaging community work, what is its relationship to conda and PyPI and how can everyone package software with it?

Wolf studied robotics at ETH Zurich and Stanford University. After completion, he worked on many impactful Open Source projects: xtensor, xsimd, jupyter, jupyterlab and more. Most recently he initiated the mamba package manager alongside the boa and quetz projects and supports conda-forge as a core developer.

Wolf also started the RoboStack project to streamline the installation of robotic software on Windows, OS X and Linux, and pushed the intersection of data science and robotics by bringing Robotics to Project Jupyter.

This speaker also appears in:

Jannis Leidel, better known as "jezdez" in the Python community, has until recently been working at Mozilla as a staff software engineer on the Mozilla data platform team, maintaining part of Mozilla’s data infrastructure and tools and before that as a web developer on the Mozilla Developer Network (MDN) project that documents Open Web technologies. He now works on the conda team at Anaconda to help co-maintain the conda package manager.

As an avid contributor to Open Source projects, he's incredibly proud of the different communities he has become part of, whether it's the Python packaging ecosystem, the data science community, the Django project, the conda-forge project or the Jazzband collective. As director at the Python Software Foundation he works in the packaging working group, the finance committee and as co-communication chair.

Feel free to reach out to him via Twitter at @jezdez (DMs are open).

Jaime holds a PhD in Biotechnology and believes that packaging is one of the pillars for reproducible research. He became a conda enthusiast while working on molecular modelling frameworks and machine learning pipelines for drug design.