2024-08-15 –, Conference Auditorium (capacity 260)
Your own personal supercomputer? Within 15 minutes? Are you crazy?
I promise you that the answer is no. What if you could have a supercomputing system that ships with all the necessary components – storage, networking, identity, orchestration, and more – wherever you want it? And the system could easily be deployed on your laptop, home lab, or public/private/hybrid in a short amount of time? The barrier between general purpose cloud computing and traditional high-performance computing (HPC) is coming down with the increasing need for HPC systems to be capable of supporting complex, heterogeneous workloads, and the need for cloud systems to be more efficient for resource intensive tasks such as training large-language AI models on a massive, distributed datasets. Rather than painstakingly evaluating each cloud-based or on-premise HPC platform and the complementary tools offered by each vendor, what if you could just use a single, open source project that works both in the cloud and on-premises? And that project holds true to the straight-forward 15 minute deployment time promise? Well… there is such an open source project...
In this talk, you will learn about Charmed HPC, an open source HPC infrastructure stack being developed by the Ubuntu HPC community team. We will explore how all the services that compose Charmed HPC are integrated together using the Juju orchestration engine, and how common life-cycle events such as compute node registration and filesystem provisioning are automatically handled by Charmed HPC. You will also learn how Charmed HPC enables you to take control of where your supercomputing system is deployed and how you can leverage multiple cloud platforms such as OpenStack, LXD, GCP, AWS, or Azure... within 15 minutes!
At the end of the talk, we will demo a development preview of Charmed HPC showcasing the features we are actively developing. For example, we will demo the new CephFS storage provider and show Open OnDemand in action as the web-based user interface for our test cluster. Lastly, we will outline our current roadmap for Charmed HPC’s development - such as adding both an observability and identity + access management platform - and opportunities for how the open source community can get involved with the Ubuntu HPC community team.
Jason is a young professional in the HPC industry passionate about developing the next generation of lean, mean, open source supercomputing machines. By day, he works at Canonical as one of their resident HPC engineers working to make Ubuntu better for supercomputing, and by night he leads the Ubuntu HPC community team as one of its “Not so Ancient Elders.” He is focused on addressing current and future challenges facing the HPC industry such as the convergence of cloud and HPC systems, the impending end of Moore’s Law, and supporting research software engineer workflows. In his free time, he likes to work on several of his open source projects, organize open source community conferences such as the Ubuntu Summit or UbuCon @ SCaLE 21x, and travel to new places to teach others about open-source HPC and supercomputing. Recently he’s started learning the Crystal programming language out of personal interest for its potential applications in HPC environments. Why Crystal specifically? Well… after five years, he still hasn’t decided if he wants to write Rust or not.