Using geojupyter community tools for earth data analysis and visualization at scale in the context of Snow Detection
This talk will present and demonstrate new Python and Jupyter ecosystems tools to analyse huge amount of satellite or more generally geospatial data. Our goal is to demonstrate that we are close to be able to propose a Google Earth Engine open alternative, that anyone may use and contribute to. It is thus aimed at developers or scientists in the geospatial data analysis field, and will be about technologies such as JupyterGIS, Xarray, Titiler and OpenEO. A full use case demonstration on Snow Detection will be showcased at the end of the talk.
Cloud-native technologies and standards are creating new possibilities for geospatial data analysis at global or multi temporal scales. Until recently, Google Earth Engine (GEE) was the only practical solution for scientists wanting to test algorithms at scale and visualize results quickly. With the advancement of the geospatial and Python ecosystems supported by the Pangeo, CNG, and OGC communities, we've seen open-source tools and standards -- including Jupyter, Xarray, Dask, cloud-optimized formats, STAC, and OpenEO -- closing the gap with GEE. Still, there is a shortage of easy-to-use interactive visualization tools for working with modern datacubes and data streams enabled by these new developments.
In this talk, we will present specific work from the GeoJupyter community, based on JupyterGIS for the frontend and TiTiler for the backend, to enable interactive computation at scale.
We'll first give the big picture: the challenge of working with and vizualising the Peta scale datasets in an open and standard way, and how we are closer to building an open source alternative to GEE.
We'll then dive into tools under active developement such as JupyterGIS and Titiler, show casing their functionnalities and roadmaps. Addtionally, we will show the ease of deployment of JupyterGIS by making use of tools like JupyterLite and Notebook.link.
We'll then demonstrate a CNES (French space agency) use case for snow detection over the Pyrenees mountains. It shows how these technologies can interactively display the results of a computation performed on-the-fly on geospatial data streamed from cloud-optimized and open Sentinel-2 data.
We'll compare alternative methods, including:
- Using OpenEO as the data source, which enables reproducible visualization by serializing a processing graph inside a GIS document.
- Using full Xarray syntax with jupyter-tiler, powered by TiTiler, which enables visualizing a datacube with custom computations.
Software research engineer at CNES since 2016, I've worked in satellite ground segment development and related projects for about 20 years. I've specialized myself in big data processing, deploying and using Hadoop and Spark for scientific data processing first in 2012. I then joined the CNES computing center team and helped users develop processing chains at scale using Dask or Slurm. At this time, I became a member of Pangeo community and contributed to deploy Dask enabled Jupyterhub for huge geospatial data analysis. I'm working now in the Data Campus division at CNES, where I maintain a snow detection tool and I also try to help improving the Python ecosystem around satellite raster processing (Xarray related projects like EOReader) and visualization.
Martin Renou is a Technical Director at QuantStack. Prior to joining QuantStack, Martin also worked as a Software Developer at Enthought. He studied at the French Aerospace Engineering School ISAE-Supaero, with a major in autonomous systems and programming.
As an open-source developer, Martin has worked on a variety of projects, such as ipygany (a 3-D mesh visualization library for the Jupyter Notebook) and ipympl (an interactive Matplotlib backend for Jupyter)
Passionate about 3-D rendering and computer graphics, Martin has also developed a 3-D Chess GUI based on OpenGL, and an interactive canvas library during his spare time.
Martin is the main author of xeus-python, he worked on xtensor and xsimd, and is now working on Jupyter interactive widgets.
🥇 Jupyter Distinguished Contributor