07-28, 13:40–13:50 (UTC), Blue
An introduction to the Transformers.jl and relative packages for building transformer models.
I would talk about the new API design in Transformers.jl, from the new text encoder that build on top of TextEncoderBase.jl, to the new model implementation that build on top of NeuralAttentionlib.jl and the new pretrain model management API based on HuggingFaceApi.jl.
A graduate student working on deep learning and natural language processing.