Representing Small Floats for Machine Learning
The IEEE has a working group drafting a standard for Floating-point Arithmetic Formats in Machine Learning. This talk explains one approach to implementing these multi-format microfloat representations. The presentation covers specific implementation approaches adopted and design advantages found with Julia.