Highlights:

• mx.fast subpackage
• Custommx.fast.rope up to20x faster

Core

• Support metadata withsafetensors
• Up to 5x faster scatter and 30% faster gather
• 40% fasterbfloat16 quantizated matrix-vector multiplies
• mx.fast subpackage with a fast RoPE
• Context managermx.stream to set the default device

NN

• Average and Max pooling layers for 1D and 2D inputs

Optimizers

• Support schedulers for e.g. learning rates
• A few basic schedulers:
  • optimizers.step_decay
  • optimizers.cosine_decay
  • opimtizers.exponential_decay

Bugfixes

• Fix bug in remainder with negative numerators and integers
• Fix bug with slicing into softmax
• Fix quantized matmuls with non 32 multiples