Neutron Mojo
Preview tensor, quantization, and transformer-inference libraries for the evolving Mojo toolchain.
Overview
- Status
- Preview; APIs may change with Mojo before 1.0
- Compute
- CPU-first SIMD tensor and inference paths
- Models
- GGUF and SafeTensors loading with several quantization formats
- Toolchain
- Tracks the current MAX nightly channel
A dedicated GPU backend and hardened HTTP serving runtime are not currently shipped.