A lightweight block-diffusion draft model for speculative decoding, shipped with checkpoints and tooling that plugs into Transformers, MLX, SGLang and vLLM to speed up LLM generation.
6238A lightweight block-diffusion draft model for speculative decoding, shipped with checkpoints and tooling that plugs into Transformers, MLX, SGLang and vLLM to speed up LLM generation.