ninfer

High-performance single-GPU inference for selected model checkpoints and GPUs.