NInfer is a native C++/CUDA inference engine for selected models on RTX 5090 and DGX Spark, serving text and multimodal generation through a CLI and compatible HTTP APIs.
3345NInfer is a native C++/CUDA inference engine for selected models on RTX 5090 and DGX Spark, serving text and multimodal generation through a CLI and compatible HTTP APIs.