A .NET inference engine for local GGUF models offering a CLI, browser chat and Ollama/OpenAI-compatible APIs with CPU, CUDA, Metal and Vulkan backends.
679gemma,inference,inference-engineA .NET inference engine for local GGUF models offering a CLI, browser chat and Ollama/OpenAI-compatible APIs with CPU, CUDA, Metal and Vulkan backends.