An open-source LLM inference engine tuned for AMD consumer hardware, with speculative decoding, long-context tricks and OpenAI/Anthropic-compatible APIs that coding agents can connect to.
3007kernel,llama-cpp,local-aiAn open-source LLM inference engine tuned for AMD consumer hardware, with speculative decoding, long-context tricks and OpenAI/Anthropic-compatible APIs that coding agents can connect to.