koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.