WhimRead needs JavaScript for on-site search.
Whim
Read
browse at whim
Discover
All tools
Picks
Surprise
About
Search
中文
Agent infrastructure
omlx
jundot/omlx
A macOS LLM inference server with batched serving and SSD caching for local AI agents.
View on GitHub
Copy link
Topics
apple-silicon
inference-server
llm
macos
mlx
openai-api
Related projects
apfel
6.6k
A Mac CLI and local OpenAI-compatible server exposing Apple Foundation Models for on-device inference and tool calling.
Rapid-MLX
4.2k
Rapid-MLX is an OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX. It offers fast local serving with tool calling, vision, continuous batching, and one-command setup for coding agents.
mlx-serve
2.5k
A native local LLM inference server and macOS app for Apple Silicon. It speaks OpenAI, Anthropic, and Ollama APIs and adds chat, coding agents, image, video, speech, and 3D generation.
VoxtMini
890
VoxtMini is a macOS voice-input app that runs local speech and language models: press a shortcut, speak, and transcribed, translated or rewritten text appears at your cursor.
magpie
36.9k
A local gateway and menu-bar app that lets any coding agent use any model or subscription, with unified provider management, failover, profiles and privacy masking.
inference
9.7k
A unified model-serving library to deploy LLMs and multimodal models locally or in the cloud via OpenAI-compatible API.
23603
apple-silicon,inference-server,llm
A macOS LLM inference server with batched serving and SSD caching for local AI agents.
←
Previous
marimo
Next
→
saleor