中文

Agent infrastructure

451 projects · page 1 / 5

1-100 of 451
Project
Added
Created
Stars
01
cc-switchai-toolsclaude-codedesktop-app
A cross-platform desktop manager for coding agents that switches API providers and centralizes MCP, skills, and prompts.farion1231
2026-06-26
2025-08-04
155.2k stars
02
OmniRoutea2aai-agentsai-gateway
A free MIT AI gateway that exposes hundreds of providers and models through one OpenAI-compatible endpoint, with quota-aware fallback, token compression, routing strategies and MCP/A2A support.cheaper-inference
2026-10-21
2026-02-13
89.4k stars
03
OmniRoutea2aai-agentsai-gateway
A free self-hosted AI gateway that routes one OpenAI-compatible endpoint across hundreds of providers with fallback and compression.diegosouzapw
2026-06-24
2026-02-13
88.6k stars
04
dsh-our-free-modelai-agentsdeepseekdeepseek-harness
A DeepSeek Harness plugin that adds free and bring-your-own-key model providers, a local OpenAI/Anthropic-compatible gateway, routing, usage dashboards, and token compression.Ebony-Vinyl
2026-10-05
2026-09-24
74.2k stars
05
dsh-our-free-modelai-agentsdeepseekdeepseek-harness
This DeepSeek Harness plugin adds free, no-key access to several upstream model pools and exposes a local OpenAI/Anthropic-compatible gateway. It includes fallback routing, usage dashboards, token-saving compression and in-app updates.zouyuxuan122
2026-09-30
2026-09-24
72.7k stars
06
free-claude-code
Local proxy gateway letting eleven coding agents share sixty-plus providers with fallback routing, token optimization, cost tracking and admin UI.alishahryar1
2026-06-26
2026-01-28
72.2k stars
07
t3code
T3 Code is a remote control surface for the coding agents already installed on your machine, letting you drive Claude Code, Codex, Cursor and others from mobile, web or desktop.pingdotgg
2026-07-26
2026-02-08
66.2k stars
08
freellmapi
A self-hosted LLM gateway that unifies dozens of free-tier providers behind one OpenAI-compatible endpoint with routing.tashfeenahmed
2026-06-26
2026-04-21
54.6k stars
09
herdragentagent-orchestrationai
A terminal multiplexer built for coding agents with persistent sessions, multi-machine views, and agent status tracking.ogulcancelik
2026-06-26
2026-03-27
51.9k stars
10
herdragentagent-orchestrationai
A terminal runtime and workspace manager for coding agents, keeping sessions alive across detaches, organizing multiple machines, and exposing panes to agents through a CLI and socket API.herdrdev
2026-07-30
2026-03-27
51.4k stars
11
LocalAIllamaaillm
An open-source engine to run LLMs, vision, and audio models locally with OpenAI-compatible APIs.mudler
2026-06-26
2023-03-18
50.5k stars
12
colibri
A pure-C inference engine that runs giant mixture-of-experts models on everyday hardware by streaming experts from disk with OpenAI-compatible serving.justvugg
2026-07-10
2026-07-01
50.3k stars
13
iFixAiaidiagnostic-toolagent-evaluation
An independent auditing tool for AI agents that simulates realistic business requests and grades responses, surfacing misalignment, privilege abuse, prompt injection, and other risks in a scored report.ifixai-ai
2026-07-24
2026-04-27
46.2k stars
14
sub2api2apiantigravity2apiclaude
A self-hosted AI API gateway that pools subscription quotas and exposes them as managed API keys with billing and routing.wei-shaw
2026-06-26
2025-12-18
46.2k stars
15
airllmchinese-nlpfinetunegenerative-ai
A Python inference engine that streams huge language models layer by layer to run 70B to 671B models on small GPUs.lyogavin
2026-06-24
2023-06-12
42.3k stars
16
posthoganalyticspythonreact
An open-source product analytics and observability platform with funnels, replays, flags, experiments, errors, logs, and AI tracing.PostHog
2026-06-26
2020-01-23
40.8k stars
17
sglangcudainferencellama
A fast open-source inference framework for serving large language and multimodal models at scale.sgl-project
2026-06-24
2024-01-08
38.9k stars
18
claude-code-router
A local model gateway and control plane for coding agents such as Claude Code, Codex and OpenCode, unifying providers, routing, credentials, tools and request observability.musistudio
2026-08-26
2025-02-25
38.3k stars
19
magpieclaude-codecodexdeepseek
A local gateway and menu-bar app that lets any coding agent use any model or subscription, with unified provider management, failover, profiles and privacy masking.yetone
2026-11-04
2026-09-23
36.9k stars
20
deepseek-harness-desktopdeepseekdeepseek-harnessdsh-plugin
An out-of-the-box Electron desktop client that packages and manages DeepSeek Harness with plugins.anywhere-labs
2026-08-15
2026-08-13
35.9k stars
21
codexplusplus
A desktop manager for the Codex app with provider switching, session tools, extensions, and usage enhancements.bigpizzav3
2026-06-26
2026-05-06
33.2k stars
22
antigravity-manageraccount-managerantigravity
A desktop account manager and protocol proxy for AI services, offering one-click multi-account switching, quota monitoring, and OpenAI/Anthropic/Gemini-compatible endpoints for coding agents.lbjlaq
2026-07-20
2025-11-26
33.1k stars
23
9routerclaude-codecursorai-agents
A free AI router and token saver that connects coding tools to 40+ providers with smart fallback and quota tracking.decolua
2026-06-26
2026-01-05
32.6k stars
24
claude-hudanthropicclaudeclaude-code
A Claude Code statusline plugin showing live context usage, rate limits, active tools, agents and todo progress.jarrodwatts
2026-06-24
2026-01-02
29.3k stars
25
mlflowmachine-learningaiml
An open-source AI engineering platform for tracing, evaluating, monitoring, and governing LLMs, agents, and models.mlflow
2026-06-24
2018-06-05
28.8k stars
26
cmuxampclaude-codecodex
A native macOS terminal built for running many coding agents in parallel, with tabs, notifications, and browser panes.manaflow-ai
2026-06-24
2026-01-28
28.8k stars
27
promptfoollmprompt-engineeringprompts
An open-source CLI and library for evaluating prompts and red-teaming LLM apps, with CI integration and model comparisons.promptfoo
2026-06-24
2023-04-28
27.1k stars
28
llamafilecross-platformggufllama-cpp
A Mozilla project that packs LLMs into single-file executables for local, no-install inference across operating systems.mozilla-ai
2026-06-24
2023-09-10
26.6k stars
29
ds4
A narrow native inference engine for running DeepSeek and GLM models fast on consumer hardware.antirez
2026-06-26
2026-05-06
24.4k stars
30
omlxapple-siliconinference-serverllm
A macOS LLM inference server with batched serving and SSD caching for local AI agents.jundot
2026-06-24
2026-02-13
23.6k stars
31
mlc-llmllmlanguage-modeltvm
A universal ML-compilation engine for deploying large language models with high-performance inference across GPUs, mobile, and browsers.mlc-ai
2026-06-24
2023-04-29
23.4k stars
32
opikopen-sourcelangchainopenai
An open-source LLM observability platform for tracing agents, running evaluations, and monitoring production.comet-ml
2026-06-24
2023-05-10
23.4k stars
33
nemoclawai-agentsnvidiaopenclaw
NVIDIA's open-source reference stack for running AI agents such as OpenClaw and Hermes safely inside OpenShell sandboxes, with managed inference, network policies, state persistence, and lifecycle operations.nvidia
2026-07-15
2026-03-15
23.0k stars
34
opcodeanthropicanthropic-claudeclaude
A desktop command center for Claude Code for managing sessions, custom agents, usage analytics, and MCP servers.winfunc
2026-06-24
2025-06-19
22.4k stars
35
onnxruntimedeep-learningonnxneural-networks
A cross-platform high-performance inference and training accelerator for ML models with hardware acceleration and graph optimizations.microsoft
2026-06-24
2018-11-10
22.3k stars
36
OpenShell
A safe, private runtime for agent fleets that enforces filesystem, syscall and network policies inside isolated sandboxes.NVIDIA
2026-06-24
2026-02-24
21.8k stars
37
wasmerwebassemblywasmwasi
Wasmer is a fast, lightweight WebAssembly sandbox runtime and CLI with SDKs for JavaScript, Python, Rust and Swift, letting you run portable or untrusted code safely across local, cloud and browser environments.wasmerio
2026-08-26
2018-10-11
21.3k stars
38
cockpit-toolsaccount-manageraiantigravity
A cross-platform desktop utility for managing accounts across AI IDEs such as Codex, Cursor, Copilot, Windsurf, and Antigravity, with quota monitoring, one-click switching, wake-up tasks, and parallel instances.jlcodes99
2026-07-16
2026-01-16
20.0k stars
39
evals
OpenAI's framework for evaluating LLMs and LLM systems, with an open registry of benchmarks and tooling for custom eval creation.openai
2026-06-24
2023-01-23
19.7k stars
40
deepevalevaluation-metricsevaluation-frameworkllm-evaluation
DeepEval is an open-source LLM evaluation framework with Pytest-style testing, diverse judge metrics, synthetic datasets, and tracing for agents and RAG pipelines.confident-ai
2026-06-24
2023-08-10
19.5k stars
41
web-llmdeep-learningllmtvm
A high-performance in-browser LLM inference engine with WebGPU acceleration and OpenAI-compatible APIs for building private web AI apps.mlc-ai
2026-06-24
2023-04-13
19.4k stars
42
opencodexai-toolsclaudecodex
opencodex is a local AI gateway that lets Codex, Claude Code, Claude Desktop, and Grok Build use many model providers, with routing, account pooling, and a management dashboard.lidge-jun
2026-07-21
2026-06-18
18.6k stars
43
OpenSandboxaiai-infrakubernetes
An isolated sandbox runtime for AI agents to run code, files, browsers, and desktops locally via Docker or on Kubernetes.opensandbox-group
2026-06-24
2025-12-17
17.3k stars
44
freetokendeepseek-v4edgeglm
FreeToken is an edge-native Mixture-of-Experts inference engine that runs large open-weight models on consumer hardware, with a desktop app, CLI, and OpenAI/Anthropic-compatible APIs.flashml-org
2026-08-22
2026-07-20
17.3k stars
45
ag-uiag-ui-protocolagent-frontendagent-ui
AG-UI is an open, event-based protocol that standardizes how AI agents connect to user-facing applications, shipping SDKs, middleware and a reference HTTP implementation for agent-powered frontends.ag-ui-protocol
2026-11-14
2025-05-07
17.3k stars
46
experiential
An open-source model gateway and router that unifies providers behind one API with budgets, guardrails, and optimization.experientiallabs
2026-08-28
16.7k stars
47
nano-vllminferencellmpytorch
A lightweight vLLM reimplementation in about 1,200 lines of Python delivering fast, readable offline LLM inference.GeeeekExplorer
2026-06-24
2025-06-09
16.4k stars
48
cc-connect
A bridge that exposes local AI coding agents to chat apps with multi-bot relay, sessions, scheduling, and remote control.chenhg5
2026-06-24
2026-02-28
16.4k stars
49
ragasllmllmopsevaluation
An evaluation toolkit for LLM apps offering objective metrics, test generation, and production feedback loops.vibrantlabsai
2026-06-24
2023-05-08
16.3k stars
50
RagaAI-Catalystagentneoagentsllm-testing
An observability and evaluation platform for LLM agents, offering tracing, debugging, analytics, and guardrails.raga-ai-hub
2026-06-24
2024-08-26
16.2k stars
51
claudianclaude-codeobsidianobsidian-plugin
An Obsidian plugin that embeds Claude Code, Codex, OpenCode and other coding agents in your vault, with sessions, inline editing, skills, and cross-session messaging.YishenTu
2026-07-15
2025-12-05
16.0k stars
52
TensorRT-LLMblackwellcudamoe
NVIDIA's open-source library for optimizing LLM inference with custom kernels and a high-performance runtime.NVIDIA
2026-06-24
2023-08-16
15.1k stars
53
E2Baigptopenai
An open-source sandbox infrastructure for running AI-generated code securely, controlled via Python and JavaScript SDKs.e2b-dev
2026-06-24
2023-03-04
14.9k stars
54
claudecodeuiclaudeclaude-apiclaude-code
An open-source web and mobile UI for Claude Code, Cursor CLI, and Codex, letting you manage coding-agent sessions, files, Git, and MCP from anywhere.siteboon
2026-08-26
2025-06-25
14.6k stars
55
ax
Google's declarative runtime for running autonomous agent workloads at scale on Kubernetes, sandboxing each task and pre-wiring repositories, tools and models.google
2026-09-22
2026-03-30
14.6k stars
56
hermes-desktopaiai-agentautonomous-agents
A native desktop companion for installing, configuring, and chatting with the Hermes Agent in one place.fathah
2026-06-24
2026-04-02
14.6k stars
57
ccstatuslineai-toolsclaude-codecli
A highly customizable status line for the Claude Code CLI that shows model, Git branch, token usage, cost, and limits in real time, with themes and Powerline styling.sirmalloc
2026-07-16
2025-08-08
13.6k stars
58
cubesandboxagentscontainersandbox
An instant, secure MicroVM sandbox service for AI agents with millisecond startup, hardware isolation, and E2B compatibility.tencentcloud
2026-07-09
2026-04-10
13.4k stars
59
gatewaygatewaygenerative-aillmops
An open-source AI gateway that routes requests across 1600+ LLMs with retries, guardrails, caching, observability, and MCP server management.Portkey-AI
2026-06-24
2023-08-23
13.4k stars
60
openchamberaiopencodeagentic-engineering
A desktop, web, VS Code, and mobile workspace for running and reviewing OpenCode coding-agent sessions, with goals, multi-run comparison, previews, GitHub workflows, and private remote access.openchamber
2026-07-17
2025-09-11
12.9k stars
61
OpenLLMllmllmopsmodel-inference
An open-source platform for self-hosting LLMs and serving them as OpenAI-compatible APIs in the cloud.bentoml
2026-06-24
2023-04-19
12.6k stars
62
LMCacheamdcudainference
A vendor-neutral KV cache management layer for LLM inference that reuses cached context to cut latency and boost throughput.LMCache
2026-06-24
2024-05-28
12.4k stars
63
phoenixllmopsai-monitoringai-observability
Arize Phoenix is an open-source observability and evaluation platform for LLM applications, offering OpenTelemetry tracing, datasets, experiments, prompt management, and LLM-based evals.Arize-ai
2026-08-26
2022-11-09
12.3k stars
64
kubesharkkubernetesgolangrest
An eBPF-powered network observability platform for Kubernetes that indexes L4/L7 traffic, decrypts TLS, and serves AI agents via MCP.kubeshark
2026-06-24
2021-04-19
12.1k stars
65
kimi-k3-in-cavx2c99cpu-inference
A portable C99 inference engine that runs the 2.78T-parameter Kimi K3 model on a single CPU with streaming.fareedkhan-dev
2026-08-02
2026-08-01
12.1k stars
66
codeburnai-codingclaude-codecli
A local observability tool that tracks AI coding token spend across dozens of agents, broken down by model, project, and task.getagentseal
2026-08-19
2026-04-13
11.9k stars
67
wandbmachine-learningexperiment-trackdeep-learning
An experiment tracking and observability platform for logging, visualizing, and managing machine learning training runs.wandb
2026-06-24
2017-03-24
11.3k stars
68
inspectortooldebugmcp
Official developer inspector for MCP servers with web, CLI and TUI clients to connect, list tools, call methods and smoke-test servers.modelcontextprotocol
2026-06-24
2024-10-03
11.3k stars
69
serverinferencegpumachine-learning
NVIDIA's open-source inference serving software for deploying AI models efficiently across cloud and edge.triton-inference-server
2026-06-24
2018-10-04
11.1k stars
70
tykgoapiapi-management
Tyk is a cloud-native open-source API and AI gateway supporting REST, GraphQL, gRPC, TCP, and MCP, adding authentication, rate limiting, analytics, and governance for API and AI-agent traffic.TykTechnologies
2026-08-26
2014-05-07
10.9k stars
71
openskills
A universal CLI that installs and syncs SKILL.md skills to any coding agent, matching Claude Code format everywhere.numman-ali
2026-06-24
2025-10-26
10.8k stars
72
llama-cpp-python
Python bindings and an OpenAI-compatible server for llama.cpp, bringing fast local LLM inference to Python apps.abetlen
2026-06-24
2023-03-23
10.7k stars
73
astridagent-runtimeai-agentscapability-security
An operating-system-grade runtime for AI agents that runs WebAssembly capsules with capability security, sandboxing, isolation, and auditable execution.unicity-astrid
2026-06-24
2026-02-15
10.3k stars
74
pixel-agentsai-agentsclaude-codecli
Pixel Agents turns AI coding agents running in your terminals into animated pixel-art characters in a tiny office, showing what each agent is doing and letting you launch and manage sessions.pixel-agents-hq
2026-11-18
2026-02-08
10.3k stars
75
garakaillm-evaluationllm-security
An LLM vulnerability scanner that red-teams models with probes for injection, jailbreaks, leaks, and toxicity.NVIDIA
2026-06-24
2023-05-10
10.1k stars
76
hyperdxanalyticsapplication-monitoringlog-management
An open-source observability platform unifying logs, metrics, traces and session replays on ClickHouse for fast debugging.hyperdxio
2026-06-24
2023-09-13
10.0k stars
77
computer
A durable virtual computer for agents with a persistent filesystem and sandboxed shell and code execution.cloudflare
2026-08-05
2026-06-05
9.9k stars
78
failproofaiclaude-codereliabilityagent-reliability
Observability and policy enforcement for agent harnesses with tracing, guardrails, and local audits.failproofai
2026-08-12
2026-04-06
9.8k stars
79
inferencepytorchdeploymentllm
A unified model-serving library to deploy LLMs and multimodal models locally or in the cloud via OpenAI-compatible API.xorbitsai
2026-06-24
2023-06-14
9.7k stars
80
self-hostedsentrydockerdocker-compose
The self-hosted Sentry distribution packaging full error tracking and performance monitoring for private low-volume deployments.getsentry
2026-06-24
2016-02-11
9.7k stars
81
bifrostgatewayllm-gatewayguardrails
Bifrost is a high-performance AI gateway that unifies 23+ providers behind one OpenAI-compatible API. It adds automatic failover, load balancing, semantic caching, guardrails, governance, and observability, with a web UI and Docker deployment.maximhq
2026-08-26
2025-03-19
9.5k stars
82
atlasaiai-coding-assistantclaude-code
Atlas is an agent visibility and control layer that records coding agent sessions, links them to commits, and gives teams a shared timeline, memory, and usage dashboard.tryatlas
2026-11-06
2026-05-14
9.4k stars
83
atlasaiai-coding-assistantclaude-code
A desktop control center for coding agents that runs Claude Code, Codex and others side by side with shared memory and session checkpoints.pacifio
2026-08-07
2026-05-14
9.2k stars
84
microsandboxagentsdockerlinux
A fast local-first microVM runtime and SDK for running untrusted AI agents, code, and automation in hardware-isolated sandboxes.superradcompany
2026-06-24
2024-10-03
9.1k stars
85
claude-squadclaude-codeclivibe-coding
A terminal TUI for running multiple coding agents in isolated git worktrees, managing sessions, diffs, and background tasks.smtg-ai
2026-06-24
2025-03-09
8.8k stars
86
Claude-Code-Usage-Monitoraiclaudeclaude-code
Claude Code Usage Monitor is a terminal companion that tracks Claude Code token, message, and cost usage in real time, with forecasting, warnings, and machine-readable exports.Maciek-roboblog
2026-08-26
2025-06-19
8.8k stars
87
nexa-sdkllmon-device-aisdk
An on-device GenAI inference runtime for Snapdragon that runs frontier LLMs and VLMs locally via CLI, SDK, or server.qualcomm
2026-06-24
2024-08-16
8.5k stars
88
ogx
An open-source OpenAI-compatible API server that unifies models, vector search, and agentic orchestration as infrastructure for AI applications anywhere with pluggable providers.ogx-ai
2026-06-24
2024-06-25
8.5k stars
89
aos-ce
An open agent operating system that gives AI agents a governed local environment for tools and permissions, running capabilities as isolated WebAssembly capsules.unicity-aos
2026-07-26
2026-07-12
8.5k stars
90
pi-web
A local browser UI for the pi coding agent that reuses pi's config and session files to browse and resume sessions, run agent turns, configure models, and inspect project files.agegr
2026-07-21
2026-03-22
8.2k stars
91
lmdeploycuda-kernelsdeepspeedfastertransformer
A toolkit for compressing, deploying, and serving LLMs with fast inference engines, quantization, and distributed serving.InternLM
2026-06-24
2023-06-15
8.1k stars
92
evidentlydata-driftjupyter-notebookpandas-dataframe
An open-source framework to evaluate, test, and monitor ML and LLM systems with reports and a monitoring dashboard.evidentlyai
2026-06-24
2020-11-25
8.1k stars
93
openspace
A skill management layer for AI agents that retrieves, evaluates, shares, and evolves skills using real execution evidence.hkuds
2026-08-16
2026-03-24
8.1k stars
94
stable-diffusion.cppaicplusplusdiffusion
A lightweight C/C++ diffusion-model inference engine built on ggml, supporting Stable Diffusion, FLUX, Wan, Qwen Image, and other image and video models on local CPU or GPU backends.leejet
2026-09-24
2023-08-13
8k stars
95
grok2apigrokgrok-imaginegrok-build
A multi-account Grok API gateway exposing OpenAI- and Anthropic-compatible endpoints, with account pools, routing, auditing, and an admin console.chenyme
2026-07-15
2025-10-10
7.9k stars
96
mistral.rsllmrustuqff
A fast Rust LLM inference engine with quantization, OpenAI-compatible serving and SDKs for local and multi-GPU deployment.EricLBuehler
2026-06-24
2024-02-26
7.8k stars
97
magnitude
An open-source local inference engine tuned for each machine that runs open models quickly and connects them to popular coding agents via compatible APIs.magnitudedev
2026-08-09
2026-06-12
7.8k stars
98
substrate
A zero-trust sandbox runtime on Kubernetes for isolating, snapshotting, and scaling millions of agents.agent-substrate
2026-08-20
2026-05-13
7.8k stars
99
vllm-omnidiffusioninferencemodel-serving
vLLM-Omni extends vLLM to serve omni-modality models, supporting text, image, audio, video, and action generation with an OpenAI-compatible API, streaming, and distributed inference.vllm-project
2026-07-18
2025-09-11
7.8k stars
100
manifestopenclawcost-trackingllm-observability
An open-source LLM gateway that unifies API keys, subscriptions, and local models behind one OpenAI-compatible endpoint, adding routing, fallbacks, full logs, and cost tracking.mnfst
2026-08-26
2022-09-27
7.7k stars