中文
Agent infrastructure

LitServe

Lightning-AI/LitServe

LitServe is a minimal Python framework for building custom AI inference servers, giving developers control over model loading, batching, routing, streaming, and scaling.

Topics