中文
Agent infrastructure

vllm-omni

vllm-project/vllm-omni

vLLM-Omni extends vLLM to serve omni-modality models, supporting text, image, audio, video, and action generation with an OpenAI-compatible API, streaming, and distributed inference.

Topics