vLLM-Omni extends vLLM to serve omni-modality models, supporting text, image, audio, video, and action generation with an OpenAI-compatible API, streaming, and distributed inference.
7770diffusion,inference,model-servingvLLM-Omni extends vLLM to serve omni-modality models, supporting text, image, audio, video, and action generation with an OpenAI-compatible API, streaming, and distributed inference.