#model-inference

How to Deploy Any Open-Source AI Model with OpenAI API in One Command

OpenLLM lets you deploy any open-source AI model with an OpenAI-compatible API endpoint in a single command. Built on BentoML and vLLM.