Vllm

Receiving attention for its open-source large language model capabilities and applications.