SIGN IN SIGN UP
vllm-project / vllm UNCLAIMED

A high-throughput and memory-efficient inference and serving engine for LLMs

0 0 1 Python
167 lines | 6.1 KB