MORPH
®
EXPLORE
SEARCH
/
SIGN IN
SIGN UP
EXPLORE
SEARCH
huggingface
/
text-generation-inference
UNCLAIMED
Large Language Model Text Generation Inference
10809
0
1
Python
CODE
ISSUES
RELEASES
WIKI
ACTIVITY
ANALYTICS
b4adbf2f6e2e721280bd0ea5f91d70f7d033f5ed
text-generation-inference
/
server
Download ZIP
custom_kernels
exllama_kernels
exllamav2_kernels
tests
text_generation_server
.gitignore
2.8 KB
bounds-from-nix.py
1.2 KB
kernels.lock
20.0 KB
Makefile
2.3 KB
Makefile-awq
463 B
Makefile-eetq
370 B
Makefile-exllamav2
666 B
Makefile-flash-att
673 B
Makefile-flash-att-v2
945 B
Makefile-flashinfer
384 B
Makefile-selective-scan
937 B
Makefile-vllm
446 B
pyproject.toml
2.6 KB
README.md
173 B
req.txt
5.7 KB
requirements_cuda.txt
9.0 KB
requirements_gen.txt
5.3 KB
requirements_intel.txt
8.8 KB
requirements_rocm.txt
8.8 KB
uv.lock
536.9 KB