MORPH
®
EXPLORE
SEARCH
/
SIGN IN
SIGN UP
EXPLORE
SEARCH
huggingface
/
text-generation-inference
UNCLAIMED
Large Language Model Text Generation Inference
0
0
1
Python
CODE
ISSUES
RELEASES
WIKI
ACTIVITY
ANALYTICS
use_updated_kernels
text-generation-inference
/
server
Download ZIP
custom_kernels
exllama_kernels
exllamav2_kernels
tests
text_generation_server
.gitignore
2.8 KB
bounds-from-nix.py
1.2 KB
hf-kernels.lock
360.2 KB
Makefile
2.3 KB
Makefile-awq
463 B
Makefile-eetq
370 B
Makefile-exllamav2
666 B
Makefile-flash-att
673 B
Makefile-flash-att-v2
924 B
Makefile-flashinfer
384 B
Makefile-lorax-punica
543 B
Makefile-selective-scan
937 B
Makefile-vllm
480 B
pyproject.toml
2.1 KB
README.md
173 B
req.txt
5.7 KB
requirements_cuda.txt
9.3 KB
requirements_gen.txt
5.0 KB
requirements_intel.txt
8.4 KB
requirements_rocm.txt
8.4 KB
uv.lock
512.4 KB