huggingface/text-generation-inference - Morph

SIGN IN SIGN UP

huggingface / text-generation-inference UNCLAIMED

Large Language Model Text Generation Inference

10809 0 1 Python

50 branches 67 tags

https://code.morphllm.com/huggingface/text-generation-inference.git

bloom deep-learning falcon gpt inference nlp pytorch starcoder transformer

	.github
	assets
	backends
	benchmark
	clients
	docs
	integration-tests
	launcher
	load_tests
	nix
	proto
	router
	server
	.dockerignore		106 B
	.gitignore		554 B
	.pre-commit-config.yaml		629 B
	.redocly.lint-ignore.yaml		4.1 KB
	Cargo.lock		154.8 KB
	Cargo.toml		1.2 KB
	CODE_OF_CONDUCT.md		5.4 KB
	CONTRIBUTING.md		5.5 KB
	crate-hashes.json		179 B
	Dockerfile		8.9 KB
	Dockerfile_amd		11.0 KB
	Dockerfile_gaudi		3.8 KB
	Dockerfile_intel		8.4 KB
	Dockerfile_llamacpp		2.5 KB
	Dockerfile_trtllm		5.5 KB
	Dockerfile.neuron		5.0 KB
	Dockerfile.nix		677 B
	flake.lock		26.4 KB
	flake.nix		5.5 KB
	LICENSE		11.1 KB
	Makefile		1.4 KB
	README.md		14.3 KB
	rust-toolchain.toml		133 B
	sagemaker-entrypoint.sh		524 B
	tgi-entrypoint.sh		170 B
	update_doc.py		6.2 KB