kvcache-ai/ktransformers - Morph

SIGN IN SIGN UP

kvcache-ai / ktransformers UNCLAIMED

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

16884 0 0 Python

37 branches 28 tags

Jim James [feat]: add AVX512F+BW fallback for FP8 and BF16 under AMX backend (#1908)

8a427c9 · 15h ago · 1,233 Commits

	.github
	archive
	doc
	docker
	kt-kernel
	kt-sft
	third_party
	.gitignore		404 B
	.gitmodules		529 B
	book.toml		374 B
	install.sh		6.9 KB
	LICENSE		11.1 KB
	MAINTAINERS.md		2.7 KB
	pyproject.toml		605 B
	README_ZH.md		7.2 KB
	README.md		8.7 KB
	setup.py		382 B
	version.py		110 B