bindings/python - huggingface/tokenizers - Morph

SIGN IN SIGN UP

huggingface / tokenizers UNCLAIMED

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

0 0 0 Rust

	.cargo
	benches
	docs
	examples
	py_src
	scripts
	src
	tests
	tools
	.gitignore	5 B
	Cargo.toml	986 B
	CHANGELOG.md	22.4 KB
	conftest.py	576 B
	Makefile	1.8 KB
	MANIFEST.in	188 B
	pyproject.toml	2.0 KB
	pytest.ini	73 B
	README.md	6.3 KB
	rust-toolchain	7 B
	setup.cfg	895 B
	stub.py	9.2 KB
	test.txt	1.6 KB