💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
COMMITS
/ bindings/python/pyproject.toml March 12, 2024
A
[`remove black`] And use ruff (#1436)
Arthur committed
November 10, 2023
L
Allow huggingface_hub<1.0 (#1385)
Lucain committed
November 6, 2023
M
Allow hf_hub 0.18 (#1383)
Mario Šaško committed
October 2, 2023
A
Let's allow hf_hub < 1.0 (#1344)
Arthur committed
August 28, 2023
N
Move to maturing mimicking move for `safetensors`. + Rewritten node bindings. (#1331)
Nicolas Patry committed
October 5, 2022
N
Updating python formatting. (#1079)
Nicolas Patry committed
May 24, 2021
A
Remove support for Python 3.5 (#714)
Anthony MOI committed
November 27, 2020
P
Split Pre-Tokenizer (#542)
Patrick von Platen committed
September 23, 2020
A
Setup black format in pyproject.toml
Anthony MOI committed
November 27, 2019
A
Basic python setuptools
Anthony MOI committed