💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
COMMITS
/ bindings/python/examples/example.py March 12, 2024
A
[`remove black`] And use ruff (#1436)
Arthur committed
October 5, 2022
N
Updating python formatting. (#1079)
Nicolas Patry committed
September 24, 2020
N
Upgrading to black 20.8b1
Nicolas Patry committed
September 23, 2020
N
We use 19.10b0 not 20 here...
Nicolas Patry committed
N
Adressing first pass of comments.
Nicolas Patry committed
April 6, 2020
B
Python - Update examples to use new models API
Bjarte Johansen committed
February 18, 2020
A
Python - Black auto formatting
Anthony MOI committed
February 10, 2020
A
Python - Fix example.py for GPT-2
Anthony MOI committed
A
Python - More updates to the new API
Anthony MOI committed
A
Python - Update example.py with new API
Anthony MOI committed
January 15, 2020
M
Use the same vocabs/merges for Python and Rust comparison.
Morgan Funtowicz committed
January 7, 2020
A
Python - Update examples with getter/setter
Anthony MOI committed
January 6, 2020
A
Python - Improve imports
Anthony MOI committed
December 29, 2019
A
Python - Update example
Anthony MOI committed
December 26, 2019
A
Python - Update doc and readme for add_prefix_space
Anthony MOI committed
December 24, 2019
A
Python - fix example
Anthony MOI committed
December 16, 2019
A
Python - Update example
Anthony MOI committed
December 13, 2019
A
Python - Handle kwargs for bert modules
Anthony MOI committed
December 10, 2019
A
Python - Add Encoding repr + improve example
Anthony MOI committed
December 9, 2019
A
Python - Update example
Anthony MOI committed
November 24, 2019
A
Python - PoC Custom PreTokenizer
Anthony MOI committed