💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
|
include Cargo.toml
|
||
|
|
recursive-include src *
|
||
|
|
recursive-include tokenizers-lib *
|
||
|
|
recursive-exclude tokenizers-lib/target *
|