COMMITS
/ llama_cpp/llama_tokenizer.py September 19, 2024
A
misc: Format
Andrei Betlen committed
August 29, 2024
B
feat: Enable detokenizing special tokens with `special=True` (#1596)
benniekiss committed
July 9, 2024
A
fix(misc): Format
Andrei Betlen committed
February 23, 2024
A
fix: LlamaHFTokenizer now receives pre_tokens
Andrei Betlen committed
February 11, 2024
C
fix: Circular dependancy preventing early Llama object free (#1176)
Connor committed
February 8, 2024
A
feat: Move tokenizer to own module
Andrei Betlen committed