MORPH
SIGN IN SIGN UP
abetlen / llama-cpp-python UNCLAIMED

Python bindings for llama.cpp

0 0 0 Python

COMMITS

v0.2.71-metal
May 9, 2024
A
chore: Bump version
Andrei Betlen committed
bf66a28
A
fix: free last image embed in llava chat handler
Andrei Betlen committed
3757328
May 8, 2024
A
fix: Make leading bos_token optional for image chat formats, fix nanollava system message
Andrei Betlen committed
7712263
A
feat: Update llama.cpp
Andrei Betlen committed
2a39b99
A
chore: Bump version
Andrei Betlen committed
9ce5cb3
S
feat: fill-in-middle support (#1386)
Sigbjørn Skjæret committed
4a7122d
A
feat: Update llama.cpp
Andrei Betlen committed
228949c
S
fix: adding missing args in create_completion for functionary chat handler (#1430)
Sarunas Kalade committed
903b28a
I
docs: update README.md (#1432)
Ikko Eltociear Ashimine committed
07966b9
B
fix: chat_format log where auto-detected format prints `None` (#1434)
Bruno Alvisio committed
a50d24e
May 5, 2024
A
feat(server): Add support for setting root_path. Closes #1420
Andrei Betlen committed
0318702
O
feat(ci): Add docker checks and check deps more frequently (#1426)
Olivier DEBAUCHE committed
3666833
A
feat: Update llama.cpp
Andrei Betlen committed
3e2597e
May 4, 2024
N
fix: detokenization case where first token does not start with a leading space (#1375)
Noam Gat committed
e0d7674
J
feat: Implement streaming for Functionary v2 + Bug fixes (#1419)
Jeffrey Fong committed
1f56c64
May 3, 2024
A
Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
Andrei Betlen committed
f9b7221
A
fix: Use memmove to copy str_value kv_override. Closes #1417
Andrei Betlen committed
9f7a855
A
feat(server): Remove temperature bounds checks for server. Closes #1384
Andrei Betlen committed
0a454be
D
fix(server): Propagate `flash_attn` to model load. (#1424)
Daniel Thuerck committed
2138561
May 2, 2024
A
chore: Bump version
Andrei Betlen committed
2117122
A
feat: Update llama.cpp
Andrei Betlen committed
d75dea1
A
feat: Add llama-3-vision-alpha chat format
Andrei Betlen committed
31b1d95
April 30, 2024
A
fix: Change default verbose value of verbose in image chat format handlers to True to match Llama
Andrei Betlen committed
4f01c45
A
feat: Update llama.cpp
Andrei Betlen committed
946156f
A
Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
Andrei Betlen committed
9286b5c
A
fix: Suppress all logs when verbose=False, use hardcoded fileno's to work in colab notebooks. Closes #796 Closes #729
Andrei Betlen committed
f116175
J
fix: UTF-8 handling with grammars (#1415)
Jonathan Soma committed
3226b3c
A
docs: Change all examples from interpreter style to script style.
Andrei Betlen committed
945c62c
A
docs: Update README.md
Andrei Betlen committed
26478ab
A
chore: Bump version
Andrei Betlen committed
b14dd98