MORPH
SIGN IN SIGN UP
abetlen / llama-cpp-python UNCLAIMED

Python bindings for llama.cpp

0 0 2 Python

COMMITS

v0.3.1-metal
September 29, 2024
A
chore: Bump version
Andrei Betlen committed
7c4aead
A
feat: Update llama.cpp
Andrei Betlen committed
57e70bb
September 26, 2024
A
feat: Expose libggml in internal APIs (#1761)
Andrei committed
01c7607
A
feat: Update llama.cpp
Andrei Betlen committed
dca0c9a
A
fix: Additional fixes for speculative decoding
Andrei Betlen committed
e975dab
X
misc: Rename all_text to remaining_text (#1658)
Xu Song committed
11d9562
A
fix: Fix speculative decoding
Andrei Betlen committed
9992c50
September 25, 2024
A
fix: install build dependency
Andrei Betlen committed
65222bc
A
fix: install build dependency
Andrei Betlen committed
8e07db0
A
chore: Bump version
Andrei Betlen committed
b3dfb42
A
feat: Update llama.cpp
Andrei Betlen committed
926b414
September 22, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
4744551
September 20, 2024
D
chore(deps): bump actions/cache from 3 to 4 (#1751)
dependabot[bot] committed
1324c0c
O
docs: Add cuda 12.5 to README.md (#1750)
Olivier DEBAUCHE committed
49b1e73
A
feat: Add option to configure n_ubatch
Andrei Betlen committed
6c44a3f
A
feat: Update llama.cpp
Andrei Betlen committed
47d7a62
September 19, 2024
J
feat: Add loading sharded GGUF files from HuggingFace with Llama.from_pretrained(additional_files=[...]) . Closes #1341
Jonathan Jordan committed
84c0920
A
fix: Don't store scores internally unless logits_all=True. Reduces memory requirements for large context. Closes #1542
Andrei Betlen committed
29afcfd
X
fix: Fix memory allocation of ndarray (#1704)
Xu Song committed
22cedad
A
misc: Format
Andrei Betlen committed
9b64bb5
A
feat: Update llama.cpp
Andrei Betlen committed
1e64664
A
feat: Update sampling API for llama.cpp (#1742)
Andrei committed
f8fcb3e
September 18, 2024
D
chore(deps): bump pypa/cibuildwheel from 2.20.0 to 2.21.1 (#1743)
dependabot[bot] committed
a4e1451
O
feat(ci): Speed up CI workflows using `uv`, add support for CUDA 12.5 wheels
Olivier DEBAUCHE committed
e529940
September 6, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
c032fc6
September 5, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
9497bcd
September 2, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
c3fc80a
August 31, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
9769e57
August 30, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
dcb0d0c
A
fix: Use system message in og qwen format. Closes #1697
Andrei Betlen committed
98eb092