Morph MORPH
SIGN IN SIGN UP
abetlen / llama-cpp-python UNCLAIMED

Python bindings for llama.cpp

0 0 45 Python

COMMITS

v0.3.0
September 25, 2024
A
fix: install build dependency
Andrei Betlen committed
65222bc
A
fix: install build dependency
Andrei Betlen committed
8e07db0
A
chore: Bump version
Andrei Betlen committed
b3dfb42
A
feat: Update llama.cpp
Andrei Betlen committed
926b414
September 22, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
4744551
September 20, 2024
D
chore(deps): bump actions/cache from 3 to 4 (#1751)
dependabot[bot] committed
1324c0c
O
docs: Add cuda 12.5 to README.md (#1750)
Olivier DEBAUCHE committed
49b1e73
A
feat: Add option to configure n_ubatch
Andrei Betlen committed
6c44a3f
A
feat: Update llama.cpp
Andrei Betlen committed
47d7a62
September 19, 2024
J
feat: Add loading sharded GGUF files from HuggingFace with Llama.from_pretrained(additional_files=[...]) . Closes #1341
Jonathan Jordan committed
84c0920
A
fix: Don't store scores internally unless logits_all=True. Reduces memory requirements for large context. Closes #1542
Andrei Betlen committed
29afcfd
X
fix: Fix memory allocation of ndarray (#1704)
Xu Song committed
22cedad
A
misc: Format
Andrei Betlen committed
9b64bb5
A
feat: Update llama.cpp
Andrei Betlen committed
1e64664
A
feat: Update sampling API for llama.cpp (#1742)
Andrei committed
f8fcb3e
September 18, 2024
D
chore(deps): bump pypa/cibuildwheel from 2.20.0 to 2.21.1 (#1743)
dependabot[bot] committed
a4e1451
O
feat(ci): Speed up CI workflows using `uv`, add support for CUDA 12.5 wheels
Olivier DEBAUCHE committed
e529940
September 6, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
c032fc6
September 5, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
9497bcd
September 2, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
c3fc80a
August 31, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
9769e57
August 30, 2024
A
feat: Update llama.cpp
Andrei Betlen committed
dcb0d0c
A
fix: Use system message in og qwen format. Closes #1697
Andrei Betlen committed
98eb092
August 29, 2024
B
feat: Enable detokenizing special tokens with `special=True` (#1596)
benniekiss committed
d981d32
A
docs: Update README
Andrei Betlen committed
9cba3b8
A
docs: Update README
Andrei Betlen committed
8b853c0
A
docs: Update README
Andrei Betlen committed
4b1e364
A
misc(fix): Update CHANGELOG
Andrei Betlen committed
45001ac
A
chore: Bump version
Andrei Betlen committed
077ecb6
A
feat: Update llama.cpp
Andrei Betlen committed
332720d