MORPH
SIGN IN SIGN UP
abetlen / llama-cpp-python UNCLAIMED

Python bindings for llama.cpp

0 0 8 Python

COMMITS

/ llama_cpp/server/model.py
docker
June 13, 2024
J
feat: Add `.close()` method to `Llama` class to explicitly free model from memory (#1513)
Junpei Kawamoto committed
320a5d7
June 4, 2024
N
feat: adding `rpc_servers` parameter to `Llama` class (#1477)
nullname committed
d634efc
May 29, 2024
A
fix: fix string value kv_overrides. Closes #1487
Andrei Betlen committed
df45a4b
May 3, 2024
D
fix(server): Propagate `flash_attn` to model load. (#1424)
Daniel Thuerck committed
2138561
May 2, 2024
A
feat: Add llama-3-vision-alpha chat format
Andrei Betlen committed
31b1d95
April 30, 2024
A
feat: Generic Chat Formats, Tool Calling, and Huggingface Pull Support for Multimodal Models (Obsidian, LLaVA1.6, Moondream) (#1147)
Andrei committed
fe2da09
April 1, 2024
L
feat: add support for KV cache quantization options (#1307)
Limour committed
f165048
February 28, 2024
A
misc: Format
Andrei Betlen committed
727d60c
February 26, 2024
A
feat(server): Add support for pulling models from Huggingface Hub (#1222)
Andrei committed
4d574bd
February 8, 2024
A
fix: broken import
Andrei Betlen committed
85d3374
J
feat: Integrate functionary v1.4 and v2 models + add custom tokenizer support to Llama class (#1078)
Jeffrey Fong committed
9018270
January 31, 2024
A
Add speculative decoding (#1120)
Andrei committed
fb762a6
January 21, 2024
A
fix: pass chat handler not chat formatter for huggingface autotokenizer and tokenizer_config formats.
Andrei Betlen committed
24f3945
January 19, 2024
A
feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.
Andrei Betlen committed
b8fc1c7
January 15, 2024
P
Implement GGUF metadata KV overrides (#1011)
Phil H committed
76aafa6
December 22, 2023
D
[Feat] Multi model support (#931)
Dave committed
12b7f2f