Morph MORPH
SIGN IN SIGN UP
abetlen / llama-cpp-python UNCLAIMED

Python bindings for llama.cpp

0 0 65 Python

COMMITS

/ llama_cpp/llama.py
batch-processing
January 18, 2024
A
Merge branch 'main' into batch-processing
Andrei Betlen committed
850416a
January 17, 2024
A
Re-order classes in llama.py
Andrei Betlen committed
7b46bb5
A
Move helper classes to _internals submodule
Andrei Betlen committed
cc4630e
A
Move cache classes to llama_cache submodule.
Andrei Betlen committed
3b92419
January 15, 2024
A
Merge branch 'main' into batch-processing
Andrei Betlen committed
358593f
A
Add split_mode option. Closes #1085
Andrei Betlen committed
84615ad
P
Implement GGUF metadata KV overrides (#1011)
Phil H committed
76aafa6
January 10, 2024
A
Use sampling context
Andrei Betlen committed
7f4ba48
A
Merge branch 'main' into batch-processing
Andrei Betlen committed
456a601
S
Add ability to pass in penalize_nl param (#1068)
Stephen Hankinson committed
df3be58
January 5, 2024
A
Fix #1038
Andrei Betlen committed
e1cd61e
A
Merge branch 'main' into batch-processing
Andrei Betlen committed
b1e9962
December 22, 2023
A
Fix typo
Andrei Betlen committed
d9a1d90
S
server: Support none defaulting to infinity for completions (#111)
swg committed
4b01a87
T
fix text_offset of multi-token characters (#1037)
twaka committed
2f03fb0
December 18, 2023
A
fix: float32 is not JSON serializable when streaming logits.
Andrei Betlen committed
a05b4da
A
Fix logits are not json serializable
Andrei Betlen committed
fcbd177
A
Merge branch 'main' into batch-processing
Andrei Betlen committed
a625412
A
Add offload_kqv option to llama and server
Andrei Betlen committed
095c650
A
Remove unnused import
Andrei Betlen committed
472b344
K
perf: Don't convert logprobs arrays to lists (#1021)
kddubey committed
6b2e0e0
B
Bugfix: Remove f16_kv, add offload_kqv field (#1019)
Brandon Roberts committed
62944df
December 16, 2023
D
Bug fixed with n_ctx=0 (#1015)
Daniele Morotti committed
f1c631d
K
Fix logits_to_logprobs for 2-D and 3-D logits (#1002)
kddubey committed
5a89446
December 12, 2023
T
Replace logits_to_logprobs implementation with numpy equivalent to llama.cpp (#991)
Tanner Hobson committed
ef22e47
A
Merge branch 'main' into batch-processing
Andrei Betlen committed
4335a9d
December 11, 2023
A
Remove f16_kv
Andrei Betlen committed
ec26f36
November 30, 2023
A
Refactor _create_completion
Andrei Betlen committed
40f2293
November 29, 2023
K
Fix #891 (#952)
kddubey committed
b069d06
November 28, 2023
A
Add sampling context
Andrei Betlen committed
3a1ba77
A
Clean up llama.py into seperate modules.
Andrei Betlen committed
3c13436
November 26, 2023
A
docs: Update Llama docs
Andrei Betlen committed
6308f21
November 24, 2023
A
docs: Update completion and chat_completion parameter docstrings
Andrei Betlen committed
4026166
November 23, 2023
A
docs: Add Llama class example
Andrei Betlen committed
b6bb7ac
November 21, 2023
A
Format
Andrei Betlen committed
7a3f878
A
Fix: Add logit_bias to all completion api methods
Andrei Betlen committed
422ebc8
A
Add support for logit_bias outside of server api. Closes #827
Andrei Betlen committed
07e47f5
T
Added support for min_p (#921)
TK-Master committed
b8438f7
A
Fix #929
Andrei Betlen committed
a34d480
November 10, 2023
A
Fix sampling bug when logits_all=False
Andrei Betlen committed
6f0b0b1
A
Potential bugfix for eval
Andrei Betlen committed
d9b38e3
A
Fix: default max_tokens matches openai api (16 for completion, max length for chat completion)
Andrei Betlen committed
e7962d2
November 8, 2023
A
Add set_seed to Llama class
Andrei Betlen committed
fd41ed3
A
Fix destructor NoneType is not callable error
Andrei Betlen committed
ca4cb88
A
Add JSON mode support. Closes #881
Andrei Betlen committed
b30b9c3
A
Add seed parameter support for completion and chat_completion requests. Closes #884
Andrei Betlen committed
86aeb9f
D
Multimodal Support (Llava 1.5) (#821)
Damian Stewart committed
aab74f0
November 6, 2023
A
Fix type bug
Andrei Betlen committed
be0add1
A
Refactor Llama class internals
Andrei Betlen committed
e214a58
November 3, 2023
A
Clean up stdout / stderr suppression
Andrei Betlen committed
2ec043a