MORPH
SIGN IN SIGN UP
abetlen / llama-cpp-python UNCLAIMED

Python bindings for llama.cpp

0 0 23 Python

COMMITS

/ llama_cpp/server/settings.py
batch-processing
January 16, 2024
K
fix(cli): allow passing n_ctx=0 to openAI API server args to use model n_ctx_train field per #1015 (#1093)
Kyle Mistele committed
9c36688
January 15, 2024
A
Add split_mode option. Closes #1085
Andrei Betlen committed
84615ad
P
Implement GGUF metadata KV overrides (#1011)
Phil H committed
76aafa6
December 22, 2023
A
docs: add server config docs
Andrei Betlen committed
522aecb
D
[Feat] Multi model support (#931)
Dave committed
12b7f2f