Morph MORPH
SIGN IN SIGN UP
abetlen / llama-cpp-python UNCLAIMED

Python bindings for llama.cpp

0 0 45 Python

COMMITS

/ llama_cpp/server/app.py
dev-add-rpc
May 14, 2024
T
feat: add MinTokensLogitProcessor and min_tokens argument to server (#1333)
twaka committed
5212fb0
May 5, 2024
A
feat(server): Add support for setting root_path. Closes #1420
Andrei Betlen committed
0318702
April 17, 2024
K
feat: add `disable_ping_events` flag (#1257)
khimaros committed
b73c73c
April 10, 2024
A
feat: Add support for yaml based configs
Andrei Betlen committed
060bfa6
March 31, 2024
W
feat: Add logprobs support to chat completions (#1311)
windspirit95 committed
aa9f1ae
March 23, 2024
A
fix(server): minor type fixes
Andrei Betlen committed
d11ccc3
March 19, 2024
A
docs: Add chat examples to openapi ui
Andrei Betlen committed
f7decc9
March 9, 2024
F
feat: Add endpoints for tokenize, detokenize and count tokens (#1136)
Felipe Lorenz committed
c139f8b
February 28, 2024
A
misc: Format
Andrei Betlen committed
727d60c
February 15, 2024
K
fix: Use '\n' seperator for EventSourceResponse (#1188)
khimaros committed
ea1f88d
January 25, 2024
A
feat(server): include llama-cpp-python version in openapi spec
Andrei Betlen committed
cde7514
January 16, 2024
A
Support Accept text/event-stream in chat and completion endpoints, resolves #1083 (#1088)
anil committed
cfb7da9
December 22, 2023
D
[Feat] Multi model support (#931)
Dave committed
12b7f2f
December 21, 2023
D
Implement openai api compatible authentication (#1010)
docmeth02 committed
33cc623
December 18, 2023
A
Add offload_kqv option to llama and server
Andrei Betlen committed
095c650
B
Bugfix: Remove f16_kv, add offload_kqv field (#1019)
Brandon Roberts committed
62944df
December 12, 2023
R
Add support for running the server with SSL (#994)
Radoslav Gerganov committed
8e44a32
November 24, 2023
A
docs: Update openapi endpoint names
Andrei Betlen committed
1a7bf20
November 21, 2023
A
Fix #569
Andrei Betlen committed
128dc47
A
Format
Andrei Betlen committed
7a3f878
A
Add support for logit_bias outside of server api. Closes #827
Andrei Betlen committed
07e47f5
T
Added support for min_p (#921)
TK-Master committed
b8438f7
November 10, 2023
A
Fix: default max_tokens matches openai api (16 for completion, max length for chat completion)
Andrei Betlen committed
e7962d2
November 8, 2023
A
Fix destructor NoneType is not callable error
Andrei Betlen committed
ca4cb88
A
Add JSON mode support. Closes #881
Andrei Betlen committed
b30b9c3
A
Add seed parameter support for completion and chat_completion requests. Closes #884
Andrei Betlen committed
86aeb9f
D
Multimodal Support (Llava 1.5) (#821)
Damian Stewart committed
aab74f0
November 3, 2023
A
Update llama.cpp
Andrei Betlen committed
df9362e
A
Add functionary support (#784)
Andrei committed
3af7b21
November 2, 2023
A
Update llama.cpp
Andrei Betlen committed
fa83cc5
A
fix: tokenization of special characters: (#850)
Antoine Lizee committed
4d4e0f1
November 1, 2023
D
Iterate over tokens that should be biased rather than the entire vocabulary. (#851)
David Ponce committed
3fc9147
D
Pass-Through grammar parameter in web server. (#855) Closes #778
Daniel Thuerck committed
5f8f369
October 18, 2023
X
update value check for n_gpu_layers field (#826)
Xiaoyu Kevin Hu committed
a315128
October 10, 2023
A
Print traceback on server error
Andrei Betlen committed
d6a130a
September 30, 2023
A
Log server exceptions to stdout
Andrei Betlen committed
5ef5280
September 29, 2023
A
Update server params
Andrei Betlen committed
d9bce17
September 25, 2023
V
Adds openai-processing-ms response header (#748)
Viacheslav/Slava Tradunsky committed
3d5e5b1
September 14, 2023
E
Update app.py (#705)
earonesty committed
58a6e42
A
Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.
Andrei Betlen committed
f4090a0
A
Format
Andrei Betlen committed
4daf77e
A
Update server params. Added lora_base, lora_path, low_vram, and main_gpu. Removed rms_norm_eps and n_gqa (deprecated in llama.cpp)
Andrei Betlen committed
2920c4b
September 13, 2023
D
Add X-Request-ID request header for mirroring custom IDs. (#703)
Devrim committed
da9df78
September 12, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
1910793
August 25, 2023
A
Add copilot-codex completions endpoint for drop-in copilot usage
Andrei Betlen committed
5de8009
August 24, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
cf405f6
August 8, 2023
A
Add mul_mat_q option
Andrei Betlen committed
d015bdb
July 24, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
3434803
A
Add temporary rms_norm_eps parameter
Andrei Betlen committed
11dd2bf
July 20, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
0538ba1