MORPH
SIGN IN SIGN UP
abetlen / llama-cpp-python UNCLAIMED

Python bindings for llama.cpp

0 0 0 Python

COMMITS

/ llama_cpp/llama.py
df31303a12fe4e38cdd5b2dfd57940e3685cef09
November 3, 2023
A
Migrate inference to llama_batch and llama_decode api (#795)
Andrei committed
ab028cb
November 2, 2023
A
Update llama.cpp
Andrei Betlen committed
fa83cc5
A
fix: tokenization of special characters: (#850)
Antoine Lizee committed
4d4e0f1
November 1, 2023
C
llama: fix exception in Llama.__del__ (#846)
cebtenzzre committed
eefd76f
M
fixed Llama._create_completion suffix check, it can be either None or str instance (#854)
Marko Tasic committed
9c8f4dc
October 24, 2023
A
Update llama.cpp
Andrei Betlen committed
53861c9
October 19, 2023
G
Fix streaming doesn't return finish reason (#798)
gmcgoldr committed
09a8406
A
Update llama.cpp
Andrei Betlen committed
ff58003
October 15, 2023
P
Make use of suppress_stdout_stderr when freeing model (#803)
Pierre Alexandre SCHEMBRI committed
10304d7
E
Add validation for tensor_split size exceeding LLAMA_MAX_DEVICES (#820)
Eric Liu committed
b501665
September 30, 2023
A
Fix logits_all bug
Andrei Betlen committed
d696251
A
Fix bug in embedding
Andrei Betlen committed
42bb721
September 29, 2023
A
Configurable Chat Formats (#711)
Andrei committed
3bca770
J
Fix rope scaling defaults (#767)
Josh XT committed
a945404
A
Update llama.cpp
Andrei Betlen committed
1a1c3dc
September 18, 2023
A
Update llama.cpp
Andrei Betlen committed
38e34c9
September 14, 2023
A
Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.
Andrei Betlen committed
f4090a0
A
Reorder init params to match llama.cpp order
Andrei Betlen committed
6a20293
A
Explicitly make all init params other than model_path into keyword only params
Andrei Betlen committed
c8f9b8a
A
Add kwargs to init to catch extra params
Andrei Betlen committed
a68f9e2
A
remove print
Andrei Betlen committed
9e345a4
A
Convert missed llama.cpp constants into standard python types
Andrei Betlen committed
517f9ed
A
Fix tensor_split cli option
Andrei Betlen committed
c4c440b
September 12, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
1910793
August 29, 2023
A
cjk pr minor cleanup
Andrei Betlen committed
3f76e1d
A
Merge pull request #309 from MeouSker77/fix-CJK
Andrei committed
bae44ec
August 27, 2023
A
Update llama.cpp
Andrei Betlen committed
4887973
A
Update llama.cpp
Andrei Betlen committed
3a29d65
August 25, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
ac47d55
A
Use _with_model variants for tokenization
Andrei Betlen committed
48cf43b
A
Strip leading space when de-tokenizing.
Andrei Betlen committed
8ac5946
August 24, 2023
A
Remove deprecated params
Andrei Betlen committed
4ed632c
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
cf405f6
A
Update llama.cpp
Andrei Betlen committed
bbbf0f4
August 15, 2023
A
Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
Andrei Betlen committed
620cd2f
A
Remove unnused import
Andrei Betlen committed
5788f1f
August 13, 2023
B
make n_gpu_layers=-1 offload all layers
Billy Cao committed
c471871
August 12, 2023
B
Add doc string for n_gpu_layers argument
Billy Cao committed
d018c7b
August 9, 2023
M
fix CJK output again
MeouSker77 committed
88184ed
August 8, 2023
A
Move grammar to function call argument
Andrei Betlen committed
66fb034
A
fix
Andrei Betlen committed
1e844d3
A
Merge branch 'main' into c0sogi/main
Andrei Betlen committed
843b7cc
A
Add mul_mat_q option
Andrei Betlen committed
d015bdb
August 7, 2023
C
reset grammar for every generation
c0sogi committed
b07713c
August 6, 2023
C
Added grammar based sampling
c0sogi committed
418aa83
July 28, 2023
A
Suppress llama.cpp output when loading model.
Andrei Betlen committed
ce57920
A
Format
Andrei Betlen committed
a9b9f03
A
fix: annoying bug where attribute exceptions were droining out file not found exceptions
Andrei Betlen committed
abc538f
July 25, 2023
S
Change tensor_split from array to pointer
Shouyi Wang committed
426dbfe
July 24, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
3434803