MORPH
SIGN IN SIGN UP
abetlen / llama-cpp-python UNCLAIMED

Python bindings for llama.cpp

0 0 0 Python

COMMITS

/ llama_cpp/llama.py
a1ac19998014fa499271d382cb58b3316ec64f46
October 15, 2023
E
Add validation for tensor_split size exceeding LLAMA_MAX_DEVICES (#820)
Eric Liu committed
b501665
September 30, 2023
A
Fix logits_all bug
Andrei Betlen committed
d696251
A
Fix bug in embedding
Andrei Betlen committed
42bb721
September 29, 2023
A
Configurable Chat Formats (#711)
Andrei committed
3bca770
J
Fix rope scaling defaults (#767)
Josh XT committed
a945404
A
Update llama.cpp
Andrei Betlen committed
1a1c3dc
September 18, 2023
A
Update llama.cpp
Andrei Betlen committed
38e34c9
September 14, 2023
A
Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.
Andrei Betlen committed
f4090a0
A
Reorder init params to match llama.cpp order
Andrei Betlen committed
6a20293
A
Explicitly make all init params other than model_path into keyword only params
Andrei Betlen committed
c8f9b8a
A
Add kwargs to init to catch extra params
Andrei Betlen committed
a68f9e2
A
remove print
Andrei Betlen committed
9e345a4
A
Convert missed llama.cpp constants into standard python types
Andrei Betlen committed
517f9ed
A
Fix tensor_split cli option
Andrei Betlen committed
c4c440b
September 12, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
1910793
August 29, 2023
A
cjk pr minor cleanup
Andrei Betlen committed
3f76e1d
A
Merge pull request #309 from MeouSker77/fix-CJK
Andrei committed
bae44ec
August 27, 2023
A
Update llama.cpp
Andrei Betlen committed
4887973
A
Update llama.cpp
Andrei Betlen committed
3a29d65
August 25, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
ac47d55
A
Use _with_model variants for tokenization
Andrei Betlen committed
48cf43b
A
Strip leading space when de-tokenizing.
Andrei Betlen committed
8ac5946
August 24, 2023
A
Remove deprecated params
Andrei Betlen committed
4ed632c
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
cf405f6
A
Update llama.cpp
Andrei Betlen committed
bbbf0f4
August 15, 2023
A
Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
Andrei Betlen committed
620cd2f
A
Remove unnused import
Andrei Betlen committed
5788f1f
August 13, 2023
B
make n_gpu_layers=-1 offload all layers
Billy Cao committed
c471871
August 12, 2023
B
Add doc string for n_gpu_layers argument
Billy Cao committed
d018c7b
August 9, 2023
M
fix CJK output again
MeouSker77 committed
88184ed
August 8, 2023
A
Move grammar to function call argument
Andrei Betlen committed
66fb034
A
fix
Andrei Betlen committed
1e844d3
A
Merge branch 'main' into c0sogi/main
Andrei Betlen committed
843b7cc
A
Add mul_mat_q option
Andrei Betlen committed
d015bdb
August 7, 2023
C
reset grammar for every generation
c0sogi committed
b07713c
August 6, 2023
C
Added grammar based sampling
c0sogi committed
418aa83
July 28, 2023
A
Suppress llama.cpp output when loading model.
Andrei Betlen committed
ce57920
A
Format
Andrei Betlen committed
a9b9f03
A
fix: annoying bug where attribute exceptions were droining out file not found exceptions
Andrei Betlen committed
abc538f
July 25, 2023
S
Change tensor_split from array to pointer
Shouyi Wang committed
426dbfe
July 24, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
3434803
A
Add temporary rms_norm_eps parameter
Andrei Betlen committed
11dd2bf
A
Add rms_eps_norm
Andrei Betlen committed
8cd64d4
B
add support for llama2 70b
bretello committed
0f09f10
July 20, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
0538ba1
A
Merge pull request #481 from c0sogi/main
Andrei committed
365d9a4
C
Now the last token sent when `stream=True`
Carlos Tejada committed
0756a2d
July 19, 2023
A
Add functions parameters
Andrei Betlen committed
b43917c
July 18, 2023
A
Use numpy arrays for logits_processors and stopping_criteria. Closes #491
Andrei Betlen committed
19ba9d3
July 16, 2023
C
Added `RouteErrorHandler` for server
c0sogi committed
1551ba1