MORPH
SIGN IN SIGN UP
abetlen / llama-cpp-python UNCLAIMED

Python bindings for llama.cpp

0 0 2 Python

COMMITS

/ llama_cpp/llama.py
v0.2.6
September 14, 2023
A
Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.
Andrei Betlen committed
f4090a0
A
Reorder init params to match llama.cpp order
Andrei Betlen committed
6a20293
A
Explicitly make all init params other than model_path into keyword only params
Andrei Betlen committed
c8f9b8a
A
Add kwargs to init to catch extra params
Andrei Betlen committed
a68f9e2
A
remove print
Andrei Betlen committed
9e345a4
A
Convert missed llama.cpp constants into standard python types
Andrei Betlen committed
517f9ed
A
Fix tensor_split cli option
Andrei Betlen committed
c4c440b
September 12, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
1910793
August 29, 2023
A
cjk pr minor cleanup
Andrei Betlen committed
3f76e1d
A
Merge pull request #309 from MeouSker77/fix-CJK
Andrei committed
bae44ec
August 27, 2023
A
Update llama.cpp
Andrei Betlen committed
4887973
A
Update llama.cpp
Andrei Betlen committed
3a29d65
August 25, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
ac47d55
A
Use _with_model variants for tokenization
Andrei Betlen committed
48cf43b
A
Strip leading space when de-tokenizing.
Andrei Betlen committed
8ac5946
August 24, 2023
A
Remove deprecated params
Andrei Betlen committed
4ed632c
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
cf405f6
A
Update llama.cpp
Andrei Betlen committed
bbbf0f4
August 15, 2023
A
Merge branch 'main' of github.com:abetlen/llama_cpp_python into main
Andrei Betlen committed
620cd2f
A
Remove unnused import
Andrei Betlen committed
5788f1f
August 13, 2023
B
make n_gpu_layers=-1 offload all layers
Billy Cao committed
c471871
August 12, 2023
B
Add doc string for n_gpu_layers argument
Billy Cao committed
d018c7b
August 9, 2023
M
fix CJK output again
MeouSker77 committed
88184ed
August 8, 2023
A
Move grammar to function call argument
Andrei Betlen committed
66fb034
A
fix
Andrei Betlen committed
1e844d3
A
Merge branch 'main' into c0sogi/main
Andrei Betlen committed
843b7cc
A
Add mul_mat_q option
Andrei Betlen committed
d015bdb
August 7, 2023
C
reset grammar for every generation
c0sogi committed
b07713c
August 6, 2023
C
Added grammar based sampling
c0sogi committed
418aa83
July 28, 2023
A
Suppress llama.cpp output when loading model.
Andrei Betlen committed
ce57920
A
Format
Andrei Betlen committed
a9b9f03
A
fix: annoying bug where attribute exceptions were droining out file not found exceptions
Andrei Betlen committed
abc538f
July 25, 2023
S
Change tensor_split from array to pointer
Shouyi Wang committed
426dbfe
July 24, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
3434803
A
Add temporary rms_norm_eps parameter
Andrei Betlen committed
11dd2bf
A
Add rms_eps_norm
Andrei Betlen committed
8cd64d4
B
add support for llama2 70b
bretello committed
0f09f10
July 20, 2023
A
Merge branch 'main' into v0.2-wip
Andrei Betlen committed
0538ba1
A
Merge pull request #481 from c0sogi/main
Andrei committed
365d9a4
C
Now the last token sent when `stream=True`
Carlos Tejada committed
0756a2d
July 19, 2023
A
Add functions parameters
Andrei Betlen committed
b43917c
July 18, 2023
A
Use numpy arrays for logits_processors and stopping_criteria. Closes #491
Andrei Betlen committed
19ba9d3
July 16, 2023
C
Added `RouteErrorHandler` for server
c0sogi committed
1551ba1
July 15, 2023
A
Re-order Llama class params
Andrei Betlen committed
8ab098e
A
Merge branch main into custom_rope
Andrei Betlen committed
f0797a6
July 9, 2023
R
Add bindings for custom_rope
randoentity committed
3f8f276
A
bugfix: truncate completion max_tokens to fit context length by default
Andrei Betlen committed
a86bfdf
July 8, 2023
A
Merge branch 'main' into add_unlimited_max_tokens
Andrei committed
5d756de
A
Merge pull request #453 from wu-qing-157/main
Andrei committed
b8e0bed
A
bugfix: fix compatibility bug with openai api on last token
Andrei Betlen committed
d6e6aad