Commit Graph

Select branches

Hide Pull Requests

abetlen/bump-version-0.3.18

abetlen/fix-cuda-real-arch

abetlen/fix-hf-download-checks

abetlen/fix-macos-runner-label

abetlen/setup-ruff

abetlen/update-llama-cpp-bindings

add-paligemma-support

batch-processing

binary-wheels

dependabot/github_actions/conda-incubator/setup-miniconda-3.1.1

dependabot/github_actions/pypa/cibuildwheel-2.23.2

dependabot/pip/starlette-context-gte-0.3.6-and-lt-0.5

dev-add-rpc

docker

expose-libggml

fix-embeddings-for-non-embedding-models

fix-windows-import-error

generic-vlm-chat-format

main

patch-1

patch-3

remove-unwanted-bos

update-sampling-api

#10

#1002

#1005

#1007

#1010

#1011

#1012

#1015

#1019

#1021

#1023

#1028

#1037

#1050

#1052

#1058

#1059

#1067

#1067

#1068

#1078

#108

#1080

#1080

#1086

#1087

#1088

#1090

#1092

#1093

#1106

#1106

#111

#1110

#1115

#1116

#1120

#1122

#1131

#1136

#1147

#1156

#1157

#1160

#1160

#1170

#1170

#1172

#1175

#1176

#1179

#118

#1184

#1186

#1187

#1188

#119

#1193

#1194

#1205

#1206

#1209

#1209

#1210

#1212

#1212

#1214

#1222

#1230

#1232

#1244

#1246

#1247

#1248

#125

#1257

#126

#1263

#1264

#1272

#1273

#1281

#1281

#1282

#1289

#1295

#1296

#130

#1307

#1311

#1317

#1330

#1331

#1331

#1333

#1345

#1347

#135

#1350

#1351

#1351

#1353

#1364

#137

#1370

#1371

#1374

#1374

#1375

#1380

#1382

#1382

#1383

#1383

#1385

#1386

#1387

#1388

#139

#1390

#1391

#1392

#1396

#1397

#1398

#1399

#140

#1400

#1401

#1407

#1407

#1408

#1409

#1410

#1411

#1412

#1413

#1415

#1416

#1419

#1424

#1426

#1427

#1427

#1430

#1432

#1433

#1434

#1439

#144

#144

#1440

#1440

#1441

#1444

#1448

#1449

#1453

#1457

#1459

#146

#146

#1462

#1465

#1471

#1472

#1476

#1477

#1486

#1486

#1492

#1493

#1497

#15

#1503

#1503

#1509

#1509

#1513

#1514

#1515

#1515

#1516

#1522

#1525

#1526

#1527

#153

#1530

#1539

#154

#1544

#1550

#1550

#1551

#1552

#1552

#156

#1568

#1569

#157

#1576

#1583

#1583

#1585

#1589

#1590

#1594

#1596

#1597

#160

#1605

#1605

#161

#1613

#1613

#162

#1626

#163

#1630

#1632

#1633

#1634

#1635

#1637

#164

#1649

#165

#1651

#1651

#1653

#1656

#1657

#1658

#1659

#1667

#1668

#1673

#1677

#1677

#1679

#168

#1680

#1704

#1716

#1716

#1718

#1718

#172

#172

#1721

#173

#1738

#1739

#1739

#1741

#1742

#1743

#1750

#1751

#1758

#1758

#176

#176

#1761

#177

#1775

#1776

#1776

#1777

#1777

#178

#1782

#1782

#1783

#1786

#1786

#1788

#1790

#1791

#1791

#1793

#1795

#1796

#1798

#1800

#1800

#1802

#1807

#1817

#1817

#1819

#1820

#1820

#1821

#1825

#1825

#1833

#1834

#1834

#1838

#1842

#1842

#1843

#1843

#1844

#1845

#1858

#1862

#1864

#1864

#1867

#1867

#1871

#1877

#1877

#1878

#1878

#1879

#1884

#1884

#1887

#1887

#189

#1894

#1898

#1899

#1899

#190

#1901

#191

#1911

#1911

#1912

#1959

#1961

#1961

#1966

#1971

#1971

#1973

#1974

#1978

#198

#198

#1980

#1981

#1981

#1989

#1989

#1991

#1991

#2007

#2007

#2009

#2015

#2015

#2018

#2018

#2025

#2025

#2027

#203

#2030

#2034

#2034

#2039

#2039

#2040

#2041

#2041

#2042

#2042

#2044

#2044

#2046

#2049

#2056

#2056

#2058

#2058

#2059

#2059

#2066

#2066

#2071

#2071

#2072

#2072

#2077

#2082

#2082

#2083

#2083

#2085

#2085

#2088

#2088

#2099

#2099

#2100

#2102

#2102

#2108

#2108

#2109

#2109

#2112

#212

#2120

#2120

#2121

#2121

#2128

#2128

#2129

#2129

#2131

#2131

#2132

#2133

#2134

#2134

#2139

#214

#2141

#2141

#2143

#2147

#2147

#2148

#2149

#215

#2150

#2151

#2152

#2153

#2154

#2155

#2156

#2157

#2158

#2160

#2161

#2162

#2164

#2164

#217

#225

#235

#240

#246

#248

#249

#251

#252

#258

#262

#263

#264

#265

#270

#271

#274

#277

#28

#289

#29

#292

#293

#294

#295

#296

#297

#309

#310

#322

#323

#324

#325

#326

#328

#329

#329

#350

#351

#359

#360

#365

#366

#367

#368

#370

#376

#385

#390

#392

#402

#405

#41

#414

#414

#415

#42

#420

#429

#430

#431

#432

#435

#436

#442

#443

#444

#452

#453

#456

#460

#466

#481

#485

#486

#498

#499

#50

#501

#505

#505

#508

#511

#516

#517

#517

#521

#522

#523

#525

#530

#531

#532

#536

#540

#540

#548

#549

#55

#550

#551

#556

#564

#565

#567

#572

#573

#575

#575

#577

#583

#584

#594

#594

#598

#600

#604

#61

#610

#611

#612

#621

#624

#624

#625

#63

#631

#631

#633

#64

#644

#647

#648

#667

#668

#669

#670

#671

#678

#678

#680

#682

#684

#688

#690

#691

#692

#694

#694

#703

#704

#705

#709

#709

#711

#713

#716

#716

#73

#730

#733

#733

#748

#752

#752

#76

#767

#768

#772

#778

#781

#783

#784

#790

#795

#798

#799

#803

#808

#809

#820

#821

#824

#824

#826

#83

#834

#835

#842

#843

#843

#846

#848

#849

#850

#851

#854

#855

#864

#868

#868

#869

#87

#875

#892

#913

#913

#920

#921

#922

#922

#925

#927

#93

#930

#931

#934

#936

#937

#938

#940

#947

#951

#951

#952

#955

#955

#957

#958

#961

#962

#962

#967

#98

#986

#991

#993

#993

#994

#996

v0.1.29

v0.1.30

v0.1.31

v0.1.32

v0.1.33

v0.1.34

v0.1.35

v0.1.36

v0.1.37

v0.1.38

v0.1.39

v0.1.40

v0.1.41

v0.1.42

v0.1.43

v0.1.44

v0.1.45

v0.1.46

v0.1.47

v0.1.48

v0.1.49

v0.1.50

v0.1.51

v0.1.52

v0.1.53

v0.1.54

v0.1.55

v0.1.56

v0.1.57

v0.1.59

v0.1.60

v0.1.61

v0.1.62

v0.1.63

v0.1.64

v0.1.65

v0.1.66

v0.1.67

v0.1.68

v0.1.69

v0.1.70

v0.1.71

v0.1.72

v0.1.73

v0.1.74

v0.1.75

v0.1.76

v0.1.77

v0.1.78

v0.1.79

v0.1.80

v0.1.81

v0.1.82

v0.1.83

v0.1.84

v0.1.85

v0.2.0

v0.2.1

v0.2.10

v0.2.11

v0.2.12

v0.2.13

v0.2.14

v0.2.15

v0.2.16

v0.2.17

v0.2.18

v0.2.19

v0.2.2

v0.2.20

v0.2.21

v0.2.22

v0.2.23

v0.2.24

v0.2.25

v0.2.26

v0.2.27

v0.2.28

v0.2.29

v0.2.3

v0.2.30

v0.2.31

v0.2.32

v0.2.33

v0.2.34

v0.2.35

v0.2.36

v0.2.37

v0.2.38

v0.2.39

v0.2.4

v0.2.40

v0.2.41

v0.2.42

v0.2.43

v0.2.44

v0.2.45

v0.2.46

v0.2.47

v0.2.48

v0.2.49

v0.2.5

v0.2.50

v0.2.51

v0.2.52

v0.2.53

v0.2.54

v0.2.55

v0.2.56

v0.2.57

v0.2.58

v0.2.59

v0.2.59-cu121

v0.2.59-cu122

v0.2.59-cu123

v0.2.59-metal

v0.2.6

v0.2.60

v0.2.60-cu121

v0.2.60-cu122

v0.2.60-cu123

v0.2.60-metal

v0.2.61

v0.2.61-cu121

v0.2.61-cu122

v0.2.61-cu123

v0.2.61-metal

v0.2.62

v0.2.62-cu121

v0.2.62-cu122

v0.2.62-cu123

v0.2.62-metal

v0.2.63

v0.2.63-cu121

v0.2.63-cu122

v0.2.63-cu123

v0.2.63-metal

v0.2.64

v0.2.64-cu121

v0.2.64-cu122

v0.2.64-cu123

v0.2.64-metal

v0.2.65

v0.2.65-cu121

v0.2.65-cu122

v0.2.65-cu123

v0.2.65-metal

v0.2.66

v0.2.66-cu121

v0.2.66-cu122

v0.2.66-cu123

v0.2.66-cu124

v0.2.66-metal

v0.2.67

v0.2.67-cu121

v0.2.67-cu122

v0.2.67-cu123

v0.2.67-cu124

v0.2.67-metal

v0.2.68

v0.2.68-cu121

v0.2.68-cu122

v0.2.68-cu123

v0.2.68-cu124

v0.2.68-metal

v0.2.69

v0.2.69-cu121

v0.2.69-cu122

v0.2.69-cu123

v0.2.69-cu124

v0.2.69-metal

v0.2.7

v0.2.70

v0.2.70-cu121

v0.2.70-cu122

v0.2.70-cu123

v0.2.70-cu124

v0.2.70-metal

v0.2.71

v0.2.71-cu121

v0.2.71-cu122

v0.2.71-cu123

v0.2.71-cu124

v0.2.71-metal

v0.2.72

v0.2.72-cu121

v0.2.72-cu122

v0.2.72-cu123

v0.2.72-cu124

v0.2.72-metal

v0.2.73

v0.2.73-cu121

v0.2.73-cu122

v0.2.73-cu123

v0.2.73-cu124

v0.2.73-metal

v0.2.74

v0.2.74-cu121

v0.2.74-cu122

v0.2.74-cu123

v0.2.74-cu124

v0.2.74-metal

v0.2.75

v0.2.75-cu121

v0.2.75-cu122

v0.2.75-cu123

v0.2.75-cu124

v0.2.75-metal

v0.2.76

v0.2.76-cu121

v0.2.76-cu122

v0.2.76-cu123

v0.2.76-cu124

v0.2.76-metal

v0.2.77

v0.2.77-cu121

v0.2.77-cu122

v0.2.77-cu123

v0.2.77-cu124

v0.2.77-metal

v0.2.78

v0.2.78-metal

v0.2.79

v0.2.79-metal

v0.2.8

v0.2.80

v0.2.80-metal

v0.2.81

v0.2.81-cu121

v0.2.81-cu122

v0.2.81-cu123

v0.2.81-cu124

v0.2.81-metal

v0.2.82

v0.2.82-cu121

v0.2.82-cu122

v0.2.82-cu123

v0.2.82-cu124

v0.2.82-metal

v0.2.83

v0.2.83-cu121

v0.2.83-cu122

v0.2.83-cu123

v0.2.83-cu124

v0.2.83-metal

v0.2.84

v0.2.84-cu121

v0.2.84-cu122

v0.2.84-cu123

v0.2.84-cu124

v0.2.84-metal

v0.2.85

v0.2.85-cu121

v0.2.85-cu122

v0.2.85-cu123

v0.2.85-cu124

v0.2.85-metal

v0.2.86

v0.2.86-cu121

v0.2.86-cu122

v0.2.86-cu123

v0.2.86-cu124

v0.2.86-metal

v0.2.87

v0.2.87-cu121

v0.2.87-cu122

v0.2.87-cu123

v0.2.87-cu124

v0.2.87-metal

v0.2.88

v0.2.88-cu121

v0.2.88-cu122

v0.2.88-cu123

v0.2.88-cu124

v0.2.88-metal

v0.2.89

v0.2.89-cu121

v0.2.89-cu124

v0.2.89-metal

v0.2.9

v0.2.90

v0.2.90-cu121

v0.2.90-cu122

v0.2.90-cu123

v0.2.90-cu124

v0.2.90-metal

v0.3.0

v0.3.0-metal

v0.3.1

v0.3.1-metal

v0.3.10

v0.3.11

v0.3.11-metal

v0.3.12

v0.3.12-cu121

v0.3.12-cu122

v0.3.12-cu123

v0.3.12-cu124

v0.3.12-metal

v0.3.13

v0.3.13-cu121

v0.3.13-cu122

v0.3.13-cu123

v0.3.13-cu124

v0.3.13-metal

v0.3.14

v0.3.14-cu124

v0.3.14-metal

v0.3.15

v0.3.15-cu121

v0.3.15-cu122

v0.3.15-cu123

v0.3.15-cu124

v0.3.15-metal

v0.3.16

v0.3.16-cu121

v0.3.16-cu122

v0.3.16-cu123

v0.3.16-cu124

v0.3.16-metal

v0.3.17

v0.3.17-metal

v0.3.18

v0.3.18-cu121

v0.3.18-cu122

v0.3.18-cu123

v0.3.18-cu124

v0.3.18-metal

v0.3.19

v0.3.19-cu121

v0.3.19-cu122

v0.3.19-cu123

v0.3.19-cu124

v0.3.19-metal

v0.3.2

v0.3.2-metal

v0.3.3

v0.3.4

v0.3.4-cu121

v0.3.4-cu122

v0.3.4-cu123

v0.3.4-cu124

v0.3.4-metal

v0.3.5

v0.3.5-metal

v0.3.6

v0.3.7

v0.3.8

v0.3.9

Mono Color

• 6889429fca Merge branch 'main' of github.com:abetlen/llama-cpp-python into main Andrei Betlen 2024-12-06 07:36:51 -05:00
• df136cb3c7 misc: Update development Makefile Andrei Betlen 2024-12-06 07:36:47 -05:00
• 4f0ec659f9 fix: chat API logprobs format (#1788) Adam Jones 2024-12-06 12:35:46 +00:00
• d610477a06 fix(examples): Refactor Batching notebook to use new sampler chain API (#1793) Luke Stanley 2024-12-06 10:22:26 +00:00
• 1ea615424b fix(docs): Update development instructions (#1833) Florents Tselai 2024-12-06 12:11:50 +02:00
• 9bd0c95424 fix: Avoid thread starvation on many concurrent requests by making use of asyncio to lock llama_proxy context (#1798) Graeme Power 2024-12-06 10:03:41 +00:00
• 073b7e421e fix: added missing exit_stack.close() to /v1/chat/completions (#1796) Ignaz "Ian" Kraft 2024-12-06 11:02:34 +01:00
• 77a12a3966 fix: Re-add suport for CUDA 12.5, add CUDA 12.6 (#1775) Olivier DEBAUCHE 2024-12-06 11:01:17 +01:00
• 4192210232 fix: make content not required in ChatCompletionRequestAssistantMessage (#1807) Philippe Martin 2024-12-06 10:47:38 +01:00
• 38fbd2968d docs: Remove ref to llama_eval in llama_cpp.py docs (#1819) Rich Dougherty 2024-12-06 22:41:52 +13:00
• fa04cdc497 fix logit-bias type hint (#1802) ddh0 2024-12-06 03:40:47 -06:00
• ddac04c78e chore(deps): bump conda-incubator/setup-miniconda from 3.0.4 to 3.1.0 (#1821) dependabot[bot] 2024-12-06 04:39:27 -05:00
• d553a54333 Merge branch 'main' of github.com:abetlen/llama-cpp-python into main Andrei Betlen 2024-12-06 04:37:02 -05:00
• 2523472c3e fix: Fix pickling of Llama class by setting seed from _seed member. Closes #1769 Andrei Betlen 2024-12-06 04:36:22 -05:00
• 27953036b1 chore(deps): bump pypa/cibuildwheel from 2.21.1 to 2.22.0 (#1844) dependabot[bot] 2024-12-06 04:32:37 -05:00
• 991d9cde1b fix(ci): Remove CUDA 12.5 from index Andrei Betlen 2024-12-06 04:32:19 -05:00
• 4f17ae5af0 fix(ci): Remove cuda version 12.5.0 incompatibility with VS (#1838) PΛBLØ ᄃΞ 2024-12-06 04:31:01 -05:00
• d5d50990d0 fix(ci): Update CMakeLists.txt for macos Andrei Betlen 2024-12-06 04:14:59 -05:00
• d8cc231fd0 fix(ci): Use default architecture chosen by action Andrei Betlen 2024-12-06 04:06:07 -05:00
• b34f20046b fix(ci): Use python3 Andrei Betlen 2024-12-06 03:59:51 -05:00
• 1cd3f2cc6a fix(ci): gg Andrei Betlen 2024-12-06 03:52:54 -05:00
• df05096fc5 fix(ci): Install with regular pip Andrei Betlen 2024-12-06 03:42:33 -05:00
• a412ba5539 fix(ci): Update config Andrei Betlen 2024-12-06 03:38:12 -05:00
• 9a09fc7848 fix(ci): Debug print python system architecture Andrei Betlen 2024-12-06 03:19:36 -05:00
• f11a781d86 fix(ci): Use macos-13 runner Andrei Betlen 2024-12-06 03:04:48 -05:00
• 8988aaf7f6 fix(ci): Use macos-14 runner Andrei Betlen 2024-12-06 03:02:04 -05:00
• 72ed7b8855 fix(ci): Explicitly test on arm64 macos runner Andrei Betlen 2024-12-06 02:55:57 -05:00
• fb0b8fefd4 fix(ci): Explicitly set cmake osx architecture Andrei Betlen 2024-12-06 02:53:06 -05:00
• 9d06e36c00 fix(ci): Explicitly install arm64 python version Andrei Betlen 2024-12-06 02:49:20 -05:00
• 7ba257e5da feat: Update llama.cpp Andrei Betlen 2024-12-06 02:33:55 -05:00
• f3fb90b114 feat: Update llama.cpp Andrei Betlen 2024-11-28 18:27:55 -05:00
• 7ecdd94462 chore: Bump version v0.3.2-metal v0.3.2 Andrei Betlen 2024-11-15 19:55:09 -05:00
• 2796f4e62f Add all missing ggml dependencies Andrei Betlen 2024-11-15 19:31:12 -05:00
• d1cb50b49f Add missing ggml dependency Andrei Betlen 2024-11-15 19:26:16 -05:00
• cafa33e1a8 feat: Update llama.cpp Andrei Betlen 2024-11-15 18:00:30 -05:00
• e712cffc0c feat: Update llama.cpp Andrei Betlen 2024-10-31 13:50:18 -04:00
• 7403e002b8 feat: Update llama.cpp Andrei Betlen 2024-10-22 09:33:48 -04:00
• 2181912c75 Update chat handler name to PaliGemmaChatHandler add-paligemma-support Andrei Betlen 2024-10-02 13:43:57 -04:00
• 9558b22fa4 Add paligemma server support Andrei Betlen 2024-10-02 04:50:18 -04:00
• 08cc0b822b Add Paligemma support Andrei Betlen 2024-10-02 04:39:24 -04:00
• 7c4aead82d chore: Bump version v0.3.1-metal v0.3.1 Andrei Betlen 2024-09-29 15:26:54 -04:00
• 57e70bb569 feat: Update llama.cpp Andrei Betlen 2024-09-29 15:23:24 -04:00
• 01c76078ee feat: Expose libggml in internal APIs (#1761) Andrei 2024-09-26 11:23:00 -04:00
• b4a8a0c8ab Use ctypes_extensions module for libllama and libllava expose-libggml Andrei Betlen 2024-09-26 11:12:03 -04:00
• eb160720bf Merge branch 'main' into expose-libggml Andrei 2024-09-26 10:09:43 -04:00
• dca0c9a09c feat: Update llama.cpp Andrei Betlen 2024-09-26 10:09:22 -04:00
• e975dabf74 fix: Additional fixes for speculative decoding Andrei Betlen 2024-09-26 01:11:02 -04:00
• 11d9562fd6 misc: Rename all_text to remaining_text (#1658) Xu Song 2024-09-26 12:37:17 +08:00
• 9992c5084a fix: Fix speculative decoding Andrei Betlen 2024-09-26 00:34:21 -04:00
• 2c260b9e3a Only expose libggml Andrei Betlen 2024-09-25 16:03:30 -04:00
• 1aa39910aa Merge branch 'main' into expose-libggml Andrei 2024-09-25 15:47:03 -04:00
• 65222bc493 fix: install build dependency v0.3.0 Andrei Betlen 2024-09-25 14:27:19 -04:00
• 8e07db0f87 fix: install build dependency v0.3.0-metal Andrei Betlen 2024-09-25 14:17:04 -04:00
• b3dfb420e7 chore: Bump version Andrei Betlen 2024-09-25 14:05:08 -04:00
• c94bdc45da Expose libggml and refactor ctypes extension Andrei Betlen 2024-09-25 13:31:31 -04:00
• 926b4143e8 feat: Update llama.cpp Andrei Betlen 2024-09-25 13:23:18 -04:00
• 4744551b3b feat: Update llama.cpp Andrei Betlen 2024-09-21 20:53:16 -04:00
• 1324c0c50c chore(deps): bump actions/cache from 3 to 4 (#1751) dependabot[bot] 2024-09-20 18:04:59 -04:00
• 49b1e7379f docs: Add cuda 12.5 to README.md (#1750) Olivier DEBAUCHE 2024-09-21 00:04:34 +02:00
• 6c44a3f36b feat: Add option to configure n_ubatch Andrei Betlen 2024-09-20 18:03:37 -04:00
• 47d7a62133 feat: Update llama.cpp Andrei Betlen 2024-09-20 18:02:11 -04:00
• 84c092063e feat: Add loading sharded GGUF files from HuggingFace with Llama.from_pretrained(additional_files=[...]) . Closes #1341 Jonathan Jordan 2024-09-19 05:09:01 +02:00
• 29afcfdff5 fix: Don't store scores internally unless logits_all=True. Reduces memory requirements for large context. Closes #1542 Andrei Betlen 2024-09-18 23:04:59 -04:00
• 22cedad8a9 fix: Fix memory allocation of ndarray (#1704) Xu Song 2024-09-19 10:11:01 +08:00
• 8306d1cb88 Improve LlamaState test and fix rng / seed patch-3 Andrei Betlen 2024-09-18 22:08:12 -04:00
• e552955217 Add basic LlamaState tests Andrei Betlen 2024-09-18 21:11:05 -04:00
• 0b64530ff4 Merge branch 'main' into patch-3 Andrei 2024-09-18 20:53:10 -04:00
• 9b64bb5b13 misc: Format Andrei Betlen 2024-09-18 20:11:02 -04:00
• 1e64664e0f feat: Update llama.cpp Andrei Betlen 2024-09-18 20:07:48 -04:00
• d8dbdfd1b0 Merge branch 'main' into patch-3 Andrei 2024-09-18 20:04:19 -04:00
• f8fcb3ea34 feat: Update sampling API for llama.cpp (#1742) Andrei 2024-09-18 20:00:19 -04:00
• 7455b9f023 Merge branch 'update-sampling-api' of github.com:abetlen/llama-cpp-python into update-sampling-api update-sampling-api Andrei Betlen 2024-09-18 19:59:55 -04:00
• 334ca35b71 Add actual logit processor test Andrei Betlen 2024-09-18 19:59:40 -04:00
• 2e4c826888 Merge branch 'main' into update-sampling-api Andrei 2024-09-18 19:42:40 -04:00
• 2102eb909c Remove RUST_LOG=trace Andrei Betlen 2024-09-18 19:32:18 -04:00
• 4f222b24e6 Merge branch 'main' into patch-3 Andrei 2024-09-18 19:27:27 -04:00
• a4e1451abe chore(deps): bump pypa/cibuildwheel from 2.20.0 to 2.21.1 (#1743) dependabot[bot] 2024-09-18 19:26:51 -04:00
• 903781a5f8 Merge branch 'main' into update-sampling-api Andrei 2024-09-18 19:26:22 -04:00
• 0cff3d07fe Add huggingface-hub as a test dependency Andrei Betlen 2024-09-18 19:23:31 -04:00
• e529940f45 feat(ci): Speed up CI workflows using uv, add support for CUDA 12.5 wheels Olivier DEBAUCHE 2024-09-19 01:22:05 +02:00
• 2897fc2b7a Use real model for tests Andrei Betlen 2024-09-18 19:15:47 -04:00
• 56c1f4501e Update cache version Andrei Betlen 2024-09-18 19:10:15 -04:00
• de267c78ff Fix typo Andrei Betlen 2024-09-18 18:10:41 -04:00
• 4cfb46d515 Fix typo Andrei Betlen 2024-09-18 18:08:44 -04:00
• d4fde4c9ee Use Qwen2 0.5B for ci tests Andrei Betlen 2024-09-18 18:07:08 -04:00
• aa91ec0f16 Remove unnused test Andrei Betlen 2024-09-18 12:03:23 -04:00
• ba1f1b246a Add sampling chain Andrei Betlen 2024-09-18 11:24:59 -04:00
• a757e2b033 Remove seed Andrei Betlen 2024-09-17 13:32:58 -04:00
• 172fb0aa0d Update Andrei Betlen 2024-09-17 13:31:11 -04:00
• 0e650282e4 Update tests Andrei Betlen 2024-09-15 16:18:20 -04:00
• f9db9b74f1 Fix logger Andrei Betlen 2024-09-15 16:13:10 -04:00
• 7893c8fce2 Initial samplng api update Andrei Betlen 2024-09-15 16:07:04 -04:00
• c032fc65b0 feat: Update llama.cpp Andrei Betlen 2024-09-06 04:12:29 -04:00
• 9497bcd6da feat: Update llama.cpp Andrei Betlen 2024-09-04 23:01:55 -04:00
• c3fc80a2cf feat: Update llama.cpp Andrei Betlen 2024-09-01 21:06:18 -04:00
• 9769e5719a feat: Update llama.cpp Andrei Betlen 2024-08-31 08:59:41 -04:00
• dcb0d0cf2a feat: Update llama.cpp Andrei Betlen 2024-08-30 00:33:58 -04:00
• 98eb092d3c fix: Use system message in og qwen format. Closes #1697 Andrei Betlen 2024-08-30 00:14:49 -04:00
• d981d32dac feat: Enable detokenizing special tokens with special=True (#1596) benniekiss 2024-08-29 13:04:00 -04:00
• 9cba3b8198 docs: Update README Andrei Betlen 2024-08-29 12:41:28 -04:00