Commit Graph

  • d410f12fae Update docs. Closes #386 Andrei Betlen 2023-06-17 13:38:48 -04:00
  • 9f528f4715 Merge branch 'main' of github.com:abetlen/llama_cpp_python into main Andrei Betlen 2023-06-17 13:37:17 -04:00
  • 60426b23cc Update llama.cpp Andrei Betlen 2023-06-17 13:37:14 -04:00
  • 036548365f added termux with root instructions SubhranshuSharma 2023-06-17 14:50:07 +05:30
  • ff9faaa48b Merge pull request #385 from nb-programmer/main Andrei 2023-06-16 23:12:39 -04:00
  • d7153abcf8 Update llama.cpp Andrei Betlen 2023-06-16 23:11:14 -04:00
  • 37d5192a92 Update docs Andrei Betlen 2023-06-16 10:41:51 -04:00
  • fd9f294b3a Update llama.py: Added how many input tokens in ValueError exception imaprogrammer 2023-06-16 14:11:57 +05:30
  • d938e59003 Bump version v0.1.63 Andrei Betlen 2023-06-14 22:15:44 -04:00
  • 54e2e4ffde Move metal docs to metal section of README. Andrei Betlen 2023-06-14 22:15:22 -04:00
  • 1e20be6d0c Add low_vram to server settings Andrei Betlen 2023-06-14 22:13:42 -04:00
  • 44b83cada5 Add low_vram parameter Andrei Betlen 2023-06-14 22:12:33 -04:00
  • f7c5cfaf50 Format server options Andrei Betlen 2023-06-14 22:08:28 -04:00
  • 9c41a3e990 Merge branch 'main' of github.com:abetlen/llama_cpp_python into main Andrei Betlen 2023-06-14 21:50:43 -04:00
  • f568baeef1 Merge pull request #351 from player1537-forks/th/add-logits-bias-parameter Andrei 2023-06-14 21:49:56 -04:00
  • abf6d4a0a1 Merge pull request #367 from ianscrivener/ianscrivener-macos-install-md-docs Andrei 2023-06-14 21:48:04 -04:00
  • 243c6fdca0 Merge pull request #368 from mattdennewitz/patch-1 Andrei 2023-06-14 21:47:16 -04:00
  • f27393ab7e Add additional verbose logs for cache Andrei Betlen 2023-06-14 21:46:48 -04:00
  • 4cefb70cd0 Merge branch 'main' of github.com:abetlen/llama_cpp_python into main Andrei Betlen 2023-06-14 21:40:19 -04:00
  • 715f98c591 Update llama.cpp Andrei Betlen 2023-06-14 21:40:13 -04:00
  • 6517900623 Merge pull request #360 from Orfeous/main Andrei 2023-06-14 00:25:04 -04:00
  • 4121d03c0a Merge pull request #366 from abetlen/dependabot/pip/pytest-7.3.2 Andrei 2023-06-14 00:24:27 -04:00
  • fe41cb9043 Bump pytest from 7.3.1 to 7.3.2 dependabot[bot] 2023-06-13 15:07:50 +00:00
  • e722bc703f Merge pull request #365 from abetlen/dependabot/pip/fastapi-0.97.0 Andrei 2023-06-13 11:06:46 -04:00
  • 10b0cb727b fix: Make LLamaState pickable for disk cache Okabintaro 2023-06-13 12:03:31 +02:00
  • 613dd70c8a Update README.md Matt Dennewitz 2023-06-13 00:56:05 -05:00
  • 7ca50a3e45 Update README.md Ian Scrivener 2023-06-13 09:52:22 +10:00
  • 94f63a66b9 Create macos_install.md Ian Scrivener 2023-06-13 09:49:19 +10:00
  • efcf380490 Bump fastapi from 0.96.0 to 0.97.0 dependabot[bot] 2023-06-12 21:03:40 +00:00
  • 3129a0e7e5 correction to add back environment variable support <3 docker Gabor 2023-06-11 01:11:24 +01:00
  • 3ea31930e5 fixes abetlen/llama-cpp-python #358 Gabor 2023-06-11 00:58:08 +01:00
  • ad4479e609 Merge pull request #359 from matthoffner/main Andrei 2023-06-10 19:31:40 -04:00
  • 4eb245afd8 Update README.md Matt Hoffner 2023-06-10 15:59:26 -07:00
  • 74fbaae157 Bump version v0.1.62 Andrei Betlen 2023-06-10 18:19:48 -04:00
  • 6e302c6ee8 Update makefile and gitignore Andrei Betlen 2023-06-10 18:17:34 -04:00
  • c1eaef329a Add resource destination to cmake Andrei Betlen 2023-06-10 18:11:48 -04:00
  • 890ae442b9 Update llama.cpp Andrei Betlen 2023-06-10 18:10:01 -04:00
  • bf2bfec615 Update changelog Andrei Betlen 2023-06-10 12:22:39 -04:00
  • 21acd7901f Re-enable cache Andrei Betlen 2023-06-10 12:22:31 -04:00
  • 6639371407 Update llama.cpp Andrei Betlen 2023-06-10 12:17:38 -04:00
  • 6b764cab80 Bump version v0.1.61 Andrei Betlen 2023-06-09 23:25:38 -04:00
  • e3542b6627 Revert "Merge pull request #350 from abetlen/migrate-to-scikit-build-core" Andrei Betlen 2023-06-09 23:23:16 -04:00
  • 3c6e1b6c42 Update to smoketest Andrei Betlen 2023-06-09 19:08:15 -04:00
  • d4aed351e3 Run on workflow_dispatch Andrei Betlen 2023-06-09 17:08:42 -04:00
  • 2fdd873125 Add gihub action to test published pypi version of package Andrei Betlen 2023-06-09 16:52:40 -04:00
  • a553552868 Add project urls to pyproject Andrei Betlen 2023-06-09 16:52:17 -04:00
  • eb7645b3ba Add support for logit_bias and logit_bias_type parameters Tanner Hobson 2023-06-09 13:13:08 -04:00
  • c0f7e739c9 Update llama.cpp Andrei Betlen 2023-06-09 12:39:09 -04:00
  • dd7c7bf80b Bump version v0.1.60 Andrei Betlen 2023-06-09 11:52:07 -04:00
  • 0da655b3be Temporarily disable cache until save state bug is fixed. Andrei Betlen 2023-06-09 11:10:24 -04:00
  • be0403da98 Add missing poetry sections to pyproject.toml Andrei Betlen 2023-06-09 11:09:32 -04:00
  • f2a54ecb4c Update CHANGELOG Andrei Betlen 2023-06-09 11:01:42 -04:00
  • 556c7edf47 Truncate max_tokens if it exceeds context length Andrei Betlen 2023-06-09 10:57:36 -04:00
  • fb2c5f7fd9 Merge pull request #350 from abetlen/migrate-to-scikit-build-core Andrei 2023-06-09 03:00:01 -04:00
  • b025a859ae Add full path to shared library installation path Andrei Betlen 2023-06-08 22:11:01 -04:00
  • 146ca2c59f Add missing httpx Andrei Betlen 2023-06-08 22:03:24 -04:00
  • 1d6bdf8db6 Update server dependencies Andrei Betlen 2023-06-08 21:59:58 -04:00
  • 43854e6a83 Update server dependencies Andrei Betlen 2023-06-08 21:55:42 -04:00
  • c12138f7bd Update changelog Andrei Betlen 2023-06-08 21:53:38 -04:00
  • 7345456779 Migrate to scikit-build-core Andrei Betlen 2023-06-08 21:49:42 -04:00
  • 202ed4464b Update gitignore Andrei Betlen 2023-06-08 20:33:30 -04:00
  • 312f6eb144 Update llama.cpp Andrei Betlen 2023-06-08 16:46:55 -04:00
  • 0c42168508 Fix cache implementation breaking changes Andrei Betlen 2023-06-08 13:19:23 -04:00
  • 90874c01cd Bump version v0.1.59 Andrei Betlen 2023-06-08 03:26:49 -04:00
  • e169a960f6 Ensure make clean removes all shared library files Andrei Betlen 2023-06-08 00:40:04 -04:00
  • 607d217caa Allow both .so and .dylib extensions for macos Andrei Betlen 2023-06-08 00:27:19 -04:00
  • c9e79c6681 Add metal build flags Andrei Betlen 2023-06-08 00:22:39 -04:00
  • 69355403c6 Update llama.cpp Andrei Betlen 2023-06-08 00:15:17 -04:00
  • bf322861e8 Update llama.cpp Andrei Betlen 2023-06-07 03:43:33 -04:00
  • fe4ae72ad2 Merge branch 'main' of github.com:abetlen/llama_cpp_python into main Andrei Betlen 2023-06-07 03:43:18 -04:00
  • cf6a9d6d8e Add framework and archive destinations to cmake for macos and windows. Andrei Betlen 2023-06-07 03:42:55 -04:00
  • 0f0b447fa4 Merge pull request #289 from Maximilian-Winter/main Andrei 2023-06-06 17:03:03 -04:00
  • 0e156ffd66 Fix changelog format Andrei Betlen 2023-06-06 17:01:10 -04:00
  • d508573fb4 Merge pull request #328 from spirilis/mirostat Andrei 2023-06-06 16:58:23 -04:00
  • aad4b17f52 Update llama.cpp Andrei Betlen 2023-06-06 16:23:55 -04:00
  • 8b4968ea67 Fix resize issue. Closes #330 Andrei Betlen 2023-06-06 11:37:57 -04:00
  • 9b1c9e902c Added mirostat support for completions, chat completions API Eric B 2023-06-05 22:37:11 -04:00
  • cc8858a413 Merge pull request #324 from abetlen/dependabot/pip/typing-extensions-4.6.3 Andrei 2023-06-05 19:47:30 -04:00
  • 5702d30a83 Bump typing-extensions from 4.6.2 to 4.6.3 dependabot[bot] 2023-06-05 23:46:45 +00:00
  • 2f42d6b513 Merge pull request #322 from abetlen/dependabot/pip/scikit-build-0.17.6 Andrei 2023-06-05 19:45:16 -04:00
  • fa7285c51f Bump scikit-build from 0.17.5 to 0.17.6 dependabot[bot] 2023-06-05 23:30:17 +00:00
  • 40276cb417 Merge pull request #325 from abetlen/dependabot/pip/fastapi-0.96.0 Andrei 2023-06-05 19:28:46 -04:00
  • 9e40061664 Bump fastapi from 0.95.1 to 0.96.0 dependabot[bot] 2023-06-05 23:04:20 +00:00
  • 5b968615bd Merge pull request #326 from abetlen/dependabot/pip/sse-starlette-1.6.1 Andrei 2023-06-05 18:57:11 -04:00
  • 7b57420ea9 Update llama.cpp Andrei Betlen 2023-06-05 18:17:29 -04:00
  • 4bcaa5293c Bump sse-starlette from 1.5.0 to 1.6.1 dependabot[bot] 2023-06-05 21:04:04 +00:00
  • 18c7b8520e Bump version Andrei Betlen 2023-06-04 23:31:51 -04:00
  • 8ff83db3ee Merge branch 'main' of github.com:abetlen/llama_cpp_python into main Andrei Betlen 2023-06-04 23:30:47 -04:00
  • 6d5b049801 Update llama.cpp Andrei Betlen 2023-06-04 23:30:42 -04:00
  • 76e364cdf2 Added 0.1.57 notes Andrei Betlen 2023-06-04 23:30:10 -04:00
  • c3dfb5c24a Merge branch 'abetlen:main' into main Maximilian Winter 2023-06-03 03:44:35 +02:00
  • 3977eea8e9 Merge pull request #310 from gjmulder/auto-docker Andrei 2023-06-02 13:02:48 -04:00
  • 30d32e996b More README.md corrections and cleanup Gary Mulder 2023-06-02 11:08:59 +00:00
  • d4eef735d9 Fixed .gitignore to ignore any downloaded model .bin files. Cleaned up README.md again Gary Mulder 2023-06-02 11:03:19 +00:00
  • f24e7a7e52 Updated instructions Gary Mulder 2023-06-02 10:44:52 +00:00
  • cf4931a400 Working Open Llama 3B in a box Gary Mulder 2023-06-02 08:48:54 +00:00
  • 71f4582d44 Bump version v0.1.57 Andrei Betlen 2023-05-31 23:25:39 -04:00
  • a89e3ca35f Merge branch 'main' of github.com:abetlen/llama_cpp_python into main Andrei Betlen 2023-05-31 23:25:06 -04:00
  • 5377f9784a Update llama.cpp Andrei Betlen 2023-05-31 23:24:52 -04:00
  • 1848afebe0 Added dependencies. Maximilian-Winter 2023-05-31 22:41:35 +02:00