Andrei f8fcb3ea34 feat: Update sampling API for llama.cpp (#1742) ...

* Initial samplng api update

* Fix logger

* Update tests

* Update

* Remove seed

* Add sampling chain

* Remove unnused test

* Use Qwen2 0.5B for ci tests

* Fix typo

* Fix typo

* Update cache version

* Use real model for tests

* Add huggingface-hub as a test dependency

* Remove RUST_LOG=trace

* Add actual logit processor test

2024-09-18 20:00:19 -04:00

..

ISSUE_TEMPLATE

Update bug report instructions for new build process.

2023-12-22 15:35:51 -05:00

workflows

feat: Update sampling API for llama.cpp (#1742)

2024-09-18 20:00:19 -04:00

dependabot.yml

feat(ci): Add docker checks and check deps more frequently (#1426)

2024-05-05 12:42:28 -04:00