MORPH
SIGN IN SIGN UP
BerriAI / litellm UNCLAIMED

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

0 0 1 Python
Normal View History Raw
Expanded .env, added Poetry and basic Docstring
2023-08-02 12:05:35 +03:00
[tool.poetry]
name = "litellm"
bump: version 1.65.2 → 1.65.3
2025-04-02 21:59:01 -07:00
version = "1.65.3"
Expanded .env, added Poetry and basic Docstring
2023-08-02 12:05:35 +03:00
description = "Library to easily interface with LLM API providers"
authors = ["BerriAI"]
nit: switch to valid SPDX license identifier `MIT` in pyproject.toml See: https://python-poetry.org/docs/pyproject/#license
2024-01-19 10:47:29 +01:00
license = "MIT"
Expanded .env, added Poetry and basic Docstring
2023-08-02 12:05:35 +03:00
readme = "README.md"
feature #360 - Distribute py.typed
2024-05-30 14:36:04 -04:00
packages = [
{ include = "litellm" },
{ include = "litellm/py.typed"},
]
Expanded .env, added Poetry and basic Docstring
2023-08-02 12:05:35 +03:00
nit: added urls to pyproject.toml This adds links to the various URLs from the PyPI page.
2024-01-20 16:09:40 +01:00
[tool.poetry.urls]
homepage = "https://litellm.ai"
(Fix) - Docker build error with pyproject.toml (#7550) * fix pyproject * fix homepage
2025-01-04 10:50:24 -08:00
Homepage = "https://litellm.ai"
nit: added urls to pyproject.toml This adds links to the various URLs from the PyPI page.
2024-01-20 16:09:40 +01:00
repository = "https://github.com/BerriAI/litellm"
(Fix) - Docker build error with pyproject.toml (#7550) * fix pyproject * fix homepage
2025-01-04 10:50:24 -08:00
Repository = "https://github.com/BerriAI/litellm"
nit: added urls to pyproject.toml This adds links to the various URLs from the PyPI page.
2024-01-20 16:09:40 +01:00
documentation = "https://docs.litellm.ai"
(Fix) - Docker build error with pyproject.toml (#7550) * fix pyproject * fix homepage
2025-01-04 10:50:24 -08:00
Documentation = "https://docs.litellm.ai"
nit: added urls to pyproject.toml This adds links to the various URLs from the PyPI page.
2024-01-20 16:09:40 +01:00
Expanded .env, added Poetry and basic Docstring
2023-08-02 12:05:35 +03:00
[tool.poetry.dependencies]
support langfuse tags feature
2024-02-12 19:49:11 +02:00
python = ">=3.8.1,<4.0, !=3.9.7"
fix loosen httpx restriction on pip (#8255)
2025-02-04 16:10:48 -08:00
httpx = ">=0.23.0"
build(pyproject.toml): add new dev dependencies - for type checking (#9631) * build(pyproject.toml): add new dev dependencies - for type checking * build: reformat files to fit black * ci: reformat to fit black * ci(test-litellm.yml): make tests run clear * build(pyproject.toml): add ruff * fix: fix ruff checks * build(mypy/): fix mypy linting errors * fix(hashicorp_secret_manager.py): fix passing cert for tls auth * build(mypy/): resolve all mypy errors * test: update test * fix: fix black formatting * build(pre-commit-config.yaml): use poetry run black * fix(proxy_server.py): fix linting error * fix: fix ruff safe representation error
2025-03-29 11:02:13 -07:00
openai = ">=1.68.2"
loosen python dotenv version requirements
2023-09-02 15:25:34 -07:00
python-dotenv = ">=0.2.0"
feat(utils.py): bump tiktoken dependency to 0.7.0 adds support for gpt-4o token counting
2024-06-10 21:21:23 -07:00
tiktoken = ">=0.7.0"
loosen depedencies
2023-09-25 07:33:23 -07:00
importlib-metadata = ">=6.8.0"
remove tokenizers version requirement
2023-09-25 09:15:50 -07:00
tokenizers = "*"
push cli tool
2023-09-26 13:30:35 -07:00
click = "*"
add support for ai21 input params
2023-10-03 21:05:20 -07:00
jinja2 = "^3.1.2"
fix(azure.py): adding support for aiohttp calls on azure + openai
2023-11-09 10:40:26 -08:00
aiohttp = "*"
build(pyproject.toml): require pydantic v2 https://github.com/BerriAI/litellm/pull/3670 moved to pydantic v2. This created issues for people using sdk with pydantic v1. Move to requiring pydantic v2
2024-06-12 10:40:31 -07:00
pydantic = "^2.0.0"
build(pyproject.toml): remove ijson dep. add jsonschema dep.
2024-06-29 19:24:00 -07:00
jsonschema = "^4.22.0"
push cli tool
2023-09-26 13:30:35 -07:00
build(pyproject.toml): bump uvicorn depedency requirement (#7773) * build(pyproject.toml): bump uvicorn depedency requirement Fixes https://github.com/BerriAI/litellm/issues/7768 * fix(anthropic/chat/transformation.py): fix is_vertex_request check to actually use optional param passed in Fixes https://github.com/BerriAI/litellm/issues/6898#issuecomment-2590860695 * fix(o1_transformation.py): fix azure o1 'is_o1_model' check to just check for o1 in model string https://github.com/BerriAI/litellm/issues/7743 * test: load vertex creds
2025-01-14 21:47:11 -08:00
uvicorn = {version = "^0.29.0", optional = true}
(proxy perf improvement) - use `uvloop` for higher RPS (10%-20% higher RPS) (#7662) * uvicorn use uvloop * fix uvloop==0.21.0 * add uvloop to pyproject * test_completion_response_ratelimit_headers
2025-01-09 18:11:20 -08:00
uvloop = {version = "^0.21.0", optional = true}
bump gunicorn - fix security issue on gunicorn
2025-03-21 21:58:43 -07:00
gunicorn = {version = "^23.0.0", optional = true}
(Security fix) - Upgrade to `fastapi==0.115.5 ` (#7447) * fix upgrade fast api * bump fastapi * update a proxy startup tests * remove unused test file * update tests * bump fast api
2024-12-28 17:08:19 -08:00
fastapi = {version = "^0.115.5", optional = true}
Use poetry extras for proxy
2023-11-30 16:23:34 -07:00
backoff = {version = "*", optional = true}
Altered requirements.txt to require pyyaml 6.0.1 which will resolve the alpine docker build issue.
2024-01-18 18:52:43 +11:00
pyyaml = {version = "^6.0.1", optional = true}
Use poetry extras for proxy
2023-11-30 16:23:34 -07:00
rq = {version = "*", optional = true}
(fix) pip install litellm[proxy]
2023-12-28 12:59:27 +05:30
orjson = {version = "^3.9.7", optional = true}
fix(utils.py): fix streaming cost tracking
2024-01-23 14:39:35 -08:00
apscheduler = {version = "^3.10.4", optional = true}
(security fix) - bump fast api, fastapi-sso, python-multipart - fix snyk vulnerabilities (#7417) * bump fast api, fastapi-sso, python-multipart * bump cryptography * bump deps * bump proxy_logging_guardrails_model_info_tests * reduce num changes * undo change * undo change * undo fast api change
2024-12-25 19:56:35 -08:00
fastapi-sso = { version = "^0.16.0", optional = true }
(fix) ui - include UI deps in pyproject.toml
2024-02-02 07:39:11 -08:00
PyJWT = { version = "^2.8.0", optional = true }
(security fix) - bump fast api, fastapi-sso, python-multipart - fix snyk vulnerabilities (#7417) * bump fast api, fastapi-sso, python-multipart * bump cryptography * bump deps * bump proxy_logging_guardrails_model_info_tests * reduce num changes * undo change * undo change * undo fast api change
2024-12-25 19:56:35 -08:00
python-multipart = { version = "^0.0.18", optional = true}
cryptography = {version = "^43.0.1", optional = true}
Fix pip install 'litellm[extra_proxy]'
2024-03-23 17:32:57 +02:00
prisma = {version = "0.11.0", optional = true}
azure-identity = {version = "^1.15.0", optional = true}
azure-keyvault-secrets = {version = "^4.8.0", optional = true}
google-cloud-kms = {version = "^2.21.3", optional = true}
resend = {version = "^0.8.0", optional = true}
bump: version 1.41.9 → 1.41.10
2024-07-06 15:30:27 -07:00
pynacl = {version = "^1.5.0", optional = true}
fix: bump websockets version on ci/cd
2025-03-13 14:38:22 -07:00
websockets = {version = "^13.1.0", optional = true}
build(pyproject.toml): add boto3 to proxy deps on pyproject fix issue with running unit tests
2025-03-18 09:15:17 -07:00
boto3 = {version = "1.34.34", optional = true}
langchain_mcp_adapters
2025-03-24 18:59:32 -07:00
redisvl = {version = "^0.4.1", optional = true, markers = "python_version >= '3.9' and python_version < '3.14'"}
add "mcp==1.5.0" to optional pyproject for litellm proxy
2025-03-24 18:56:32 -07:00
mcp = {version = "1.5.0", optional = true, python = ">=3.10"}
UI (new_usage.tsx): Report 'total_tokens' + report success/failure calls (#9675) * feat(internal_user_endpoints.py): return 'total_tokens' in `/user/daily/analytics` * test(test_internal_user_endpoints.py): add unit test to assert spend metrics and dailyspend metadata always report the same fields * build(schema.prisma): record success + failure calls to daily user table allows understanding why model requests might exceed provider requests (e.g. user hit rate limit error) * fix(internal_user_endpoints.py): report success / failure requests in API * fix(proxy/utils.py): default to success status can be missing or none at times for successful requests * feat(new_usage.tsx): show success/failure calls on UI * style(new_usage.tsx): ui cleanup * fix: fix linting error * fix: fix linting error * feat(litellm-proxy-extras/): add new migration files
2025-03-31 22:48:43 -07:00
litellm-proxy-extras = {version = "0.1.2", optional = true}
Use poetry extras for proxy
2023-11-30 16:23:34 -07:00
[tool.poetry.extras]
proxy = [
(feat) add gunicorn as a dep
2024-01-10 17:47:24 +05:30
"gunicorn",
Use poetry extras for proxy
2023-11-30 16:23:34 -07:00
"uvicorn",
fix uvloop critical fix
2025-01-10 13:47:18 -08:00
"uvloop",
Use poetry extras for proxy
2023-11-30 16:23:34 -07:00
"fastapi",
"backoff",
(feat) proxy - add pyyaml, appdirs as dependencies
2023-12-27 17:22:36 +05:30
"pyyaml",
(feat) proxy: use orjson
2023-11-30 19:50:47 -08:00
"rq",
"orjson",
(fix) ui - include UI deps in pyproject.toml
2024-02-02 07:39:11 -08:00
"apscheduler",
"fastapi-sso",
"PyJWT",
fix(proxy_server.py): use argon2 for faster api key checking 0.04s latency boost on load test
2024-03-07 21:48:18 -08:00
"python-multipart",
fix pynacl error
2024-08-24 09:48:45 -07:00
"cryptography",
fix: bump websockets version on ci/cd
2025-03-13 14:38:22 -07:00
"pynacl",
build(pyproject.toml): add boto3 to proxy deps on pyproject fix issue with running unit tests
2025-03-18 09:15:17 -07:00
"websockets",
add "mcp==1.5.0" to optional pyproject for litellm proxy
2025-03-24 18:56:32 -07:00
"boto3",
install prisma migration files - connects litellm proxy to litellm's prisma migration files (#9637) * build(README.md): initial commit adding a separate folder for additional proxy files. Meant to reduce size of core package * build(litellm-proxy-extras/): new pip package for storing migration files allows litellm proxy to use migration files, without adding them to core repo * build(litellm-proxy-extras/): cleanup pyproject.toml * build: move prisma migration files inside new proxy extras package * build(run_migration.py): update script to write to correct folder * build(proxy_cli.py): load in migration files from litellm-proxy-extras Closes https://github.com/BerriAI/litellm/issues/9558 * build: add MIT license to litellm-proxy-extras * test: update test * fix: fix schema * bump: version 0.1.0 → 0.1.1 * build(publish-proxy-extras.sh): add script for publishing new proxy-extras version * build(liccheck.ini): add litellm-proxy-extras to authorized packages * fix(litellm-proxy-extras/utils.py): move prisma migrate logic inside extra proxy pkg easier since migrations folder already there * build(pre-commit-config.yaml): add litellm_proxy_extras to ci tests * docs(config_settings.md): document new env var * build(pyproject.toml): bump relevant files when litellm-proxy-extras version changed * build(pre-commit-config.yaml): run poetry check on litellm-proxy-extras as well
2025-03-29 15:27:09 -07:00
"mcp",
"litellm-proxy-extras"
(feat) proxy-ui a separate dep
2024-01-01 09:23:34 +05:30
]
feat: support for azure key vault
2023-12-01 19:36:06 -08:00
extra_proxy = [
"prisma",
"azure-identity",
feat(utils.py): support google kms for secret management https://github.com/BerriAI/litellm/issues/1235
2023-12-26 15:39:24 +05:30
"azure-keyvault-secrets",
feat(proxy_server.py): introduces new `/user/auth` endpoint for handling user email auth decouples streamlit ui from proxy server. this then requires the proxy to handle user auth separately.
2024-01-01 13:42:36 +05:30
"google-cloud-kms",
build(pyproject.toml): add pynacl to extra_proxy deps Closes https://github.com/BerriAI/litellm/issues/4018
2024-06-05 21:52:34 -07:00
"resend",
langchain_mcp_adapters
2025-03-24 18:59:32 -07:00
"redisvl"
feat: support for azure key vault
2023-12-01 19:36:06 -08:00
]
fix(bedrock.py): support custom prompt templates for all providers Fixes https://github.com/BerriAI/litellm/issues/4239
2024-06-17 08:28:46 -07:00
[tool.isort]
profile = "black"
push cli tool
2023-09-26 13:30:35 -07:00
[tool.poetry.scripts]
litellm = 'litellm:run_server'
Expanded .env, added Poetry and basic Docstring
2023-08-02 12:05:35 +03:00
chore: add flake8 as dev dependency
2023-12-22 08:14:54 +01:00
[tool.poetry.group.dev.dependencies]
flake8 = "^6.1.0"
chore: add black as dev dependency
2023-12-22 08:38:19 +01:00
black = "^23.12.0"
Added mypy to the dev Poetry group
2024-06-11 14:43:32 -07:00
mypy = "^1.0"
chore: add pytest as dev dependency
2023-12-22 09:25:57 +01:00
pytest = "^7.4.3"
Fixed azure ad token not being processed properly in embedding models
2024-02-22 23:23:06 +00:00
pytest-mock = "^3.12.0"
update redisvl dependency
2025-03-18 22:05:26 -04:00
pytest-asyncio = "^0.21.1"
fix(proxy_server.py): get master key from environment, if not set in … (#9617) * fix(proxy_server.py): get master key from environment, if not set in general settings or general settings not set at all * test: mark flaky test * test(test_proxy_server.py): mock prisma client * ci: add new github workflow for testing just the mock tests * fix: fix linting error * ci(conftest.py): add conftest.py to isolate proxy tests * build(pyproject.toml): add respx to dev dependencies * build(pyproject.toml): add prisma to dev dependencies * test: fix mock prompt management tests to use a mock anthropic key * ci(test-litellm.yml): parallelize mock testing make it run faster * build(pyproject.toml): add hypercorn as dev dep * build(pyproject.toml): separate proxy vs. core dev dependencies make it easier for non-proxy contributors to run tests locally - e.g. no need to install hypercorn * ci(test-litellm.yml): pin python version * test(test_rerank.py): move test - cannot be mocked, requires aws credentials for e2e testing * ci: add thank you message to ci * test: add mock env var to test * test: add autouse to tests * test: test mock env vars for e2e tests
2025-03-28 12:32:04 -07:00
respx = "^0.20.2"
build(pyproject.toml): add new dev dependencies - for type checking (#9631) * build(pyproject.toml): add new dev dependencies - for type checking * build: reformat files to fit black * ci: reformat to fit black * ci(test-litellm.yml): make tests run clear * build(pyproject.toml): add ruff * fix: fix ruff checks * build(mypy/): fix mypy linting errors * fix(hashicorp_secret_manager.py): fix passing cert for tls auth * build(mypy/): resolve all mypy errors * test: update test * fix: fix black formatting * build(pre-commit-config.yaml): use poetry run black * fix(proxy_server.py): fix linting error * fix: fix ruff safe representation error
2025-03-29 11:02:13 -07:00
ruff = "^0.1.0"
types-requests = "*"
types-setuptools = "*"
types-redis = "*"
types-PyYAML = "*"
fix(proxy_server.py): get master key from environment, if not set in … (#9617) * fix(proxy_server.py): get master key from environment, if not set in general settings or general settings not set at all * test: mark flaky test * test(test_proxy_server.py): mock prisma client * ci: add new github workflow for testing just the mock tests * fix: fix linting error * ci(conftest.py): add conftest.py to isolate proxy tests * build(pyproject.toml): add respx to dev dependencies * build(pyproject.toml): add prisma to dev dependencies * test: fix mock prompt management tests to use a mock anthropic key * ci(test-litellm.yml): parallelize mock testing make it run faster * build(pyproject.toml): add hypercorn as dev dep * build(pyproject.toml): separate proxy vs. core dev dependencies make it easier for non-proxy contributors to run tests locally - e.g. no need to install hypercorn * ci(test-litellm.yml): pin python version * test(test_rerank.py): move test - cannot be mocked, requires aws credentials for e2e testing * ci: add thank you message to ci * test: add mock env var to test * test: add autouse to tests * test: test mock env vars for e2e tests
2025-03-28 12:32:04 -07:00
[tool.poetry.group.proxy-dev.dependencies]
prisma = "0.11.0"
hypercorn = "^0.15.0"
chore: add flake8 as dev dependency
2023-12-22 08:14:54 +01:00
Expanded .env, added Poetry and basic Docstring
2023-08-02 12:05:35 +03:00
[build-system]
(feat) add pip wheel - faster docker image builds
2023-11-30 14:20:17 -08:00
requires = ["poetry-core", "wheel"]
Expanded .env, added Poetry and basic Docstring
2023-08-02 12:05:35 +03:00
build-backend = "poetry.core.masonry.api"
bump: version 0.1.824 → 0.2.0
2023-10-05 22:15:23 -07:00
[tool.commitizen]
bump: version 1.65.2 → 1.65.3
2025-04-02 21:59:01 -07:00
version = "1.65.3"
ci(pyproject.toml): keeping commitizen in sync with pyproject
2023-10-06 06:45:14 -07:00
version_files = [
"pyproject.toml:^version"
]
bump: version 0.1.824 → 0.2.0
2023-10-05 22:15:23 -07:00
Add pydantic plugin to mypy to eliminate incorrect lint errors
2024-05-17 10:39:36 +08:00
[tool.mypy]
plugins = "pydantic.mypy"
Reference in New Issue Copy Permalink