BerriAI/litellm

BerriAI / litellm UNCLAIMED

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

0 0 1 Python

50 branches 1357 tags

https://code.morphllm.com/BerriAI/litellm.git

ai-gateway anthropic azure-openai bedrock gateway langchain litellm llm llm-gateway llmops mcp-gateway openai openai-proxy vertex-ai

	.circleci
	.devcontainer
	.github
	.semgrep
	ci_cd
	cookbook
	db_scripts
	deploy
	dist
	docker
	docs
	enterprise
	litellm
	litellm-js
	litellm-proxy-extras
	scripts
	tests
	ui
	.dockerignore		635 B
	.env.example		624 B
	.flake8		1.4 KB
	.git-blame-ignore-revs		386 B
	.gitattributes		25 B
	.gitguardian.yaml		3.9 KB
	.gitignore		2.5 KB
	.pre-commit-config.yaml		1.3 KB
	.trivyignore		346 B
	AGENTS.md		12.9 KB
	ARCHITECTURE.md		16.3 KB
	CLAUDE.md		12.3 KB
	codecov.yaml		791 B
	CONTRIBUTING.md		8.6 KB
	dev_config.yaml		296 B
	docker-compose.hardened.yml		1.4 KB
	docker-compose.yml		2.3 KB
	Dockerfile		6.2 KB
	GEMINI.md		4.2 KB
	index.yaml		3.6 KB
	LICENSE		1.4 KB
	license_cache.json		271 B
	Makefile		9.3 KB
	mcp_servers.json		1.1 KB
	model_prices_and_context_window.json		1.3 MB
	package-lock.json		188.7 KB
	package.json		781 B
	poetry.lock		664.6 KB
	policy_templates.json		94.6 KB
	prometheus.yml		175 B
	provider_endpoints_support.json		83.4 KB
	proxy_server_config.yaml		8.2 KB
	pyproject.toml		6.2 KB
	pyrightconfig.json		204 B
	README.md		25.6 KB
	render.yaml		256 B
	requirements.txt		3.8 KB
	ruff.toml		926 B
	schema.prisma		46.1 KB
	security.md		1.8 KB
	taplo.toml		574 B
	uv.lock		52 B