MORPH
SIGN IN SIGN UP
BerriAI / litellm UNCLAIMED

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

0 0 1 Python
Download ZIP
ai_coding_tool_guides
anthropic_agent_sdk
benchmark
codellama-server
community-resources
gollem_go_agent_framework
litellm_proxy_server
litellm_router
litellm_router_load_test
litellm-ollama-docker-image
livekit_agent_sdk
logging_observability
misc
mock_guardrail_server
mock_prompt_management_server
Benchmarking_LLMs_by_use_case.ipynb
Claude_(Anthropic)_with_Streaming_liteLLM_Examples.ipynb
Evaluating_LLMs.ipynb
google_adk_litellm_tutorial.ipynb
liteLLM_A121_Jurrasic_example.ipynb
LiteLLM_Azure_and_OpenAI_example.ipynb
liteLLM_Baseten.ipynb
LiteLLM_batch_completion.ipynb
LiteLLM_Bedrock.ipynb
liteLLM_clarifai_Demo.ipynb
LiteLLM_CometAPI.ipynb
LiteLLM_Comparing_LLMs.ipynb
LiteLLM_Completion_Cost.ipynb
liteLLM_function_calling.ipynb
liteLLM_Getting_Started.ipynb
LiteLLM_HuggingFace.ipynb
liteLLM_IBM_Watsonx.ipynb
liteLLM_Langchain_Demo.ipynb
litellm_model_fallback.ipynb
LiteLLM_NovitaAI_Cookbook.ipynb
liteLLM_Ollama.ipynb
LiteLLM_OpenRouter.ipynb
LiteLLM_Petals.ipynb
LiteLLM_PromptLayer.ipynb
liteLLM_Replicate_Demo.ipynb
liteLLM_Streaming_Demo.ipynb
litellm_test_multiple_llm_demo.ipynb
litellm_Test_Multiple_Providers.ipynb
LiteLLM_User_Based_Rate_Limits.ipynb
liteLLM_VertextAI_Example.ipynb
Migrating_to_LiteLLM_Proxy_from_OpenAI_Azure_OpenAI.ipynb
mlflow_langchain_tracing_litellm_proxy.ipynb
nova_sonic_realtime.py
Parallel_function_calling.ipynb
Proxy_Batch_Users.ipynb
result.html
TogetherAI_liteLLM.ipynb
Using_Nemo_Guardrails_with_LiteLLM_Server.ipynb
veo_video_generation.py
VLLM_Model_Testing.ipynb