SIGN IN SIGN UP
BerriAI / litellm UNCLAIMED

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

41086 0 1 Python
fixtures
realtime
test_llm_response_utils
test_skills_data
test-skill
base_audio_transcription_unit_tests.py
base_embedding_unit_tests.py
base_llm_unit_tests.py
base_rerank_unit_tests.py
conftest.py
dog.wav
duck.png
gettysburg.wav
guinea.png
log.xt
Readme.md
test_a2a.py
test_anthropic_completion.py
test_aws_base_llm.py
test_azure_agents.py
test_azure_ai.py
test_azure_o_series.py
test_azure_openai.py
test_bedrock_agentcore.py
test_bedrock_agents.py
test_bedrock_anthropic_regression.py
test_bedrock_common_utils.py
test_bedrock_completion.py
test_bedrock_dynamic_auth_params_unit_tests.py
test_bedrock_embedding.py
test_bedrock_govcloud.py
test_bedrock_gpt_oss.py
test_bedrock_invoke_tests.py
test_bedrock_llama.py
test_bedrock_moonshot.py
test_bedrock_nova_embedding.py
test_bedrock_nova_json.py
test_clarifai_completion.py
test_cloudflare.py
test_cohere.py
test_containers_api.py
test_convert_dict_to_image.py
test_databricks.py
test_deepgram.py
test_deepseek_completion.py
test_elevenlabs.py
test_evals_api.py
test_fireworks_ai_translation.py
test_gemini_image_usage.py
test_gemini.py
test_gigachat.py
test_gpt4o_audio.py
test_groq.py
test_hosted_vllm_embedding_e2e.py
test_huggingface_chat_completion.py
test_hyperbolic.py
test_infinity.py
test_jina_ai.py
test_lambda_ai.py
test_langgraph.py
test_litellm_proxy_provider.py
test_minimax_tts.py
test_mistral_api.py
test_model_cost_map_resilience.py
test_morph.py
test_nvidia_nim.py
test_openai_o1.py
test_openai.py
test_openrouter.py
test_optional_params.py
test_perplexity_reasoning.py
test_prompt_caching.py
test_prompt_factory.py
test_replicate.py
test_rerank.py
test_router_llm_translation_tests.py
test_sambanova_chat_transformation.py
test_skills_api.py
test_skills_e2e.py
test_snowflake.py
test_text_completion_unit_tests.py
test_text_completion.py
test_together_ai.py
test_triton.py
test_unit_test_bedrock_invoke.py
test_v0.py
test_voyage_ai.py
test_watsonx.py
test_xai.py