SIGN IN SIGN UP
BerriAI / litellm UNCLAIMED

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

41086 0 1 Python
example_config_yaml
test_configs
test_model_response_typing
adroit-crow-413218-bc47f303efc9.json
azure_fine_tune.jsonl
batch_job_results_furniture.jsonl
conftest copy.py
conftest.py
data_map.txt
eagle.wav
gettysburg.wav
large_text.py
messages_with_counts.py
model_cost.json
openai_batch_completions_router.jsonl
openai_batch_completions.jsonl
speech_vertex.mp3
test_aproxy_startup.py
test_audit_logs_proxy.py
test_auth_checks.py
test_banned_keyword_list.py
test_blog_posts_endpoint.py
test_check_batch_cost.py
test_check_responses_cost.py
test_custom_callback_input.py
test_custom_logger_s3_gcs.py
test_custom_tokenizer_bug.py
test_db_schema_changes.py
test_db_schema_migration.py
test_default_end_user_budget_simple.py
test_deployed_proxy_keygen.py
test_e2e_pod_lock_manager.py
test_get_favicon.py
test_get_image.py
test_google_endpoint_routing.py
test_google_gemini_proxy_request.py
test_jwt_key_mapping.py
test_jwt.py
test_key_generate_dynamodb.py
test_key_generate_prisma.py
test_models_fallback_endpoint.py
test_prisma_client_backoff_retry.py
test_project_endpoints_prisma.py
test_prompt_test_endpoint.py
test_proxy_config_unit_test.py
test_proxy_custom_auth.py
test_proxy_custom_logger.py
test_proxy_encrypt_decrypt.py
test_proxy_exception_mapping.py
test_proxy_gunicorn.py
test_proxy_pass_user_config.py
test_proxy_reject_logging.py
test_proxy_routes.py
test_proxy_server_caching.py
test_proxy_server_keys.py
test_proxy_server_langfuse.py
test_proxy_server_spend.py
test_proxy_server.py
test_proxy_setting_guardrails.py
test_proxy_token_counter.py
test_proxy_utils.py
test_realtime_cache.py
test_response_polling_handler.py
test_response_polling_pre_call_checks.py
test_search_api_logging.py
test_server_root_path.py
test_skills_db.py
test_ui_path_detection.py
test_unit_test_max_model_budget_limiter.py
test_unit_test_proxy_hooks.py
test_update_spend.py
test_user_api_key_auth.py
test_zero_cost_model_budget_bypass.py
vertex_key.json