Favorite
Discover
Collections

No collections

Log in
CollectionsDiscoverLibraryLog in
Discover/BerriAI/litellm: Python SDK, Proxy Server (AI Gateway) to cal…
|Link
Open original
BerriAI/litellm: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
↗Link
Ggithub.com

BerriAI/litellm: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Your notes

Save this item to your library to add private notes.

AI Summary

Open-source AI gateway and Python SDK for 100+ LLMs, offering OpenAI-compatible calls, proxy serving, cost tracking, guardrails, load balancing, and logging.

Collection

Ask about this item

Tags

#agent-frameworks#mcp-tools#api-gateway#openai-compatibility#developer-tools#machine-learning#ai-infrastructure#llm-platforms#model-routing#enterprise-ai
✦5 left