Berri logo

Berri

Freemium
-(0 Reseñas)
0 Guardado

OpenAI-compatible gateway for managing access to 100+ large language models

Sitio web:https://www.litellm.ai/
Añadido en:13 jul 2026
Visitantes mensuales:
638.5K
Redes sociales y correo electrónico:
AI gatewayLLM gatewayOpenAI-compatibleLLM observabilitySpend trackingModel fallback
Visitar sitio web
Berri
Visite el sitio web oficial

Información de la herramienta

¿Qué es Berri?

LiteLLM is an AI gateway that provides centralized access to multiple large language models through an OpenAI-compatible interface. It supports model fallbacks, load balancing, authentication, observability, budgets, rate limits, and spend tracking.

Características principales

  • OpenAI-compatible gateway

    Access more than 100 large language models through the OpenAI format.

  • Model fallbacks and load balancing

    Use provider fallbacks, retries, cooldowns, and load balancing across model deployments.

  • Spend tracking

    Track usage costs by key, user, team, organization, model, and custom tags, with logging to supported storage services.

  • Budgets and rate limits

    Set budgets and RPM or TPM limits by key, user, and team.

  • Authentication and access control

    Manage virtual keys, custom authentication, OIDC/JWT authentication, SSO, model access restrictions, and key rotation.

  • LLM observability and logging

    Connect LLM observability and logging with tools and services including Datadog, S3, GCS, Azure Data Lake, OpenTelemetry, and Prometheus metrics.

  • Guardrails

    Apply request-level, default-on, key-based, and team-based guardrails.

  • User, team, and organization management

    Manage users, teams, organizations, and administrators through CRUD endpoints and UI capabilities.

  • Pass-through endpoints

    Pass requests to supported provider endpoints and return responses without translation for supported migration scenarios.

Casos de uso

  • #1

    Centralized LLM access

    Give developers access to multiple LLM providers through a common OpenAI-compatible interface.

  • #2

    Provider outage handling

    Maintain model availability by falling back across providers and deployments during outages or rate-limit errors.

  • #3

    AI usage governance

    Manage authentication, model access, budgets, rate limits, and spend attribution across users, teams, and organizations.

  • #4

    Enterprise and self-hosted deployment

    Deploy the open-source gateway in self-hosted, on-premises, or air-gapped environments.

Lo mejor para:Platform teamsDevelopersOrganizations managing multiple LLM providersEnterprise AI teams

Planes de precios

The official source lists self-hosted and air-gapped availability.

Alternativas

Claude

Claude

AI assistant for reasoning, coding, writing, and data analysis

🇺🇸24.5%
947M
Chatbots y LLMAI assistant+10
Grok

Grok

Frontier AI chatbot and multimodal model family for advanced reasoning, coding, voice, image and video generation, and real-time search.

🇺🇸29.1%
28M
Chatbots y LLMAI chatbot+11
DeepSeek

DeepSeek

Open-source language models and API services for coding, reasoning, and general AI tasks

🇨🇳47.9%
373M
Chatbots y LLMLarge language models+11
Writingmate

Writingmate

Writingmate – a unified AI workspace with chat, file analysis, image, video and web search across 600+ models for $20/month.

🇺🇸11.2%
128K
Chatbots y LLMAI+11
ChatPlayground AI

ChatPlayground AI

Run prompts across 30+ AI models side‑by‑side

🇺🇸66.7%
155K
Chatbots y LLMAI model comparison+8
Blue Prism

Blue Prism

Enterprise agentic automation platform for RPA, AI agents, workflow orchestration, and BPM

🇺🇸13.2%
140K
Chatbots y LLMRPA+11
Writer

Writer

An enterprise AI platform that lets teams delegate work to AI agents that execute on‑brand, compliant tasks end‑to‑end.

🇺🇸41.3%
274K
Chatbots y LLMAI agents+10
Landbot AI

Landbot AI

No-code chatbot platform for AI-powered and rule-based conversations

🇵🇹13.9%
260K
Chatbots y LLMAI chatbots+11

Preguntas frecuentes

What is LiteLLM used for?
LiteLLM is used to provide centralized access to multiple large language models through an OpenAI-compatible gateway, with tools for fallbacks, authentication, spend tracking, observability, and usage governance.
How many language models does LiteLLM support?
The official source states that LiteLLM supports access across more than 100 large language models and provider integrations.
Does LiteLLM support model fallbacks?
Yes. LiteLLM supports provider fallbacks, retries, cooldowns, and load balancing across model deployments.
Does LiteLLM offer spend tracking and budgets?
Yes. It supports spend tracking by key, user, team, organization, model, and custom tags, along with budgets and rate limits.
Can LiteLLM be self-hosted?
Yes. The official source lists self-hosted, on-premises, and air-gapped deployment options.
What is the price of LiteLLM?
The Open Source plan is listed as $0 and free. Enterprise pricing is available by request.

Berri Contacto y redes sociales

Visite el sitio web oficial

Reseñas

-

Comparte tu experiencia con esta herramienta...

Información de la herramienta

Modelo de preciosFreemium
CategoríaChatbots y LLM
Etiquetas
AI gatewayLLM gatewayOpenAI-compatibleLLM observabilitySpend trackingModel fallback
Idiomaingles
Última actualización16 jul 2026
Reclama esta herramienta