Berri logo

Berri

Freemium
-(0 Отзывы)
0 Сохранено

OpenAI-compatible gateway for managing access to 100+ large language models

Веб-сайт:https://www.litellm.ai/
Добавлено:13 июл. 2026 г.
Посетители в месяц:
638.5K
Социальные сети и электронная почта:
AI gatewayLLM gatewayOpenAI-compatibleLLM observabilitySpend trackingModel fallback
Посетите веб-сайт
Berri
Посетите официальный сайт

Информация об инструменте

Что такое Berri?

LiteLLM is an AI gateway that provides centralized access to multiple large language models through an OpenAI-compatible interface. It supports model fallbacks, load balancing, authentication, observability, budgets, rate limits, and spend tracking.

Основные функции

  • OpenAI-compatible gateway

    Access more than 100 large language models through the OpenAI format.

  • Model fallbacks and load balancing

    Use provider fallbacks, retries, cooldowns, and load balancing across model deployments.

  • Spend tracking

    Track usage costs by key, user, team, organization, model, and custom tags, with logging to supported storage services.

  • Budgets and rate limits

    Set budgets and RPM or TPM limits by key, user, and team.

  • Authentication and access control

    Manage virtual keys, custom authentication, OIDC/JWT authentication, SSO, model access restrictions, and key rotation.

  • LLM observability and logging

    Connect LLM observability and logging with tools and services including Datadog, S3, GCS, Azure Data Lake, OpenTelemetry, and Prometheus metrics.

  • Guardrails

    Apply request-level, default-on, key-based, and team-based guardrails.

  • User, team, and organization management

    Manage users, teams, organizations, and administrators through CRUD endpoints and UI capabilities.

  • Pass-through endpoints

    Pass requests to supported provider endpoints and return responses without translation for supported migration scenarios.

Варианты использования

  • #1

    Centralized LLM access

    Give developers access to multiple LLM providers through a common OpenAI-compatible interface.

  • #2

    Provider outage handling

    Maintain model availability by falling back across providers and deployments during outages or rate-limit errors.

  • #3

    AI usage governance

    Manage authentication, model access, budgets, rate limits, and spend attribution across users, teams, and organizations.

  • #4

    Enterprise and self-hosted deployment

    Deploy the open-source gateway in self-hosted, on-premises, or air-gapped environments.

Лучше всего для:Platform teamsDevelopersOrganizations managing multiple LLM providersEnterprise AI teams

Тарифные планы

The official source lists self-hosted and air-gapped availability.

Альтернативы

Claude

Claude

AI assistant for reasoning, coding, writing, and data analysis

🇺🇸24.5%
947M
Чат-боты и LLMAI assistant+10
Grok

Grok

Frontier AI chatbot and multimodal model family for advanced reasoning, coding, voice, image and video generation, and real-time search.

🇺🇸29.1%
28M
Чат-боты и LLMAI chatbot+11
DeepSeek

DeepSeek

Open-source language models and API services for coding, reasoning, and general AI tasks

🇨🇳47.9%
373M
Чат-боты и LLMLarge language models+11
Writingmate

Writingmate

Writingmate – a unified AI workspace with chat, file analysis, image, video and web search across 600+ models for $20/month.

🇺🇸11.2%
128K
Чат-боты и LLMAI+11
ChatPlayground AI

ChatPlayground AI

Run prompts across 30+ AI models side‑by‑side

🇺🇸66.7%
155K
Чат-боты и LLMAI model comparison+8
Blue Prism

Blue Prism

Enterprise agentic automation platform for RPA, AI agents, workflow orchestration, and BPM

🇺🇸13.2%
140K
Чат-боты и LLMRPA+11
Writer

Writer

An enterprise AI platform that lets teams delegate work to AI agents that execute on‑brand, compliant tasks end‑to‑end.

🇺🇸41.3%
274K
Чат-боты и LLMAI agents+10
Landbot AI

Landbot AI

No-code chatbot platform for AI-powered and rule-based conversations

🇵🇹13.9%
260K
Чат-боты и LLMAI chatbots+11

Часто задаваемые вопросы

What is LiteLLM used for?
LiteLLM is used to provide centralized access to multiple large language models through an OpenAI-compatible gateway, with tools for fallbacks, authentication, spend tracking, observability, and usage governance.
How many language models does LiteLLM support?
The official source states that LiteLLM supports access across more than 100 large language models and provider integrations.
Does LiteLLM support model fallbacks?
Yes. LiteLLM supports provider fallbacks, retries, cooldowns, and load balancing across model deployments.
Does LiteLLM offer spend tracking and budgets?
Yes. It supports spend tracking by key, user, team, organization, model, and custom tags, along with budgets and rate limits.
Can LiteLLM be self-hosted?
Yes. The official source lists self-hosted, on-premises, and air-gapped deployment options.
What is the price of LiteLLM?
The Open Source plan is listed as $0 and free. Enterprise pricing is available by request.

Berri Контакты и социальные сети

Посетите официальный сайт

Отзывы

-

Поделитесь своим опытом использования этого инструмента...

Информация об инструменте

Модель оплатыFreemium
КатегорияЧат-боты и LLM
Теги
AI gatewayLLM gatewayOpenAI-compatibleLLM observabilitySpend trackingModel fallback
Языканглийский
Последнее обновление16 июл. 2026 г.
Заявить права на этот инструмент