Berri logo

Berri

Freemium
-(0 レビュー)
0 保存済み

OpenAI-compatible gateway for managing access to 100+ large language models

ウェブサイト:https://www.litellm.ai/
追加日:2026年7月13日
月間訪問者数:
638.5K
ソーシャルと電子メール:
AI gatewayLLM gatewayOpenAI-compatibleLLM observabilitySpend trackingModel fallback
ウェブサイトにアクセス
Berri
公式ウェブサイトにアクセス

ツール情報

Berriとは何ですか?

LiteLLM is an AI gateway that provides centralized access to multiple large language models through an OpenAI-compatible interface. It supports model fallbacks, load balancing, authentication, observability, budgets, rate limits, and spend tracking.

コア機能

  • OpenAI-compatible gateway

    Access more than 100 large language models through the OpenAI format.

  • Model fallbacks and load balancing

    Use provider fallbacks, retries, cooldowns, and load balancing across model deployments.

  • Spend tracking

    Track usage costs by key, user, team, organization, model, and custom tags, with logging to supported storage services.

  • Budgets and rate limits

    Set budgets and RPM or TPM limits by key, user, and team.

  • Authentication and access control

    Manage virtual keys, custom authentication, OIDC/JWT authentication, SSO, model access restrictions, and key rotation.

  • LLM observability and logging

    Connect LLM observability and logging with tools and services including Datadog, S3, GCS, Azure Data Lake, OpenTelemetry, and Prometheus metrics.

  • Guardrails

    Apply request-level, default-on, key-based, and team-based guardrails.

  • User, team, and organization management

    Manage users, teams, organizations, and administrators through CRUD endpoints and UI capabilities.

  • Pass-through endpoints

    Pass requests to supported provider endpoints and return responses without translation for supported migration scenarios.

使用例

  • #1

    Centralized LLM access

    Give developers access to multiple LLM providers through a common OpenAI-compatible interface.

  • #2

    Provider outage handling

    Maintain model availability by falling back across providers and deployments during outages or rate-limit errors.

  • #3

    AI usage governance

    Manage authentication, model access, budgets, rate limits, and spend attribution across users, teams, and organizations.

  • #4

    Enterprise and self-hosted deployment

    Deploy the open-source gateway in self-hosted, on-premises, or air-gapped environments.

以下に最適:Platform teamsDevelopersOrganizations managing multiple LLM providersEnterprise AI teams

料金プラン

The official source lists self-hosted and air-gapped availability.

代替案

Claude

Claude

AI assistant for reasoning, coding, writing, and data analysis

🇺🇸24.5%
947M
チャットボット & LLMAI assistant+10
Grok

Grok

Frontier AI chatbot and multimodal model family for advanced reasoning, coding, voice, image and video generation, and real-time search.

🇺🇸29.1%
28M
チャットボット & LLMAI chatbot+11
DeepSeek

DeepSeek

Open-source language models and API services for coding, reasoning, and general AI tasks

🇨🇳47.9%
373M
チャットボット & LLMLarge language models+11
Writingmate

Writingmate

Writingmate – a unified AI workspace with chat, file analysis, image, video and web search across 600+ models for $20/month.

🇺🇸11.2%
128K
チャットボット & LLMAI+11
ChatPlayground AI

ChatPlayground AI

Run prompts across 30+ AI models side‑by‑side

🇺🇸66.7%
155K
チャットボット & LLMAI model comparison+8
Blue Prism

Blue Prism

Enterprise agentic automation platform for RPA, AI agents, workflow orchestration, and BPM

🇺🇸13.2%
140K
チャットボット & LLMRPA+11
Writer

Writer

An enterprise AI platform that lets teams delegate work to AI agents that execute on‑brand, compliant tasks end‑to‑end.

🇺🇸41.3%
274K
チャットボット & LLMAI agents+10
Landbot AI

Landbot AI

No-code chatbot platform for AI-powered and rule-based conversations

🇵🇹13.9%
260K
チャットボット & LLMAI chatbots+11

よくある質問

What is LiteLLM used for?
LiteLLM is used to provide centralized access to multiple large language models through an OpenAI-compatible gateway, with tools for fallbacks, authentication, spend tracking, observability, and usage governance.
How many language models does LiteLLM support?
The official source states that LiteLLM supports access across more than 100 large language models and provider integrations.
Does LiteLLM support model fallbacks?
Yes. LiteLLM supports provider fallbacks, retries, cooldowns, and load balancing across model deployments.
Does LiteLLM offer spend tracking and budgets?
Yes. It supports spend tracking by key, user, team, organization, model, and custom tags, along with budgets and rate limits.
Can LiteLLM be self-hosted?
Yes. The official source lists self-hosted, on-premises, and air-gapped deployment options.
What is the price of LiteLLM?
The Open Source plan is listed as $0 and free. Enterprise pricing is available by request.

Berri 連絡先とソーシャルメディア

公式ウェブサイトにアクセス

レビュー

-

このツールの使用経験を共有してください...

ツール情報

料金モデルFreemium
カテゴリチャットボット & LLM
タグ
AI gatewayLLM gatewayOpenAI-compatibleLLM observabilitySpend trackingModel fallback
言語英語
最終更新日2026年7月16日
このツールを請求する