Skip to main content

Tools

litellm

63,671

Call any LLM using the OpenAI API format — proxy server and Python SDK.

Prevention In-generation Fully autonomous Program Stable Activity band C Environment
Activity band details

Activity band A to F: a bin of a score that adds GitHub stars (log scale), a push to the upstream repository in the 12 months before `as_of`, the number of declared integration surfaces and, where the catalogue records them, citing papers and benchmark evaluations. It measures popularity and activity. It is not a level of evidence: no band means a paper cites the tool or that it was measured. Recency is judged as of 2026-11-22.

Computed band: C (raw score 4.92). Shown band: C .

Facets: documented_in=0evaluated_on=0integration_surfaces=1paper_citations=0recent_push=2stars=1.92

Source of truth: pipeline/maturity/score.py

Description

LiteLLM is an LLM proxy + Python SDK that exposes 100+ model providers behind the OpenAI API. Functions as an enterprise gateway with virtual keys, spend tracking, failover, and rate limits. De-facto standard for provider-agnostic LLM access.

Why it's included

Multi-provider gateway cell — canonical point of comparison for bifrost.

Addresses failure modes

These tags are the catalog's claim about what litellm is built to catch or prevent. A tag is not a test result. SAICA-Bench has not measured litellm, so none of these tags is tested here.

Techniques

provider-shimvirtual-keysspend-trackingfailover

View raw YAML on GitHub →