Comparison · Facts checked October 13, 2026

LiteLLM vs Standard Compute

LiteLLM is free software that you host, secure and connect to every provider yourself, while Standard Compute is one hosted endpoint with the compute included and a router that picks the cost-efficient model per request, which suits teams that would rather not run a proxy.

Side by side

LiteLLMStandard Compute
PricingFree and MIT-licensed; Enterprise license through sales; you pay each providerFlat monthly plan: $19, $39, $89 or $249 with $20 to $269 of compute included; Business from $499
Who picks the modelTiers you assign; cost strategy within one model groupRouter picks per request (harder steps to stronger models, routine steps to efficient ones), or pin any model ID
Budget controlHard max_budget per virtual key, user and teamPlan budget per key; new requests get HTTP 402 when it is used, no overage
Claude CodeNative on your proxyNative Messages API
CodexDocumented (Responses API)Native Responses API, any model in the catalog
Europe / US rulesWherever you host it, with the providers you chooseOpt-in Europe or US rules on every plan, per key, team or company
TeamsVirtual keys, users and teamsCompany and agency workspaces, a plan per key
Best forPlatform teams that want to self-hostCoding agents and agent fleets that need one fixed monthly cost

LiteLLM facts from its own pricing and docs pages. Standard Compute is our product.

Where they differ

  1. LiteLLM is a proxy you deploy, upgrade and secure; in March 2026 two of its PyPI releases shipped a credential stealer. Standard Compute is hosted.
  2. With LiteLLM you keep an account and a bill with each provider. Standard Compute is one plan with the compute included.
  3. LiteLLM's auto router sends prompts to tiers you assign by hand, and its cost strategy chooses between deployments of one model. Standard Compute picks the model per request.

When LiteLLM is the better fit

LiteLLM is the better pick for a platform team that wants no third party in the data path, the widest provider coverage, and full control through configuration.

Switch from LiteLLM in 2 minutes

Standard Compute speaks the same APIs, so switching is a base URL, a key and a model name. Your prompts, tools and streaming stay as they are.

SettingLiteLLMStandard Compute
OpenAI-compatible base URLhttp://localhost:4000/v1https://api.stdcmpt.com/v1
Claude Code base URLhttp://localhost:4000https://api.stdcmpt.com
API keyYour LiteLLM keyYour Standard Compute key
ModelThe model ID you use todaystandardcompute, or any exact model ID
OpenAI-compatible
# OpenAI-compatible clients (OpenCode, Cline, Kilo Code, SDKs)
base_url = "https://api.stdcmpt.com/v1"
api_key  = "<your-standard-compute-key>"
model    = "standardcompute"   # or pin one, e.g. anthropic/claude-sonnet-5.5
Claude Code
# Claude Code (Anthropic Messages API, no /v1)
export ANTHROPIC_BASE_URL="https://api.stdcmpt.com"
export ANTHROPIC_AUTH_TOKEN="<your-standard-compute-key>"
Codex CLI
# Codex CLI, ~/.codex/config.toml
model = "standardcompute"
model_provider = "standardcompute"

[model_providers.standardcompute]
name = "Standard Compute"
base_url = "https://api.stdcmpt.com/v1"
env_key = "STANDARD_COMPUTE_API_KEY"
wire_api = "responses"

Setup for every agent

Run your agents on a fixed monthly budget

Every plan includes the compute and every model, and the router spends the budget on the most cost-efficient model for each step. Pay-as-you-go top-ups are optional, never automatic.

FAQ

Is LiteLLM free?

The software is open source under the MIT license, and Enterprise features need a license from BerriAI. You still pay every model provider, plus the cost of hosting and running the proxy.

Does LiteLLM route to the cheapest model?

Its cost-based strategy picks the cheapest deployment within one model group, and its auto router sends prompts to tiers that you map to models by hand. Standard Compute's router picks the model per request.

Does LiteLLM work with Claude Code and Codex?

Yes. LiteLLM documents Claude Code against its /v1/messages endpoint and Codex against /v1/responses. Standard Compute serves both natively without a proxy to run.

Can I keep LiteLLM and add Standard Compute?

Yes. Standard Compute is OpenAI-compatible, so you can add it to LiteLLM as one more provider with base URL https://api.stdcmpt.com/v1 and model standardcompute.

What was the LiteLLM PyPI incident?

On March 24, 2026, LiteLLM versions 1.82.7 and 1.82.8 on PyPI shipped a credential stealer (GitHub issue 24512). Self-hosting means pinning versions and checking releases like any other dependency.

Sources: LiteLLM auto routing · LiteLLM with Claude Code · LiteLLM security issue 24512

Related