Skip to main content
AI Gateway

Never bet on
one model.

Bring the models you run yourself and every frontier provider into a managed gateway, with observability and access control built in.

Start buildingRead the docs
Coming soonDedicated inference

One URL, any SDK.

Change your baseURL to https://gateway.ngrok.ai and swap your API key.
That’s it. Start routing, not deploying infrastructure.

import OpenAI from "openai"; const client = new OpenAI({	baseURL: "https://gateway.ngrok.ai",	apiKey: process.env.NGROK_AI_ACCESS_KEY,}); const completion = await client.chat.completions.create({	// Route to a self-hosted model first	model: "unsloth/Qwen3.5-1228-A10B-GGUF",	// Fallback to public providers	models: ["gpt-5.4", "claude-opus-4-6"],	messages: [		{ role: "system", content: "Talk like a pirate." },		{ role: "user", content: "Are semicolons optional in JavaScript?" },	],	stream: true,});
Local LLMs

Privately connect to your self-hosted models.

Route to any local LLM reachable from your AI Gateway without wrangling public IPs or inbound ports. Keep it on private connectivity, same as any other model.

Read the local model guide
Diagram of self-hosted LLM providers connected through ngrok
Key management

Bring the keys you’re already paying for.

Use your own key with every provider we support, including OpenAI, Anthropic, Google, xAI, Groq, and DeepSeek, plus any custom provider. You pay them directly at your current rates. Keys stay on the gateway, never in your app, and extra keys for a provider take over when one hits a rate limit.

Learn how BYOK works
Diagram of API keys from multiple providers managed in one place
Access control

Decide who or what gets access.

Give each app or developer separate access keys, then set which providers and models it’s allowed to call. No more passing around one key that opens everything.

See how scoped keys work
Diagram showing scoped access from an app through ngrok to AI providers
Observability

See every call, know exactly what it costs.

Provider dashboards show what you spent, not which app, dev, or model spent it. See tokens, latency, and errors rolled up across every call you route.

See what you can measure
Dashboard showing AI gateway usage and cost by provider and model
Features

Smart defaults. Open levers.

Get started instantly. Light up advanced features without ever re-instrumenting your app.

Reroute before users notice

When a model or key slows or fails, requests reroute to a healthy alternative you've defined. Users never notice.

Retry without the code

When a request fails, we retry it instantly. Apps keep running without handling errors on your end.

Fully programmable

Manage keys, providers, and settings through the AI Gateway API, with a public OpenAPI spec. Call it from your coding agent, CLI, or custom tooling.

Read the docs for more
Pricing

One flat fee for routing, observability, and the rest.

$0.05

Per million tokens plus the cost of your inference

Use ngrok keys and we pass inference through at cost. Bring your own and your provider bills you directly. Either way, you buy credits up front and we draw down as you route. No subscriptions or commitments.

Security review

Bring your security team.

Our SOC 2 report, DPA, subprocessor list, and penetration test summary live in the ngrok Trust Center.

Visit the Trust CenterCheck status

Move fast & make things.

Build with the gateway that works with every model you use.
Even the ones you run yourself.

Start buildingRead the docs