Gateway and Rules
The AI Gateway is the request path. Your app calls it, it picks a model, runs the request, and returns the result. One API for text generation, multimodality — image, audio, and video — and realtime voice, in front of 300+ models. In Rules, you decide which models can run, what content gets blocked, how responses are scored, how long call content is kept, and what the organization can spend. The Gateway enforces those rules automatically, so policy stays outside your application code. You can block a category of content, restrict a project to EU providers, or cap monthly spend without shipping a new version of your app.Projects
Your account is an organization. Inside it, each app or environment is a project with its own API key and its own isolated data. Rules apply at one of these two levels. An organization rule applies everywhere; a project rule narrows it. You can tighten a policy for one project but never loosen what the organization allows, so a rule such as “EU providers only” continues to hold across every project.What happens on a call
Every call runs the same path, and you can replay all of it afterward:- The Gateway identifies your project from the API key.
- Checks inspect the input, model access confirms the model is allowed, and Route fills in a default model if you didn’t name one.
- The model runs.
- Checks inspect the output, and a score check grades it afterwards.
- The call is recorded. By default that’s metadata only (model, cost, latency); with retention on, it’s the full trace.
Where to go next
AI Gateway
One API, 300+ models, routing, and EU enforcement. The request path in detail.
Observe & Control
Inspect traces and manage the rules applied in production.