Skip to main content
1

Sign Up

Go to TrueFoundry and click Signup.
Screenshot of the TrueFoundry Welcome Page with signup option

Welcome Page

Create an account and verify your email. You will be redirected to the landing page.
2

Add Your Models

Go to AI Gateway > Models, click Add Model and choose To New Provider Account. Pick the provider you want to add models from.
Add Provider Account page listing the supported model providers

Add Provider Account

A provider account represents one account with a model provider (e.g. OpenAI, Anthropic, AWS Bedrock). In the setup drawer, give the account a name and enter its credentials under Configure Account, then tick the models you want under Models Selection and click Save without Testing (or Test Credentials first).
You can add multiple accounts per provider, each with their own API keys. Each account can have multiple models.
Once saved, your models appear on the Models page. To add more models to an account later, click Add Model > To Existing Provider Account, or open Manage Accounts and click + Add model on the account. Click a model and use Try in Playground to start experimenting.
3

Try Models in the Playground

The LLM Playground lets you test models from all connected providers directly in the UI.
AI Gateway Playground Page for testing LLM models

AI Gateway Playground Page

4

Integrate with Code

To call Gateway models from your code, you need Gateway Base URL, API Key, and Model ID.All three are available in the Code Snippet tab of the Playground.
Gateway Code Snippets Page with code generation options

AI Gateway Code Snippet Page

Gateway Base URL

Your Gateway Base URL (GATEWAY_BASE_URL) is the endpoint for the AI Gateway service.
  • TrueFoundry SaaS users: https://gateway.truefoundry.ai
  • Self-hosted deployments: found in the Code Snippet section of the Playground.

API Key

Authenticate with the AI Gateway using one of:Create a token from the Access section in the TrueFoundry platform.
TrueFoundry playground showing the AI Gateway Base URL and API key

Example Usage

Or set them as environment variables:
The Playground also provides ready-to-use snippets for OpenAI SDK, Langchain, Python (Streaming/Non-Streaming), Node.js, LangGraph, LlamaIndex, Google ADK, cURL, and more.