Skip to main content

truefoundry Docs home page

Book Demo
Blog
Sign Up
Sign Up

Get Started

AI Gateway Overview
Quick Start

Developer Guide

AI Gateway Playground
Access Control
Custom Metadata
Rate Limiting
Budget Controls
Caching
Virtual Models
Cost Tracking
Session Management
Log Feedback

MCP Registry and Gateway

Overview
Getting Started
Authentication and Security
Using MCP Gateway in Agent
Virtual MCP Server
OpenAPI to MCP Server
Common Tools MCP Server

Agent Hub

Agent Hub
Agent API

Guardrails and Security

Overview
Getting Started
Configuration
Commonly Used Guardrails

Prompt Management

Overview
Playground
Prompt Versioning
Using Prompts

Observability

Analytics
Request Logging
Configure Storage For Request Logs and Metrics
Fetch Request Logs
Fetch Aggregated Model Metrics
Fetch Raw Model Metrics
Export OpenTelemetry Data
Prometheus & Grafana
Alerting

Deployment

Architecture
Deployment Options
Globally Distributed SAAS
Install AI Gateway
Custom OIDC Support

Admin Guide

Setup AI Gateway in Org
Use Secret Manager

API Reference

Headers & Authentication

Chat

POST
Chat Completions

Agent

POST
Agent Responses
POST
Agent App

Embeddings

POST
Generate Embeddings

Rerank

POST
Rerank Documents

Responses

GET
List Model Response Input Items
GET
Get Model Response
DEL
Delete Model Response
POST
Model Responses

Image

POST
Generate images from a prompt
POST
Edit images based on a prompt
POST
Creates a variation of an image.

Audio

POST
Transcribe Audio

Batch

GET
List batches
POST
Create Batch
GET
Get Batch
GET
Get Batch Output
POST
Cancel Batch

Files

GET
List Files
POST
Upload File
GET
Get File
DEL
Delete file
GET
Get File Content

Moderations

POST
Post moderations

Models

GET
List available models

Deployment

Deploy AI Gateway

Learn how to use install only llm gateway with TrueFoundry AI Gateway, including setup steps, use cases, and production-ready examples.

Please refer to Deploy Control Plane and Gateway Plane page.

Was this page helpful?

Globally Distributed SAAS Custom OIDC Support

⌘I

Assistant

Responses are generated using AI and may contain mistakes.

Contact support