Skip to main content
TrueFoundry AI Gateway allows you to configure where your request logs (traces) and metrics are stored. You can choose between control plane managed storage or bring your own customer-managed storage.
Storage configuration can only be managed by tenant administrators.

​
Overview

All Gateway traces and metrics are stored in a configured storage destination. You can configure:
  • Storage type: Control plane managed storage or customer-managed storage
  • Region selection: For control plane managed storage (SaaS only)
  • Trace retention: Configure how long trace data is retained
  • Metrics retention: Metrics data is kept forever and cannot be configured
Navigate to AI Gateway > Controls > Data Routing to view and configure your data routing destinations.

​
Storage Options

​
Control Plane Managed Storage

Control plane managed storage is blob storage configured when setting up the AI Gateway control plane. When using TrueFoundry’s SaaS offering, you can select a region for the control plane managed storage. Features:
  • Fully managed by Control Plane
  • No additional setup required
  • Region selection available for data residency requirements (SaaS only)

​
Customer Managed Storage

Customer managed storage allows you to bring your own storage buckets. You can configure storage integrations (such as AWS S3 or Azure Blob Storage) and select them as your data routing destination. Features:
  • Use your own blob storage
  • Full control over data location and compliance
  • Support for multiple cloud providers (AWS S3, GCS, Azure Blob Storage, etc.)
  • Configure storage integrations via Platform > Integrations

​
Configuring Data Routing

1

Navigate to Data Routing

Go to AI Gateway > Controls > Data Routing
2

Edit the default destination

Click the edit icon (pencil) next to the default destination in the destinations table
3

Choose storage type

Select your preferred storage option:
  • Controlplane Managed Storage: For TrueFoundry-managed storage
  • Customer Managed Storage: To use your own storage buckets
4

Configure storage details

For Control Plane Managed Storage:
  • If using TrueFoundry SaaS, optionally select a storage region (e.g., US, Australia, India)
  • Leave region as “None” to use the default region
For Customer Managed Storage:
  • Ensure you have configured a storage integration in Platform > Integrations
  • Select your storage integration from the dropdown
  • The integration must be configured with appropriate permissions for the AI Gateway to write data
5

Configure trace retention (Optional)

Set the retention period for trace data. If not configured, traces will be retained according to the default policy.
Metrics data is always kept forever and cannot be configured.
6

Submit configuration

Review your settings and click Submit to save the configuration

​
Setting Up Customer Managed Storage

Before you can use customer-managed storage, you need to configure a storage integration:
1

Navigate to Integrations

Go to Platform > Integrations
2

Add Storage Integration

Add a new storage integration for your blob storage
3

Verify Permissions

Ensure the storage integration has write permissions for the AI Gateway to store traces and metrics
4

Select in Data Routing

Return to AI Gateway > Controls > Data Routing and select your configured storage integration

​
Important Considerations

Changing Storage ConfigurationChanging your storage configuration has important implications:
  • Any existing data will not be deleted but will become inaccessible
  • Existing data will not be migrated to the new storage location
  • New data will be stored in the newly configured destination
  • Consider data retention and compliance requirements before making changes

​
Region Selection (SaaS Only)

When using TrueFoundry’s SaaS offering, you can select a storage region for the control plane managed storage. This allows you to store data in a specific geographic region for compliance requirements.