For the complete documentation index, see llms.txt. This page is also available as Markdown.

Object Storage

S3-compatible object storage for datasets, checkpoints, and model outputs, with workspaces, buckets, and usage reporting.

S3-compatible object storage for datasets, checkpoints, and generated media. Because it speaks the S3 protocol, the tools you already use — s3cmd, boto3, the AWS SDKs — work against it unchanged.

How it is organised

  • A workspace is the top-level container. Creating one issues an S3 access key pair that your tools authenticate with, and it is ready to use immediately.

  • Buckets live inside a workspace and hold your objects. They are private by default and can be switched to public.

Note: The platform prefixes new bucket names — a bucket you create as checkpoints in workspace research becomes something like u-2f36933d-research.checkpoints. That prefixed name is what s3cmd and the S3 SDKs see, so take it from the console's Buckets tab rather than assuming the name you typed. Buckets created before the storage backend was migrated keep their original names.

Key features

  • S3-compatible API. Point existing S3 tooling at your workspace endpoint.

  • Console management. Create workspaces and buckets, upload and delete files, and toggle bucket privacy from Object Storage in the console.

  • Platform API. Automate the same operations — see Object Storage API.

  • Usage reporting. Storage and transfer usage broken down over 24 hours, 7 days, and 30 days.

  • Key rotation. Regenerate a workspace's access key pair when you need to.

Prerequisites

  • Credit on your account — Standard workspaces store data free and bill outgoing traffic per GB

Getting started

Create a workspace and your first bucket

Set up s3cmd on Linux or macOS

Set up s3cmd on Windows

Use the AWS SDK for Python

Use the AWS SDK for Go

Use the AWS SDK for Java

Pricing and billing

Object storage comes in three tiers, priced per the console's create form:

Tier
Stored data
Notes

Standard

Free

Durable, high-capacity storage. The default

Performance

$0.015/GB/month

Low-latency, for frequent access

Accelerated

$0.02/GB/month

For write-intensive workloads

Outgoing traffic is billed at $0.01/GB on all tiers; incoming traffic is included. Availability varies — a tier can show as out of stock.

Rates for a workspace you already have are on its Overview tab. Object storage is not covered by the public pricing page, so treat the console as authoritative.

Usage is metered hourly. See Get Storage Usage to read stored volume and transfer programmatically.

See also

Last updated