Object Storage
S3-compatible object storage for datasets, checkpoints, and model outputs, with workspaces, buckets, and usage reporting.
S3-compatible object storage for datasets, checkpoints, and generated media. Because it speaks the S3 protocol, the tools you already use — s3cmd, boto3, the AWS SDKs — work against it unchanged.
How it is organised
A workspace is the top-level container. Creating one issues an S3 access key pair that your tools authenticate with, and it is ready to use immediately.
Buckets live inside a workspace and hold your objects. They are private by default and can be switched to public.
Note: The platform prefixes new bucket names — a bucket you create as
checkpointsin workspaceresearchbecomes something likeu-2f36933d-research.checkpoints. That prefixed name is whats3cmdand the S3 SDKs see, so take it from the console's Buckets tab rather than assuming the name you typed. Buckets created before the storage backend was migrated keep their original names.
Key features
S3-compatible API. Point existing S3 tooling at your workspace endpoint.
Console management. Create workspaces and buckets, upload and delete files, and toggle bucket privacy from Object Storage in the console.
Platform API. Automate the same operations — see Object Storage API.
Usage reporting. Storage and transfer usage broken down over 24 hours, 7 days, and 30 days.
Key rotation. Regenerate a workspace's access key pair when you need to.
Prerequisites
Credit on your account — Standard workspaces store data free and bill outgoing traffic per GB
Getting started
Create a workspace and your first bucket
Set up s3cmd on Linux or macOS
Set up s3cmd on Windows
Use the AWS SDK for Python
Use the AWS SDK for Go
Use the AWS SDK for Java
Pricing and billing
Object storage comes in three tiers, priced per the console's create form:
Standard
Free
Durable, high-capacity storage. The default
Performance
$0.015/GB/month
Low-latency, for frequent access
Accelerated
$0.02/GB/month
For write-intensive workloads
Outgoing traffic is billed at $0.01/GB on all tiers; incoming traffic is included. Availability varies — a tier can show as out of stock.
Rates for a workspace you already have are on its Overview tab. Object storage is not covered by the public pricing page, so treat the console as authoritative.
Usage is metered hourly. See Get Storage Usage to read stored volume and transfer programmatically.
See also
Last updated