Overview
This page outlines the different tiers available in the system, their requirements, and the corresponding benefits. All users have access to our serverless endpoints. The tiers dictate your request and token rates, as well as whether you have access to GPU instances.
Tier Levels and Benefits
Engineer Tier 1
Sign Up
No
60 RPM
60,000 TPM
Engineer Tier 2
Add Credit Card
No
300 RPM
150,000 TPM
Engineer Tier 3
Deposit $10
Yes
600 RPM
200,000 TPM
Expert Tier 1
Spend $30
Yes
1,500 RPM
500,000 TPM
Expert Tier 2
Spend $50
Yes
3,000 RPM
800,000 TPM
Tier Descriptions
Engineer Tier 1
Available to all users upon sign-up.
Provides a request rate limit of 60 requests per minute (RPM) for using serverless endpoints.
Token Rate: 60,000 tokens per minute (TPM) for using serverless endpoints.
No GPU access.
Engineer Tier 2
Requires adding a credit card.
Increases request rate to 300 RPM.
Token Rate: 150,000 TPM.
No GPU access.
Engineer Tier 3
Requires a $10 deposit.
Grants GPU access.
Increases request rate to 600 RPM.
Token Rate: 200,000 TPM.
Expert Tier 1
Requires a $30 spend.
Grants GPU access.
Increases request rate to 1,500 RPM.
Token Rate: 500,000 TPM.
Expert Tier 2
Requires a $50 spend.
Grants GPU access.o
Highest request rate of 3,000 RPM.
Token Rate: 800,000 TPM.
Upgrade Process
Users can upgrade their tier by meeting the respective requirements.
The "Upgrade" or "Deposit" button in the interface allows users to progress to higher tiers.
Higher tiers provide increased computational power and request capabilities.
Last updated