Integrating Your AWS Cluster with VESSL AI
You can provision and integrate an AWS Cluster directly into your existing AWS account via the AWS Marketplace by filling out a simple Quick Launch form.
This form automatically creates and configures AWS infrastructure, which is then directly integrated into your VESSL cluster environment.
Step-by-Step Integration Guide
1. Access VESSL AI on AWS Marketplace
- Visit the AWS Marketplace and search for “VESSL AI”.
- Click “View purchase options” to check the pricing.
- Accept the terms and subscribe.
- After subscribing, the Quick Launch option will become available.
2. Sign in to VESSL Account
- Click Step 2: Sign in or create an account to log in to VESSL AI.
- Select your Organization after logging in.
- Click Generate AWS EKS Integration Token.
- Copy the generated token — you’ll need to paste this later in the CloudFormation form.
📝 Make sure you select the correct organization before generating the token.
3. Configure Your Integration via Template
- On the AWS Marketplace page, click Launch template under Quick Launch.
- Select the Region where your cluster will be deployed.
⚠️ Caution: This Region must match the one you will specify later in the CloudFormation parameters.
4. Fill Out Stack Parameters
You’ll be redirected to the CloudFormation form.
Fill in the following parameters:
- Stack Name: This will be your VESSL cluster name.
- AgentAccessToken: Paste the token copied from Step 2.
- ClusterDomainName (optional but recommended):
- Use a custom domain (e.g.,
example.com
). - Services will be accessible via subdomains like
service1.example.com
,model.example.com
, etc.
- Use a custom domain (e.g.,
- CPUPoolMax / CPUPoolMin: Set max/min CPU nodes per availability zone. (Defaults: 5 / 0)
- GPUInstanceType: Select your preferred GPU instance type (e.g.,
g5.xlarge
,p3.2xlarge
). - GPUPoolMax / GPUPoolMin: Set max/min GPU nodes per availability zone. (Defaults: 5 / 0)
- Region: ⚠️ Must match the region selected during the Launch Template step.
5. Optional Settings
- Tags: Add up to 50 key-value pairs for organizing and managing your resources.
- Permissions: Optionally specify an existing IAM role that CloudFormation should assume.
- Stack Failure Options:
- Define rollback behavior upon provisioning failure.
- Choose whether to delete or retain resources after rollback.
- Advanced Settings:
- Stack policy
- Notification options (e.g., via SNS)
- Rollback monitoring (e.g., via CloudWatch)
- Timeout and termination protection
6. DNS Configuration
Once you complete the CloudFormation form and click Next, the stack’s Outputs section will display your DNS configuration details.
To complete the DNS setup:
- A Route 53 Hosted Zone will be automatically created based on the
ClusterDomainName
you provided. - Copy the Nameserver (NS) records listed in that Hosted Zone.
If using a root domain (e.g., example.com
):
- Go to your domain registrar (e.g., GoDaddy, Namecheap).
- Replace your domain’s NS records with the values from the Route 53 Hosted Zone.
If using a subdomain (e.g., ml.example.com
):
- Keep your main domain (
example.com
) on your existing provider. - Create a NS record for the subdomain (
ml
) and point it to the Route 53 Hosted Zone’s nameservers.
✅ This allows VESSL services to be securely accessed at subdomains like model.example.com
.
7. Completion
Once the CloudFormation stack is successfully created:
- Your AWS EKS Cluster will appear in the VESSL Console.
- The cluster is now ready to run:
- ✅ Training
- ✅ Inference
- ✅ Service workloads
- You can now deploy models and pipelines using Workspace, Service, or Run.