Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.vessl.ai/llms.txt

Use this file to discover all available pages before exploring further.

You can provision and integrate an AWS Cluster directly into your existing AWS account using the AWS Marketplace by filling out a simple Quick Launch form. This form automatically creates and configures AWS infrastructure, which is then directly integrated into your VESSL cluster environment.

​
Step-by-step integration guide

1

Access VESSL AI on AWS marketplace

  • Visit the AWS Marketplace and search for VESSL AI.
  • Click View purchase options to check the pricing.
  • Accept the terms and subscribe.
  • After subscribing, the Quick Launch option will become available.
    Quick Launch
2

Sign in to your VESSL account

  • Click Step 2: Sign in or create an account to log in to VESSL.
  • Select your Organization after logging in.
Select Organization
  • Click Generate AWS EKS Integration Token.
Token Generation
  • Copy the generated token — you’ll need to paste this later in the CloudFormation form.
Make sure you select the correct organization before generating the token.
3

Configure your integration using a template

  • On the AWS Marketplace page, click Launch template under Quick Launch.
  • Select the Region where your cluster will be deployed.
This Region must match the one you will specify later in the CloudFormation parameters.
Step
Launch Template
4

Fill out stack parameters

You’ll be redirected to the CloudFormation form.
Stack Name
Stack Parameters
Fill in the following parameters:
  • Stack Name: This will be your VESSL cluster name.
  • AgentAccessToken: Paste the token copied from Step 2.
  • ClusterDomainName (optional but recommended):
    • Use a custom domain (e.g., example.com).
    • Services will be accessible at subdomains such as service1.example.com and model.example.com.
  • CPUPoolMax / CPUPoolMin: Set max/min CPU nodes per availability zone. (Defaults: 5 / 0)
  • GPUInstanceType: Select your preferred GPU instance type (e.g., g5.xlarge, p3.2xlarge).
  • GPUPoolMax / GPUPoolMin: Set max/min GPU nodes per availability zone. (Defaults: 5 / 0)
  • Region:
    Must match the region selected during the Launch Template step.
5

Configure optional settings

  • Tags: Add up to 50 key-value pairs for organizing and managing your resources.
  • Permissions: Optionally specify an existing IAM role that CloudFormation should assume.
  • Stack Failure Options:
    • Define rollback behavior upon provisioning failure.
    • Choose whether to delete or retain resources after rollback.
  • Advanced Settings:
    • Stack policy
    • Notification options (e.g., using SNS)
    • Rollback monitoring (e.g., using CloudWatch)
    • Timeout and termination protection
Optional Settings
Advanced Settings
6

Configure DNS

Once you complete the CloudFormation form and click Next, the stack’s Outputs section will display your DNS configuration details.To complete the DNS setup:
  • A Route 53 Hosted Zone will be automatically created based on the ClusterDomainName you provided.
  • Copy the Nameserver (NS) records listed in that Hosted Zone.
✅ This allows VESSL services to be securely accessed at subdomains like model.example.com.
7

Complete integration

Once the CloudFormation stack is successfully created:
  • Your AWS EKS Cluster will appear in the VESSL Console.
  • The cluster is now ready to run:
    • ✅ Training
    • ✅ Inference
    • ✅ Service workloads
  • You can now deploy models and pipelines using Workspace, Service, or VESSL Run.
Cluster Completion