This page provides instructions on how to integrate your OCI cluster with VESSL.
Access VESSL on OCI marketplace
General configuration
Cluster name prefix
: Enter the name for your cluster. This name will be
displayed in the VESSL platform under Clusters.Enable DNS for cluster
:
example.com
:
.example.com
service1.example.com
and model.example.com
.OKE cluster configuration
Kubernetes version
: Specify the Kubernetes version your cluster will
use. Default is version v1.32.1
.CPU Pool OCPUs (Oracle CPUs)
: Specify the number of OCPUs for each node
in the CPU Pool. This defines the processing power per node. Each node in
the CPU pool will be provisioned as a VM.Standard.E4.Flex
instance.CPU Pool Memory
: Specify the memory allocated per server (default is
6GB).CPU Pool Size
: Define how many non-GPU (CPU-only) servers to set up
initially.Enable CPU Pool Autoscaling
: Enable this option to automatically scale
servers based on CPU usage.GPU pool configuration
Enable GPU Pool 1
: Check this to utilize GPUs in your cluster. You can
enable up to 3 GPU Pools (Pool1, Pool2, Pool3) to accommodate different
GPU configurations. Each enabled pool supports the same configuration
options listed below.
GPU Type
: Select your desired GPU model (for example, A10, A100).GPU Pool Shape
: Choose the server shape that includes your selected GPU
(for example, BM.GPU4.8
indicates a server with 8 A100 GPUs).GPU Pool Node Count
: Enter the number of GPU nodes to launch initially
within this pool.Enable Multi-Instance GPU (MIG)
:
MIG Profile
:
1g.5gb(x7)
splits one A100 GPU into 7 instances).Connecting to VESSL
DNS configuration
Complete integration