> ## Documentation Index
> Fetch the complete documentation index at: https://docs.vessl.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Integrating your OCI cluster with VESSL

> This page provides instructions on how to integrate your OCI cluster with VESSL.

You can provision and integrate an OCI Cluster directly into your existing OCI account using the OCI Marketplace by filling out a simple Terraform-based form. This form automatically creates and configures Oracle infrastructure, which is then directly integrated into your VESSL cluster environment.

## Step-by-step integration guide

<Steps>
  <Step title="Access VESSL on OCI marketplace">
    * Visit the **OCI Marketplace** and search for **VESSL AI**.
    * Click on **Get App** to open the Terraform configuration form.
  </Step>

  <Step title="General configuration">
    * `Cluster name prefix`: Enter the name for your cluster. This name will be
      displayed in the VESSL platform under **Clusters**.
    * `Enable DNS for cluster`:
      * To use VESSL for easy deployment, inference and to access workloads
        securely through HTTPS, enabling the DNS option for your cluster is
        required.
      * Enter your desired subdomain for the cluster. For example, if you enter
        `example.com`:
        * An SSL certificate will be issued for `.example.com`
        * Services will be accessible at subdomains such as
          `service1.example.com` and `model.example.com`.
      * If unchecked, the cluster will only be accessible through its IP address.

    <Frame>
      <img
        style={{
      width: 600,
      display: 'block',
      margin: '0 auto',
      borderRadius: '0.5rem',
    }}
        src="https://mintcdn.com/vesslai/p4Iy0AO-LrmBbPuL/images/clusters/oci/General%20Configuration.png?fit=max&auto=format&n=p4Iy0AO-LrmBbPuL&q=85&s=06d2992bbd1836dcfd2c8d9490e64ebd"
        alt="Cluster General Configuration"
        width="991"
        height="273"
        data-path="images/clusters/oci/General Configuration.png"
      />
    </Frame>
  </Step>

  <Step title="OKE cluster configuration">
    VESSL utilizes Oracle Kubernetes Engine (OKE) to execute your AI workloads.
    Set up the CPU compute resources here:

    * `Kubernetes version`: Specify the Kubernetes version your cluster will
      use. Default is version `v1.32.1`.
    * `CPU Pool OCPUs (Oracle CPUs)`: Specify the number of OCPUs for each node
      in the CPU Pool. This defines the processing power per node. Each node in
      the CPU pool will be provisioned as a `VM.Standard.E4.Flex` instance.
    * `CPU Pool Memory`: Specify the memory allocated per server (default is
      6GB).
    * `CPU Pool Size`: Define how many non-GPU (CPU-only) servers to set up
      initially.
    * `Enable CPU Pool Autoscaling`: Enable this option to automatically scale
      servers based on CPU usage.

    <Frame>
      <img
        style={{
      width: 600,
      display: 'block',
      margin: '0 auto',
      borderRadius: '0.5rem',
    }}
        src="https://mintcdn.com/vesslai/p4Iy0AO-LrmBbPuL/images/clusters/oci/OKE%20Cluster%20Configuration.png?fit=max&auto=format&n=p4Iy0AO-LrmBbPuL&q=85&s=19b5d18a8b8813062efd965004f2fc64"
        alt="OKE Cluster Configuration"
        width="991"
        height="427"
        data-path="images/clusters/oci/OKE Cluster Configuration.png"
      />
    </Frame>
  </Step>

  <Step title="GPU pool configuration">
    * `Enable GPU Pool 1`: Check this to utilize GPUs in your cluster. You can
      enable up to 3 GPU Pools (Pool1, Pool2, Pool3) to accommodate different
      GPU configurations. Each enabled pool supports the same configuration
      options listed below.
      * To request additional GPUs, contact [support@vessl.ai](mailto:support@vessl.ai).
    * `GPU Type`: Select your desired GPU model (for example, A10, A100).
    * `GPU Pool Shape`: Choose the server shape that includes your selected GPU
      (for example, `BM.GPU4.8` indicates a server with 8 A100 GPUs).
    * `GPU Pool Node Count`: Enter the number of GPU nodes to launch initially
      within this pool.

    <Frame>
      <img
        style={{
      width: 600,
      display: 'block',
      margin: '0 auto',
      borderRadius: '0.5rem',
    }}
        src="https://mintcdn.com/vesslai/p4Iy0AO-LrmBbPuL/images/clusters/oci/GPU%20Pool%20Configuration.png?fit=max&auto=format&n=p4Iy0AO-LrmBbPuL&q=85&s=60b8ad9844e3541a8afd0c17f4e39718"
        alt="GPU Pool Configuration"
        width="1930"
        height="1246"
        data-path="images/clusters/oci/GPU Pool Configuration.png"
      />
    </Frame>

    * `Enable Multi-Instance GPU (MIG)`:
      * This option appears only if your selected GPU that supports MIG.
      * Enabling MIG allows partitioning a single GPU into multiple smaller
        instances.
    * `MIG Profile`:
      * Specify how you wish to partition the GPU (for example, selecting
        `1g.5gb(x7)` splits one A100 GPU into 7 instances).

    <Frame>
      <img
        style={{
      width: 600,
      display: 'block',
      margin: '0 auto',
      borderRadius: '0.5rem',
    }}
        src="https://mintcdn.com/vesslai/p4Iy0AO-LrmBbPuL/images/clusters/oci/GPU%20Pool%20Configuration2.png?fit=max&auto=format&n=p4Iy0AO-LrmBbPuL&q=85&s=ac1a29e52a364b71e7a0707e957c80c1"
        alt="GPU Pool Configuration2"
        width="1900"
        height="1430"
        data-path="images/clusters/oci/GPU Pool Configuration2.png"
      />
    </Frame>
  </Step>

  <Step title="Connecting to VESSL">
    <Frame>
      <img
        style={{
      width: 600,
      display: 'block',
      margin: '0 auto',
      borderRadius: '0.5rem',
    }}
        src="https://mintcdn.com/vesslai/p4Iy0AO-LrmBbPuL/images/clusters/oci/Connecting%20to%20VESSL%20AI%20Platform.png?fit=max&auto=format&n=p4Iy0AO-LrmBbPuL&q=85&s=436e8502de1faaab9b2e9a28299888d3"
        alt="Connecting to VESSL"
        width="993"
        height="192"
        data-path="images/clusters/oci/Connecting to VESSL AI Platform.png"
      />
    </Frame>

    * Visit [vessl.ai](http://vessl.ai/) and sign up or log in.
    * Navigate to the **Clusters** section and click **New Cluster**.
    * When selecting **OCI OKE** as the cluster type, an **OCI Token** will
      appear.
    * Copy the **OCI Token** and paste it into the **VESSL Agent Access Token**
      field on the OCI Marketplace form.

    <Frame>
      <img
        style={{
      width: 600,
      display: 'block',
      margin: '0 auto',
      borderRadius: '0.5rem',
    }}
        src="https://mintcdn.com/vesslai/p4Iy0AO-LrmBbPuL/images/clusters/oci/Access%20Token.png?fit=max&auto=format&n=p4Iy0AO-LrmBbPuL&q=85&s=5f514bff72fbee95bbbf0501ea1275bd"
        alt="Access Token"
        width="1190"
        height="474"
        data-path="images/clusters/oci/Access Token.png"
      />
    </Frame>
  </Step>

  <Step title="DNS configuration">
    Once you fill out the form and click **Next** at the bottom, the DNS key and
    value will be displayed in the output section. Please copy this DNS
    information and update your domain's nameserver settings accordingly.

    <Frame>
      <img
        style={{
      width: 600,
      display: 'block',
      margin: '0 auto',
      borderRadius: '0.5rem',
    }}
        src="https://mintcdn.com/vesslai/p4Iy0AO-LrmBbPuL/images/clusters/oci/DNS%20Information.png?fit=max&auto=format&n=p4Iy0AO-LrmBbPuL&q=85&s=f71db3fad8ed649732746cda4e8eca41"
        alt="DNS Information"
        width="1716"
        height="826"
        data-path="images/clusters/oci/DNS Information.png"
      />
    </Frame>

    <Frame>
      <img
        style={{
      width: 600,
      display: 'block',
      margin: '0 auto',
      borderRadius: '0.5rem',
    }}
        src="https://mintcdn.com/vesslai/p4Iy0AO-LrmBbPuL/images/clusters/oci/update%20nameserver.png?fit=max&auto=format&n=p4Iy0AO-LrmBbPuL&q=85&s=6158f353d0f03c582bd64c9111742641"
        alt="update nameserver"
        width="544"
        height="303"
        data-path="images/clusters/oci/update nameserver.png"
      />
    </Frame>
  </Step>

  <Step title="Complete integration">
    Once all configurations are submitted and the stack is successfully created,
    your **OCI Cluster** will appear in VESSL as an integrated resource, ready
    for deployment and inference workloads.

    <Frame>
      <img
        style={{
      width: 600,
      display: 'block',
      margin: '0 auto',
      borderRadius: '0.5rem',
    }}
        src="https://mintcdn.com/vesslai/p4Iy0AO-LrmBbPuL/images/clusters/oci/Completion1.png?fit=max&auto=format&n=p4Iy0AO-LrmBbPuL&q=85&s=74b71356b67b7bdfbea6bd3bc8b8004b"
        alt="Completion1"
        width="1172"
        height="311"
        data-path="images/clusters/oci/Completion1.png"
      />
    </Frame>

    <Frame>
      <img
        style={{
      width: 600,
      display: 'block',
      margin: '0 auto',
      borderRadius: '0.5rem',
    }}
        src="https://mintcdn.com/vesslai/p4Iy0AO-LrmBbPuL/images/clusters/oci/Completion2.png?fit=max&auto=format&n=p4Iy0AO-LrmBbPuL&q=85&s=342d166e57b47dc1b172ec410df03f41"
        alt="Completion2"
        width="1223"
        height="606"
        data-path="images/clusters/oci/Completion2.png"
      />
    </Frame>

    <Frame>
      <img
        style={{
      width: 600,
      display: 'block',
      margin: '0 auto',
      borderRadius: '0.5rem',
    }}
        src="https://mintcdn.com/vesslai/p4Iy0AO-LrmBbPuL/images/clusters/oci/Completion3.png?fit=max&auto=format&n=p4Iy0AO-LrmBbPuL&q=85&s=4849753059f665543f89d4ce2be3e621"
        alt="Completion3"
        width="1212"
        height="345"
        data-path="images/clusters/oci/Completion3.png"
      />
    </Frame>
  </Step>
</Steps>