Storage
Overview
VESSL provides a robust, scalable, and flexible storage system integrated seamlessly into your AI/ML development workflow. It supports both managed and external storage options, allowing for secure and efficient storage of diverse data types such as models, logs, and datasets.
A volume is the unit of storage operation in VESSL, which can be imported or mounted to the workload container during the initialization step. This allows data to be accessible throughout the execution process. After the run commands are executed, volumes can also be exported for further use.
Key features
- Automatic storage provisioning: Files and directories are fully managed in VESSL Storage.
- Flexibility with external storage: Integrate with external storage systems, including AWS S3, Google Cloud Storage, and on-premise NFS systems, without data migration.
- Seamless integration to workloads: All volumes in the storage can either be imported or mounted directly to machine learning workloads, including runs, workspaces, services, and pipelines. This ensure quick access to necessary data, optimizing performance and minimizing initialization time during operations.
- Exporting artifacts to storage: All artifacts generated by your workloads, such as logs, metrics, and model checkpoints, can be exported to a volume in storage. This ensures that important results and data are securely stored and easily accessible for future use or analysis.