Fine-tune Phi-4 with counselling dataset
phi-4-fine-tuning.yaml
file.
hf://
scheme — this goes the same for other cloud storages as well, s3://
for Amazon S3 for example.In this example, we are using mental health counselling conversations dataset hosted on Hugging Face.main.py
.vessl run create -f phi-4-fine-tuning.yaml
Once the run is completed, you can follow the link in the terminal to see the result of the run.
You can find the files under Storage.
.pt
files to mounted volumes or model registry and ensures seamless checkpointing of fine-tuning progress.DistributedDataParallel
and simplifies the process for setting up multi-cluster, multi-node distributed training.