Finetuning a Computer vision model from HuggingFace

[gminardi]

Hello,

I am relatively new to Google Cloud and have been working on fine-tuning a customized Vision Transformer model using Huggingface and PyTorch over the past few weeks. My training data consists of images stored in a Google Cloud Storage Bucket, and I have successfully tested my training script on AWS Sagemaker. The script has been containerized and is currently stored in Artifact Registry.

My goal is to train this custom model on Google Cloud and subsequently deploy it. Using a combination of the official documentation and assistance from ChatGPT, I have managed to initiate the training process. However, I am finding it challenging to locate comprehensive guidance on the best practices or recommended approaches for building an end-to-end pipeline for model training and deployment on Google Cloud.

Could anyone provide insights or references to resources that outline the optimal steps for constructing such a pipeline within the Google Cloud ecosystem? Any advice on integrating the various Google Cloud services—such as Vertex AI Platform—into this workflow would be greatly appreciated.

Thank you for your assistance.

[jaia]

Hello,

Thank you for contacting the Google Cloud Community.

Please find the following document helpful:
Custom Jobs
Vertex AI documentation

Regards,
Jai Ade

[gminardi]

Hi there,

I've been going through the documentation, but I'm finding the details about accessing Google Cloud Storage using a custom job with a custom image a bit unclear. I'm trying to use FUSE for this, but I haven't had much success so far. Could you point me to the specific section of the documentation that covers this? Your help would be greatly appreciated!

[gminardi]

Hello,

I've been manually downloading data using a script, but I’m concerned this might be inefficient for handling large datasets. Are there faster alternatives available in Google Cloud, similar to what other providers offer?

Additionally, I’m having trouble specifying a location for an artifact in my GCS bucket—it doesn't seem to appear where I expect. Could someone guide me on how to correctly set the target location in the bucket?

Thanks!