Google cloud run function network is slow

[rkolluri]

We have a simple cloud run function that does video processing and uploads processed videos to youtube. We have configured our function to have at least one instance running.

We are seeing very low network bandwidth when downloading videos from S3 or when uploading them to youtube. Given both uploads and downloads are slow, we suspect this is an issue with your cloud run function setup.

Any advice on how to get better networking performance here?

Thanks!

[KyleMari]

Hi @rkolluri,

Welcome to the Google Cloud community!

Based on the video processing that your Cloud Run function is designed to do, I'd assume you're using Amazon S3 and Youtube Data API which are essential for this task.

There are numerous factors that may affect the network bandwidth during the video processing task. Here are some of the areas to look into to identify the root cause:

• Verify the instance location. If your S3 bucket and your Cloud Run function both differ in region, there's a possibility that this may affect the download speed. It's worth a shot to check if certain adjustments are needed. Perhaps making sure that both ends can be in the same or if not -- close in region.
• Evaluate the need to increase your function's resource allocation. When there's a sudden increase of requests going on for your function during autoscaling, there are times that Cloud Run may take time when allocating resources. Limits in terms of CPU and memory allocation for a function could also affect the network bandwidth for data transfers. It's best to evaluate whether this may be the right time to increase CPU/Memory allocation for your Cloud Function.
• Check the network speed by making direct calls to the external APIs: For this one, see first if there's a way you can test the performance when connecting to (1) your S3 bucket in terms of downloading objects and (2) making API calls to Youtube Data API in terms of uploading a video. While Cloud Run function is out of the picture, is the network speed normal as expected? Is the download or upload speed still slow?
• Also bear in mind the network bandwidth limitations leaning on both S3 and Youtube. In addition to the previous tip above, perhaps there are network limits, speed or bandwidth issues arising due to external factors affecting the services involved in S3 (you may also check this post for detailed guide). For Youtube API, hitting certain quotas and rate limits could also be a contributing factor.

Lastly, make sure to log the performance and output of your Cloud Run function and see if from there, you can get more information about the way your function starts, executes and finishes its intended task -- and the length of time it takes to go from one milestone to the next. Also, this is one way to track your code (through a console log) if it's returning any errors or warnings that provide more clues about what more could be happening.

Hope this helps.