Is Signed URL using Apigee proxy the right solution for transferring video files more than 10MB ?

[samjam1311]

HI Apigee Support, @DinoChiesa,

My organization has an Azure Databricks application that is supposed to connect to a third party S3 bucket to download the video files which can be less than or greater than 10MB even up to 50-60MBs. It is an API centric integration and Apigee being the API gateway for my organization, we wanted to check if the Signed URL with Apigee proxy is the right way to do this?

I'm referring the Apigee callout for Signed URL -
https://github.com/DinoChiesa/Apigee-Java-GoogleUrlSigner/blob/master/README.md

It talks about how to download/upload a bucket object from/to GCS.
Please confirm if the below sequence of steps is how the files should be transferred using Apigee callout ?

 based on this, my question is - how do the Azure Databricks app that wants to download the data from GCS would know the resource details after the 3rd Party Bucket had uploaded the file to GCS ?

[samjam1311]

can someone take a look at this question?

[ssvaidyanathan]

@samjam1311 - The example posted by @dchiesa1 was for GCS specifically as the callout works only for GCS to generate Signed URLs. 

Not sure I understand your use case? Can you elaborate on that please? Do you need to upload / download from S3 or from GCS? 

[samjam1311]

The requirement is changed a bit now and it is to upload/download the files from Azure Blob storage so instead of GCS, it will be Azure Blob Storage, and we would like to see if the Signed URL solution can be used for the same?

[ssvaidyanathan]

Yes - you should be able to use the Azure Java SDK and see if that works as a Java Callout. The same sample will not work as it uses GCP SDK

[dchiesa1]

or have a look at this

https://github.com/DinoChiesa/Apigee-Java-Azure-Storage-Sas