BigQuery Data Transfer Salesforce Returning No Data to Display

[adnandmth]

I have bigquery data transfer connected with salesforce.

The transfer was succeed and I can see the schema exist in a proper format but the storage info shows 0 data.

I have more than 10 data transfers connected with salesforce and only this one particular transfer that has 0 data while in the salesforce instance itself this object has some data.

Appreciate any help as to how I can solve this.

[jangemmar]

Hi @adnandmth,

Welcome to Google Cloud Community!

The error that you’re getting “Fetching node details failed” often signals a permission-related problem. If your BigQuery service account lacks the proper IAM permissions to access your Salesforce data, it won’t be able to fetch the necessary information.

Ensure the service account you used for this particular Data Transfer has the necessary roles/permissions to access your Salesforce organization. I recommend using the roles/bigquery.admin IAM role as it includes all the common tasks to perform when using BigQuery Data Transfer Service.

Note: In some cases, the required permissions might differ between different data sources.

Also, Feel free to review the common Salesforce transfer issues using BigQuery.

I hope the above information is helpful.

[Snoshone07]

Hi @adnandmth Here are a few things you could try to troubleshoot the issue:

1. Check Salesforce Permissions: Make sure the service account has all the permissions it needs to access every record in the Salesforce object. Sometimes custom objects need extra permissions that aren't enabled by default.

2. Look at Salesforce Security Settings: Depending on how your Salesforce security is set up, some records might be hidden from the API, especially if they’re protected by specific access rules.

3. Review Transfer Logs in BigQuery: The transfer logs can be super helpful here. Head over to BigQuery’s Data Transfer Service logs section and see if there are any errors or warnings related to this table.

4. Double-Check the Object Data: Even if the object has data, it’s worth checking for any filters in Salesforce, like date or status filters, that could reduce the data being transferred—or even make it look empty.

5. Try a Manual Transfer: Running a manual transfer can sometimes reveal specific error messages that might not show up otherwise.

If none of this works, you could also look into using another tool that integrates with both Salesforce and BigQuery. For example, platforms like Windsor.ai offer data transfers from Salesforce to BigQuery and might help if these sync issues keep happening.

Hope these can be helpful!