BigQuery Data Transfer Service job stuck in "pending" status

[kamizuru]

Hello,

I'm trying to use BigQuery Data Transfer Service from Amazon S3 to transfer data, but the job has been stuck in "pending" status for over an hour and hasn't completed. I'm not sure what the issue could be, as I've successfully used this service before. The data transfer involves a moderate amount of data, but nothing that should be causing this delay.

Can someone please help me troubleshoot this issue? What could be causing the job to remain in "pending" status for so long? Are there any logs or error messages that I can check to get more information? Any help would be greatly appreciated.

Thank you.

[ms4446]

When a BigQuery Data Transfer Service job remains in "pending" status for an extended period, there are several potential issues to consider. Here are some possible causes and steps you can take to troubleshoot the problem:

1. Verify the transfer configuration: Ensure that you have completed all the necessary steps in the "Before You Begin" section of the documentation for your transfer type. Double-check that the transfer configuration properties are correct and that the user account used to create the transfer has the necessary permissions to access the underlying resources.

2. Check for error messages: Examine the run history for the transfer job to look for any error messages or relevant details that can help identify the issue. Capturing the error messages from the run history will be helpful if you need to contact customer support.

3. Check for quota limitations: If you are encountering a "Quota Exceeded" error, it means that the transfer is exceeding the allocated quota for BigQuery load jobs. You can contact your Google Cloud sales representative to request an increase in quota. Note that quota errors can occur when loading Cloud Billing exports to BigQuery, especially when choosing the overwrite option for partitioned tables.