NetSuite to BigQuery Connection

[adkrk]

Hi Community,

Task:
I need to get a saved search from NetSuite and load it into BigQuery with daily data refreshes. I would love to achieve this using native connectors without involving 3rd parties.

Tried Solutions:

I’ve tried multiple approaches within GCP. One of them involved using NetSuite's Integration Connector with the SuiteTalk schema and Token-Based Authentication (though I’m not sure if that was the correct method). I also tried using SuiteQL but kept receiving an error. However, I couldn’t finalize the Application Integration. I even tried using Gemini to walk me through the process, but in the end, it said it was surprised the explained approach didn’t work. 🙂

But jokes aside, I also tried using the most recent lab on Application Integration and encountered an error during the test phase. Overall, this approach did not work. 

Would appreciate any guidance on how to approach this task with any solution that may work here. Thank you. 

[AlexET]

Hello @adkrk,

We saw your question and wanted to let you know we’re keeping it on our radar. We’ll also invite others in the community to pitch in and share their thoughts.

[adkrk]

Hello AlexET,

Thank you for your reply. Looking forward to finding the solution for this.

[slebrun]

Hello @adkrk 

I'd be happy to help you troubleshoot this. Could you please share more details about the specific issues you encountered when trying to use the NetSuite connector in Application Integration, as well as the errors you saw during the Application Integration lab? The more information you can provide, the better I can assist you.

[ananymisra]

Hi  @adkrk , you can try this solution:

1. Create  a Script in NetSuite to Export the Saved Search

• We need to use SuiteScript to load your saved search and export the results as a CSV or JSON file and will utilize this  script which  should run automatically on a daily schedule inside NetSuite.
  
  
• Once the file is created, the script should upload it to Google Cloud Storage using a signed URL (so it can upload without needing full credentials).

2. Set Up a Google Cloud Storage (GCS) Bucket

• In Google Cloud, create a storage bucket where NetSuite can drop the files and generate a signed URL for NetSuite to use when uploading the file. This is secure, time-limited URL that allows the upload without complex authentication.
  
  
• Move the File from GCS into BigQuery here we will Use BigQuery Data Transfer Service to automatically load the file from GCS into your BigQuery table every day.

3. Schedule and Automate Everything

• NetSuite will run the export script every day and GCP will handle the file arrival and loading automatically.

More details can be found here: https://docs.oracle.com/en/cloud/saas/netsuite/ns-online-help/section_157660608065.html