Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Multiple Database Tables from Oracle in DataFusion

I want to load multiple tables from an Oracle db using DataFusion, I am using "Multiple Database Tables".

If I use normal Oracle source everything works fine but when I use the Multiple Database I get an error "Output records have not been generated. Please verify your logic or try sending more data.". I think there is an error in my configuration but I can't find it. I set the jdbc string and plugin and I am using Table Allow List leaving all the fields empty. I can not find any example of using Multiple Database to load Oracle, is there an issue with Oracle?

Solved Solved
1 4 1,265
2 ACCEPTED SOLUTIONS

There is no inherent issue with using the "Multiple Database Tables" source to load Oracle data in Cloud Data Fusion. The error message you're encountering suggests that the source isn't generating any data. This could be attributed to several reasons:

  • The targeted tables might not exist.
  • The tables you're attempting to load might be empty.
  • There might be permission restrictions preventing you from reading the tables.
  • The JDBC connection string might be incorrect.
  • The plugin might not be correctly installed or configured.

To address this, consider the following steps:

  1. Table Verification: Ensure the tables you're trying to access exist and contain data.
  2. Permission Check: Confirm that you have the necessary permissions to read the tables.
  3. JDBC String: Double-check the JDBC connection string. The correct format can be found in Oracle's official documentation.
  4. Plugin Configuration: Ensure the plugin is both installed and correctly configured. The Cloud Data Fusion documentation provides guidelines for installing and setting up the Oracle plugin.

Additional troubleshooting steps:

  • Preview Mode: Use Cloud Data Fusion's Preview mode to test your source's configuration. This lets you view the data generated by the source without executing the entire pipeline.
  • Debug Mode: Activate Debug mode in Cloud Data Fusion to step through your pipeline's execution. This provides insights into logs and potential errors from the source.
  • Log Review: Examine the Cloud Data Fusion logs for any reported errors or issues from the source.

View solution in original post

Enabling "Allow flexible schemas in Output" in my sink "BigQuery multi table" solved the issue.

View solution in original post

4 REPLIES 4