How to get CSV file path in Data Fusion

[sandium]

Hi There,

I am loading multiple csv files in my BigQuery and wanted to store the file path as well in the BigQuery to know the records coming from which csv. Unable to find such option in Cloud Fusion and Wrangler.

[dikaur]

You can connect GCS source to the BigQuery Sink with the full schema[1] . Schema should be the same as you want to use in BigQuery. Also I found some recommendation on [2] that can be useful.

[1] https://cloud.google.com/data-fusion/docs/tutorials/targeting-campaign-pipeline

[2] https://codelabs.developers.google.com/codelabs/batch-csv-cdf-bq#5