Renaming tables while using Dataflow Datastream to Bigquery Template

[Oyugi-Collins]

Hi ,

I am moving data from MySQL DB to Bigquery using the google provided templates, Datastream to Bigquery .Unfortunately some of my tables have space(s) in their table names causing errors to be thrown by the dataflow job.

Exact error been thrown (java.lang.IllegalArgumentException: Table reference is not in [project_id]:[dataset_id].[table_id] format)

How can I rename the tables during the this data transfer stage ?

Thanks 

[clementbellido · Accepted solution]

Hi! Unfortunately, Beam’s regex used for table validation doesn’t support spaces. Most probably this is a bug on Beam side, you could fill a bug report here

[Oyugi-Collins]

Hi @clementbellido thanks for the reply, it was helpful