Hello, I am creating a dataflow pipeline using java that will read from BQ and then insert the data into a mysql db. It reads using bigquery io, but my understanding now is that i cannot use side inputs with bigquery io. The read performed is something like below where it queries a string "select * from table"
PCollection<TableRow> data = pipeline.apply("read from BQ",
BigQueryIO
.readTableRows()
.fromQuery(query)
.usingStandardSql());
But i need to make an api call to another application that will go into a db and retrieve a date for me. so how can i do it to where I get that date from the api call and then include it into my query where it will be something like:
select * from table where date = "date from api call"
LinkedIn
Twitter
