I recently got an alert that several events in a Datastream Stream were discarded because streaming to a BQ table partition more than 5 years in the past is not supported. I paused the stream and created non-partitioned BQ tables with the same schema, and then loaded the original tables' data into them. However, now I'm not able to rename the old tables so I can use the original names for the non-partitioned tables and restart the steam. When I attempt an `ALTER TABLE ... RENAME TO` command, I get this error:
```
Invalid value: Cannot rename project:dataset.tablename because it has streaming data. at [1:1]
```
I paused the Stream 3 days ago, and I'm still getting this message. What is the right way to rename a table Datastream has streamed to historically, or alert BQ that there is no more data in the streaming buffer? Do I need to delete the Datastream info columns? I'm wary of creating a new stream and potentially losing the record of progress for what has already been written to BQ from the current Stream.
LinkedIn
Twitter
