We are facing 80 seconds of latency in Datastream Mysql to Bigquery.
Reducing the binlog size configuration will help if transactions are too big since binlog files are still very big. So this workaround provided will only work for smaller transactions since smaller binlogs means Datastream can scale and read different files concurrently to support higher loads.
Is there any other workaround reduce the latency?
LinkedIn
Twitter
