This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Dear All,I'm quite new to DataFlow, I've build a job to read data from
SQL Server and write into BigQuery. When I created the job and run it I
could query the data in BigQuery, but when importing the job as pipeline
and set to run daily at a specific...
@ms4446 I was still troubleshooting, and to workaround it I was running
the job every day on my own, but yesterday when running the job and
today too, I got new error"org.apache.beam.sdk.util.UserCodeException:
java.sql.SQLException: Cannot create Po...
@ms4446 thank for addressing the troubleshooting. But look the
cenario:The Job runs with no error. If I create the pipeline using the
"+ IMPORT AS PIPELINE" from the jobs screen, using the same job I just
run, I got the error INVALID_ARGUMENT.If I cr...
@ms4446 yesterday I was making some tests. I've found that when not
using, from Data Flow Job screeen, "+ import as pipeline" the
INVALID_ARGUMENT doesn't happen. So I've created my pipeline from Data
Flow Pipeline Screeen and "+ CREATE DATA PIPELINE...
Thank you again @ms4446 I'll go on with the investigation. Just for
testing I've created a simple job, using avaiable template, reading a
BigQuery table and exporting to a parquet file on cloud storage. Created
a new service account and give the role...
Hi @ms4446 Thank you again for your time on helping me.about the
INVALID_ARGUMENT you have written that the endpoint :run might be
expecting some additional parameters. I try to look into it, but do you
have any idea where I can found it? The possibl...
