Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

DATAFLOW: Where in the Dataflow UI can I see my Parameters?

Hi!

Where in the dataflow UI can I see my Parameters? In the Job Info section, I can only  see:

Job Info:

Job name, Job ID, Job type, Job status, etc

Resource metrics:

Total vCPU time , Current memory, Total memory time, Current HDD PD, etc

 

Pipeline options

beam_plugins, job_name (again?), machine_type, project, region, requirements_file, runner, service_account_email, setup_file, staging_location, temp_location, template_location
 
I'm talking about this:
Screen Shot 2023-05-26 at 14.16.38.png
Screen Shot 2023-05-26 at 14.19.52.png
 
--
Best regards
David Regalado
Web | Linkedin | Twitter
0 2 226
2 REPLIES 2

Could you provide some additional details about the Dataflow pipeline you're aiming to set up? The required and optional parameters can vary based on the specific type of pipeline you're trying to create, as well as whether you're using Flex Templates. Flex Templates allow you to set several optional parameters, such as disk_size_gb, workerMachineType, workerRegion, network, subnetwork, and usePublicIps among others. Could you also confirm if you're planning to use Flex Templates for your pipeline?

Flex Templates customized for my use case. Would these parameters be available in the future?

Right now, I have to log.info all.

--
Best regards
David Regalado
Web | Linkedin | Twitter