Announcements
This site is in read only until July 22 as we migrate to a new platform; refer to this community post for more details.
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

DATAFLOW: 0 elements added to the output after Flatten

I'm testing dataflow for 1 MongoDB document. It moves through the different steps of the pipeline. In the UI I can see, for a specific step, how many elements (1 in this case) were added and how many (again, 1) were at the output. But, that is not happening when I'm using beam.Flatten. I would expect to return that 1 document. The step after flatten (Export Results), which is a ParDo, shows 0 element at the input.

I'm using Python 3.8 SDK 2.37.0

Screen Shot 2023-05-29 at 20.31.47.png

 

Screen Shot 2023-05-29 at 20.32.10.png

 

--
Best regards
David Regalado
Web | Linkedin | Twitter

0 1 533
1 REPLY 1