This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Hi folks so I have a usecase where I need a realtime pipeline to push mongodb cdc data to big query for analytics. I went through Google cloud docs and I found a solution which covers some part of my problem [ https://cloud.google.com/dataflow/docs/guides/templates/provided-streaming#mongodb-to-bigquery-cdc ] . But here the pre requisites is to have "The change stream pushing changes from MongoDB to Pub/Sub should be running". In order to do this we have to use debezium or similar kind of service. We are mostly looking for a managed service for this usecase rather than self hosting debezium. Are there any services in GCP which can help me in this ? Also are there any plans for modifying apache beam mongo connector libraries for cdc streaming ?
LinkedIn
Twitter
