So I need to select a data ingestion tool for data platform based on GCP.
At first glance - Cloud Data Fusion makes sense - has pre-built connectors. Easy, just extract and sink it. And we need ingest just raw data, no transformations. But from various sources, like SAP and other DBs. No-code raw data ingestion makes sense.
However CDF has some annoying bits:
Loads of add-ons (orchestration, metadata), which duplicates other tools already selected, like Composer.
Instances, licences, updates, plugin updates - quite a bit of management/maintenance required
Just reading the network options/configs is giving me headache...
Also don't like this heavy focus on UI / No code, but it's ok, as the plan is only to use it for ingestion. But don't like that no-code focus in general.
So what's you go-to data ingestion tool on GCP and why?
LinkedIn
Twitter
