Hi Team,
I'm working on cloud Application integration where I want to fetch data from the workday web service using SOAP API to the GCP cloud and I configured it successfully. now I'm exploring how I can get only updated data from the workday. like whenever insert, update and delete commands happen I need that updated to be ingested to my cloud GCS Bucket. Has anyone worked on this particular pipeline or anyone have any idea? if yes, please reply to this message.
That would requires Workday send the updated data every time when it's changed. Not sure if Workday supports some Webhook way to trigger external API. If so, you can configure it to trigger the integration.
@sanooj is there any way in Connector side to have the Workday event trigger?
Workday trigger is in roadmap.Alternate solutions would be as below
1)Incremental pull with LIST operation based on timestamp
2)If webhook can be implemented for workday, then generic webhook trigger can be used
Hi @Madhuvandhini
1) Incremental Pull on timestamp I'm not sure because it doesn't have a Timestamp for most web services.
2) I was looking into this trigger part and I need some understanding how to config and I it works to get updated data. I have few questions in my mind. can we have GVC for 15 mins
I also referred to a few documents on Fivetran. how it manages to bring increment data from the workday and I found it gets data based on transactional logs. and also I posed a query in the workday community and I got the same reply that we can get by using transactional logs.
Fivetran referece
https://fivetran.com/docs/connectors/applications/workday-hcm?_gl=1*1t0v9c8*_ga*MTUyNDIyOTQ0OC4xNzE3...
Workday community reply :
Depending on the Workday Web Service (WWS) that you're using, many of them support the ability to use the transaction log criteria to detect changes in a date range for a specific business process, etc.
Here is an example where I'm requesting all of the Terminate Employee and End Contingent Worker Contract events updated between 2024-05-27T00:00:00-08:00 and 2024-05-27T23:59:59-08:00.
Sure @purna05 .Kindly private dm on queries