Hi Google Cloud Community,
I've been working with Pub/Sub for a few months now and enjoying how straightforward it is compared to RabbitMQ. I can't seem to find the answer to how to handle/re-play messages in a Dead Letter Topic (DLT) when the messages originated from a subscription whose topic has more than one subscription.
Things are straightforward when a DLT comes from a subscription whose topic has only one subscription. You can handle those messages with a cloud function, and dataflow and there are many options to move DLT to a DLT subscription and back to the original topic.
However, things are not very clear when you have one topic with two subscriptions. If one subscription has an issue with retries that end up in the DLT, the only supported options seem to route messages back to the original topic. This is fine for the subscription that missed the message, but the other subscription will get a duplicate message.
I've come up with some unideal workarounds, but I rather avoid them if possible.
Ideal Solutions/Feature Requests
Other Notes:
Message Subscribers should be set to ignore duplicates by using MessageID and Publishing Time. However, messages coming from a dead letter topic have new unique MessageID/Publishing Time making the subscriber unable to determine whether not the message is a duplicate.
Thank you in advance for any assistance or thoughts.