Stop duplicate entities from being created on a specific case

[John_DePalma]

Good day all,

Is there a way to stop duplicate entities from being created on a specific case? For example, I am using the exchange connector and creating an entity per discovered URL. I'm looking at a case now that has 20+ URLs but really only 5 unique URLs.

[Cyrus_Robinson]

Hey, @John DePalma ! I think I actually have a pretty good strategy for these types of things using custom lists to solve the problem! I believe that @ShakedTal and @Tom Fridman are working on getting an article published on this soon, but a more lengthy explanation can be found here:
https://community.siemplify.co/discussion/133/a-noise-reduction-strategy-example-part-1#latest

and here:
https://community.siemplify.co/discussion/134/a-noise-reduction-strategy-example-part-2#latest

[shubhamagar]

any link to access these articles ?

[ddiserens]

@shubhamagar, See the links below:

A Noise Reduction Strategy Example Part 1

A Noise Reduction Strategy Example Part 2 

[Tomtomfridman]

Yes, we are It will be published this week

[Tomtomfridman]

will be super useful

[John_DePalma]

Awesome! Thanks much. @Cyrus Robinson I'll give those articles a gander in the meantime

[Cyrus_Robinson]

@John DePalma , glad to help. I'm continually impressed by the capabilities and solutions that folks in this community come up with, so I'm always excited whenever I have some way to contribute!

[John_DePalma]

Articles inspired me to write a new action that takes in Entities, (selecting All URLs for my case) and outputs a json of deduped entities.
Then re-wrote an action to take my json instead of Entities.

Happy with the outcome