Deduplication issue and config document regarding aggregator and output

jilim — Sun, 17 Jun 2018 23:29:38 GMT

Hi Experts,

I’m testing with Splunk but, I got a problem about deduplicate.

I’ve been input different 1000 indicators of IPv4 after deduplicate, there is 750 indicators of IPv4.

below one IP address has a different value but, after deduplicate, I can see only one indicator.

My expectation is that don’t deduplicate or there is multi value for this IP address.

How can I address the issue?

Below picture is from minemeld after deduplicate.

below is original indicator from Splunk. as you can see, 172.217.161.78 has a different values.

Also, I’ve searched configuration document for Prototype. I found miner configuration document but, I couldn’t find out prototype for aggregator and output.

https://live.paloaltonetworks.com/t5/MineMeld-Articles/Configuring-nodes/ta-p/77185

Does anyone has a document for aggregator and output?

Re: Deduplication issue and config document regarding aggregator and output

PTHASK — Wed, 25 Nov 2020 14:24:16 GMT

@jilim I know this is an old thread but I am running into the same issue. Were you ever able to find an answer?

topic Deduplication issue and config document regarding aggregator and output in General Topics

Deduplication issue and config document regarding aggregator and output

Re: Deduplication issue and config document regarding aggregator and output