topic Re: Can Processor nodes put IPv4 addresses in order and in new ranges? in General Topics

Can Processor nodes put IPv4 addresses in order and in new ranges?

michael.gabriel — Thu, 25 Jan 2018 20:45:32 GMT

I find myself wanting processor or output nodes to aggregate IPv4 addresses into new ranges and in order. Since some Palo boxes have a limitation of 50K addresses in a Dynamic List Object, it would help a lot to make my outputs fit in there. Especially since I find myself in front of an output that looks like this in some parts:

108.62.56.100-108.62.56.100
108.62.56.101-108.62.56.101
108.62.56.102-108.62.56.102
108.62.56.103-108.62.56.103
108.62.56.104-108.62.56.104
108.62.56.105-108.62.56.105
108.62.56.106-108.62.56.106
108.62.56.107-108.62.56.107
108.62.56.108-108.62.56.108
108.62.56.109-108.62.56.109

It could easily read 108.62.56.100-108.62.56.109... Any way to do this?

Re: Can Processor nodes put IPv4 addresses in order and in new ranges?

xhoms — Thu, 25 Jan 2018 21:47:55 GMT

Hi @michael.gabriel,

current MineMeld implementation can't do that. And I have some concerns about such agrupation. For instance, what the confidence level should be for the agrupated range? The average of the confidence level of its individual contributors?

What about splitting the list based on attribute values? By confidence? By source? etc. This way you could feed the low end devices with a subset of indicators (the most important ones) and the big end devices with the full list.

Re: Can Processor nodes put IPv4 addresses in order and in new ranges?

michael.gabriel — Fri, 26 Jan 2018 13:35:13 GMT

Thanks for the insight @xhoms ! You make a very valid point, and ultimately I want to do exactly that, but what is a little bit dissapointing for me is that some miners have an average of up to 60K entries... Let's say I was aiming at one of those miners to be an important one? What do I do with the target PAN-OS (only PAN-OS within a PA-5000 series and 7000 series can accept more than 50K IP's, going up to 150K) ?

Re: Can Processor nodes put IPv4 addresses in order and in new ranges?

xhoms — Mon, 29 Jan 2018 06:35:06 GMT

Can you share with me the config of the Miner that is producing 60K entries?

Re: Can Processor nodes put IPv4 addresses in order and in new ranges?

michael.gabriel — Mon, 29 Jan 2018 13:40:19 GMT

It's the default alienvault.reputation miner. I don't even know yet if I want to use it, rather than asking myself if it is useful for a miner to have as many entries.

Re: Can Processor nodes put IPv4 addresses in order and in new ranges?

xhoms — Mon, 29 Jan 2018 14:28:24 GMT

Hi @michael.gabriel,

this is what indicator attributes are for. The Alien Vault miner attaches the following valuable attributes to each indicator:

alienvault_reliability
alienvault_risk and
alienvault_type

You can create multiple output nodes attached to the same source selecting only the indicators that match a given input filter criteria. For instance, the following graph splits the current +65K indicator list provided by Alien Vault based on the alienvault_risk attribute value.

As you can see, there are only around 500 indicators with risk 4. You might combine the indicators with risk 4 and 5 into a general availability "critical EDL" and only consume the rest in high-end devices.

Example of node prototype to filter Alien Vault indicators based on its risk value.

Re: Can Processor nodes put IPv4 addresses in order and in new ranges?

michael.gabriel — Mon, 29 Jan 2018 14:43:41 GMT

Super interesting! I had completely overlooked this while reading documentation, thank you very much @xhoms !