topic Re: filter based on age in General Topics

filter based on age

depps — Tue, 02 Jul 2019 16:53:43 GMT

How would one filter the OTX reputation database so only objects see more than 5 days ago are removed?

I have tried to edit the miner with age out config below however im not convinced thats the right place to do it. Failing that what are people doing to import from OTX as the default list is in excess of 50k and above the EDL limits on some kit.

default: first_seen+5d

interval: 1800

sudden_death: true

Re: filter based on age

lmori — Wed, 03 Jul 2019 10:35:23 GMT

I would suggest to use last_seen+5d if you want to keep only indicators that have been added or updated in the last 5 days.

But the best way is to use the default prototype and filter the EDL to limit it to the most recent 50k entries, you can do that using a URL parameter: https://<minemeld>/feeds/<feedname>?n=50000

Luigi

Re: filter based on age

depps — Thu, 04 Jul 2019 12:21:42 GMT

?n=50000 will use the newest in the list first?

The issue with that is we have multiple EDL's so I cant just use a single filter. i.e.

https://<minemeld>/feeds/<feedname1>?n=20000

https://<minemeld>/feeds/<feedname2>?n=20000

https://<minemeld>/feeds/<feedname3>?n=10000

Re: filter based on age

lmori — Mon, 08 Jul 2019 13:33:42 GMT

Yes, will use the newest entries.