topic Atlassian custom Miner and Feed in General Topics

Atlassian custom Miner and Feed

JDomNY — Thu, 03 Jan 2019 20:51:44 GMT

I am trying to create a miner/feed for Atlassian IP-Ranges which they publish in a JSON file. I have configured the below and it all looks good and I have Indicators, but when I go to the feed URL it returns a blank page.

I created the prototype by using AWS EC2 list which also uses JSON

Re: Atlassian custom Miner and Feed

JDomNY — Thu, 03 Jan 2019 20:52:32 GMT

Adding in screenshot of my processor config

Re: Atlassian custom Miner and Feed

JDomNY — Thu, 03 Jan 2019 21:12:39 GMT

Interestingly enough if I Curl my Feed URL it returns all the proper addresses, but now when I use Chrome

Re: Atlassian custom Miner and Feed

lmori — Fri, 04 Jan 2019 10:00:48 GMT

Hi @JDomNY,

just tested with your same prototype and it works for me:

age_out:
    default: null
    interval: 257
    sudden_death: true
attributes:
    confidence: 100
    share_level: green
    type: IPv4
extractor: items
indicator: cidr
prefix: atlassian
source_name: atlassian.RANGES
url: https://ip-ranges.atlassian.com

Re: Atlassian custom Miner and Feed

JDomNY — Fri, 04 Jan 2019 15:39:50 GMT

There is something odd going on with my URL's and F5 I have in front of my Minemeld boxes. It's working fine if I use the server hostname instead of my LTM URL, interestingly enough it also work with the GTM URL so I'm all set. Thanks for reviewing

Re: Atlassian custom Miner and Feed

lmori — Sun, 13 Jan 2019 18:45:14 GMT

Consider a Pull Request to the prototypes github repo 😉