I'm trying to create a miner that generates a list of TOR exit nodes for consumption by PAN-OS in an EDL. I found the "blutmagie.tor_exit_nodes" prototype and built a graph. My graph uses stdlib.aggregatorIPv4Generic for the processor node and stdlib.feedHCGreen for the output node.
It does generate a list of IPs at the resulting URL, but it's... odd. The prototype uses the following URL: torstatus.blutmagie.de/ip_list_exit.php/Tor_ip_list_EXIT.csv.
As you can see, this is a CSV file. I checked the file and it's just a list of individual IPv4 addresses, one per line. However, when MineMeld builds the EDL, it shows up like this:
102.165.54.56-102.165.54.56
103.194.170.223-103.194.170.223
103.208.220.122-103.208.220.122
103.208.220.226-103.208.220.226
103.234.220.195-103.234.220.195
103.234.220.197-103.234.220.197
103.236.201.110-103.236.201.110 etc.
As you can see it's generating output with ranges, where each range contains a single IP address. Even more, the ranges don't seem to be generating correctly. See this:
109.70.100.10-109.70.100.10
109.70.100.2-109.70.100.2
109.70.100.3-109.70.100.3
109.70.100.4-109.70.100.4
109.70.100.5-109.70.100.5
109.70.100.6-109.70.100.6
109.70.100.7-109.70.100.7
109.70.100.8-109.70.100.8
109.70.100.9-109.70.100.9
Shouldn't that be just....
109.70.100.2-109.70.100.10
...?
If it's not going to build real ranges, I'd just prefer it to be lists of single IP addresses, but I can't figure out how best to approach this. I'm a MineMeld novice, and I can't figure out where the code is that generates the output indicated here.
Pointers would be very welcome.
... View more