External Dynamic Lists not working

[COMIP]

Hi all,

I have configured EDL of type Dynamic URL Lists with the next configuration

Then in URL filtering profile the ransomwaretracker_URL category is configured as BLOCK and the Profile is applied in the Security rule.

It seems configured correctly, I can list the EDL in CLI, but if I try to go to listed URL, it does not blocked.

PAN is working with 7.1.2 version.

Thanks,

Jordi

[bmorris1]

Hi Jordi,

Can you remove the 'https://' and try that? The documentation says not to use this prefix.

https://www.paloaltonetworks.com/documentation/71/pan-os/pan-os/policy/formatting-guidelines-for-an-...

Can you also check your traffic logs and security policies and see if the allowed traffic is hitting a rule above or below the rule you have configured?

Try this command to see if your EDL has populated ok:

> request system external-list show type url (EDL name)

You can add your list to a URL filtering profile and add that profile to the policy:

https://www.paloaltonetworks.com/documentation/71/pan-os/pan-os/url-filtering/use-an-external-dynami...

hope this helps,

Ben

[BPry]

Does it work as expected if you build a Deny rule with your EBL as the source address? This list is also 4992 entries which may be pushing the number of address objects you can push in one EBL. If you have anything less than a 3050, 3060, or a 5020 and up then you aren't going to be able to use this list. 

[TranceforLife]

It is a bit away from the original post/question but I recall a discussion here about the limit of entries :

On each Palo Alto Networks firewall platform, you can configure a maximum of 30 unique sources for external dynamic lists. A source is a URL that includes the IP address or hostname, the path, and the filename for the external dynamic list. The firewall matches the URL (complete string) to determine whether a source is unique.

Although the firewall does not impose a limit on the number of lists for a specific type of list, the following limits are enforced:

• IP address—The PA-5000 Series and the PA-7000 Series firewalls support a maximum of 150,000 total IP addresses; all other platforms support a maximum of 50,000 total IP addresses. No limits are enforced for the number of IP addresses per list.
• URLs and domain names—a maximum of 50,000 URLs and 50,000 domains are supported on each platform, with no limits enforced on the number of entries per list.

More info here:

https://live.paloaltonetworks.com/t5/Featured-Articles/DotW-Dynamic-Block-List-Limited-Number-of-Ent...

[BPry]

@TranceforLife I believe those limits only cover 7.1. I've always gone off of what's listed here https://live.paloaltonetworks.com/t5/Learning-Articles/Working-with-External-Block-List-EBL-Formats-... unless people actually point out that they are running 7.1.* since most people seem to be ignoring it for now. 

[TranceforLife]

the user is running 7.1.2 PAN-OS

[BPry]

ahh my bad. 

[TranceforLife]

l have just tested trying using http, getting redirected to https. If it is listed on firewall through the cli that is fine, should work. Also could run test button to see if you are connected successfully. Should just work. Please follow link posted by BPry:

https://live.paloaltonetworks.com/t5/Learning-Articles/Working-with-External-Block-List-EBL-Formats-...

[COMIP]

Hi all,

Thanks for your opinions. The device is a PAN 3020 and I think that the list are supported, the number of entries is ok.

https://live.paloaltonetworks.com/t5/PAN-OS-7-1-Videos/PAN-OS-7-1-URL-Filtering-Dynamic-Block-List-E...

I have tried to configure the list without https but continues without block the URLs listed in file.

The test source URL is correct, the list can be oppened.

The traffic do match in rule with the profile applied.

[BPry]

@COMIP I just tried to run that list on my own 3020 and while the link tests okay it wasn't able to actually pull anything from the list; I would assume because of the formatting. Can you run the command request system external-list show name (name) with the correct name of your list and see if there is actually anything within the list? You could also do a refresh instead of a show and monitor the specific job of the DBL refresh and see if it actually completes. 

[COMIP]

The list is opened when the command is executed.

impala@FW_VM401(active)> request system external-list show type url name ransomwaretracker_URL

vsys1/ransomwaretracker_URL:
Next update at : Tue Oct 18 18:00:29 2016
Source : ransomwaretracker.abuse.ch/downloads/RW_URLBL.txt
Referenced : Yes
Valid : Yes

Total valid entries : 4992
Total invalid entries : 8
Valid urls:
http://01ad681.netsolhost.com/7j0jlq3
http://027tzx.com/lscpv
http://0793mobile.com/jetg2
http://108.174.196.88/8dpg3
http://109.73.234.241/dgq01p
http://11011020.web.fc2.com/ets19pre
http://111.86.142.67/~h_fujii/95hdienf
http://121.83.206.211/~ftp-yama/9z6nu
http://125ru.web.fc2.com/09u9jn87
http://12hourenergy.com.au/ty6yhd
http://151.ru/4GBrdf6
http://158.195.68.10/87hcrn33g
http://158.195.68.10/g76gyui
http://158.195.68.10/porirue
http://158.199.158.185/e2ti07
http://178.78.87.8/spyra2
http://178.78.87.8/xjzhm
http://18901350711.com/ll0wdsu
http://18vek.spb.ru/HJghjt872?FqRolfwcFC=ubcMhkMNCX
http://18vek.spb.ru/p3isx
http://194.28.172.166/~triera/95osasmx
http://198.1.95.93/~deveconomytravel/cache/binstr.php
http://1express.com.sg/cpmr1pt

[BPry]

@COMIP Do you know if your URL Filtering is working at all? 

[COMIP]

Yes, URL Filtering is working.

[BPry]

@COMIP If URL is working and you have the rules setup for both incoming and outgoing traffic then I think the next step would be a TAC case. I would question how your rules are setup however, as you are going to need both one incoming and one outgoing if you are trying to test it by going to those websites. 

[COMIP]

Yes the profiles are applied in both directions.

Thanks for your answers, I'm going to open a case.