topic Re: url filtering speed in General Topics

url filtering speed

Retired Member — Tue, 02 Jul 2013 13:40:55 GMT

Hi,

When enable url filtering page loads late.Same page loads very quickly when disable url filter.

All sites same issue.any idea about that ?

Re: url filtering speed

Chatri — Tue, 02 Jul 2013 16:24:26 GMT

Is this behavior consistent through all browsers?

Re: url filtering speed

Retired Member — Tue, 02 Jul 2013 17:22:40 GMT

yes all browsers.I thought it is from DNS but could not find anything.

Re: url filtering speed

hshah — Tue, 02 Jul 2013 17:49:23 GMT

Hi Panos,

How much is the delay difference?

Regards,

Hardik Dinendra Shah

Re: url filtering speed

kprakash — Tue, 02 Jul 2013 19:14:54 GMT

Can you tell me what vendor you are using for the URL filtering? Is it Brightcloud or PANDB

Have you tried clearing the MP and the DP URL cache to see if it made a difference?

If Brightcloud, try the following commands:

>clear url-cache all

>delete dynamic-url host all

Its also recommended that you have Dynamic URL filtering enabled on all the URL profiles.

To speed up the URL category lookup, you can also enable the bloom filter and MP URL cache on the firewall. Please refer to the pages 4 and 5 of the below document:

https://live.paloaltonetworks.com/servlet/JiveServlet/previewBody/3264-102-3-8547/URL_Categorization_PANOS-RevC.pdf

BR,

Karthik

Re: url filtering speed

Retired Member — Tue, 02 Jul 2013 19:17:31 GMT

difference is about 30 seconds max

Re: url filtering speed

Retired Member — Tue, 02 Jul 2013 19:18:27 GMT

Brightcloud

Yes I'll try that bloom just found that.Thanks.

I'll write the result

Re: url filtering speed

kprakash — Tue, 02 Jul 2013 19:24:21 GMT

You could also restart the devsrvr as a last resort to see if it makes a difference. There would be no outage whatsoever, but you can definitely try out in a window:

>debug software restart device-server

Re: url filtering speed

dyang — Wed, 03 Jul 2013 00:20:00 GMT

panos,

You mentioned that subsequent visits to the same URL when URL filtering is disabled does not present a delay. What about if you revisit the same URL when URL filtering is still enabled?

In other words,

visit URL, get delay

visit same URL -->delay?

If you're only getting a delay in loading the page the first time you visit the URL, it could simply be due to the fact that the device is reaching out to the BrightCloud servers for a categorization. The second time you go to the URL, the category should be cached in your DP, so the response should be much faster. That said, by default, we only wait 5 seconds for a response. Your delay should not be 30 seconds.

Re: url filtering speed

Retired Member — Wed, 03 Jul 2013 06:41:14 GMT

delay for all sites and for any refresh.I know what 5 second is but this issue seems to be different.

Re: url filtering speed

Retired Member — Wed, 03 Jul 2013 06:42:28 GMT

After bloom filter and restarting device server it is fixed.Hope that not happens again.it was working fine and suddenly that happen.

Thanks all.