url filtering speed

[panos]

Hi,

When enable url filtering page loads late.Same page loads very quickly when disable url filter.

All sites same issue.any idea about that ?

[Chatri]

Is this behavior consistent through all browsers?

[panos]

yes all browsers.I thought it is from DNS but could not find anything.

[hshah]

Hi Panos,

How much is the delay difference?

Regards,

Hardik Dinendra Shah

[kprakash · Accepted solution]

Can you tell me what vendor you are using for the URL filtering? Is it Brightcloud or PANDB

Have you tried clearing the MP and the DP URL cache to see if it made a difference?

If Brightcloud, try the following commands:

>clear url-cache all

>delete dynamic-url host all

Its also recommended that you have Dynamic URL filtering enabled on all the URL profiles.

To speed up the URL category lookup, you can also enable the bloom filter and MP URL cache on the firewall. Please refer to the pages 4 and 5 of the below document:

https://live.paloaltonetworks.com/servlet/JiveServlet/previewBody/3264-102-3-8547/URL_Categorization...

BR,

Karthik

[panos]

difference is about 30 seconds max

[panos]

Brightcloud

Yes I'll try that bloom just found that.Thanks.

I'll write the result

[kprakash]

You could also restart the devsrvr as a last resort to see if it makes a difference. There would be no outage whatsoever, but you can definitely try out in a window:

>debug software restart device-server

[dyang]

panos,

You mentioned that subsequent visits to the same URL when URL filtering is disabled does not present a delay.  What about if you revisit the same URL when URL filtering is still enabled?

In other words,

visit URL, get delay

visit same URL -->delay?

If you're only getting a delay in loading the page the first time you visit the URL, it could simply be due to the fact that the device is reaching out to the BrightCloud servers for a categorization.  The second time you go to the URL, the category should be cached in your DP, so the response should be much faster.  That said, by default, we only wait 5 seconds for a response.  Your delay should not be 30 seconds.

[panos]

delay for all sites and for any refresh.I know what 5 second is but this issue seems to be different.

[panos]

After bloom filter and restarting device server it is fixed.Hope that not happens again.it was working fine and suddenly that happen.

Thanks all.