topic Re: url database - learning new urls from cloud in General Topics

url database - learning new urls from cloud

MP18 — Thu, 18 Oct 2018 17:48:39 GMT

when new websites comes up we see that it is under unknown category

one option is to ask PA to re category that.

in some cases we see that after few days that websites is not under known category and is reachable.

How does PA cloud database keeps tracks of new new websites coming up everyday?

PA cloud database talks to which database on internet to get all this info?

Re: url database - learning new urls from cloud

OtakarKlier — Thu, 18 Oct 2018 18:44:02 GMT

Hello,

The PAN looks to updates.paloalto.com for its new definitions. Behind the scenes, their alogrythms make those changes for the most part.

Here is an article that kinda talks to that.

https://www.paloaltonetworks.com/documentation/80/pan-os/pan-os/url-filtering/pan-db-categorization

Regards,

Re: url database - learning new urls from cloud

MP18 — Thu, 18 Oct 2018 18:46:07 GMT

Thanks for the update.

Need to know which other databases in internet it talk to get the new websites everyday?

Re: url database - learning new urls from cloud

OtakarKlier — Thu, 18 Oct 2018 18:55:19 GMT

Hello,

They use their own, how they obtain it, I cant say for sure.

Regards,

Re: url database - learning new urls from cloud

BPry — Thu, 18 Oct 2018 21:31:33 GMT

@MP18,

The process that PA uses to analyze and categorize the websites aren't really talked about officially. They pull some of the information from partners, and they utilize their own indexing servers to assist in analyzing websites the same as someone like Google would.

Re: url database - learning new urls from cloud

MP18 — Sun, 21 Oct 2018 05:39:09 GMT

Many thanks for answering the question.

Re: url database - learning new urls from cloud

Remo — Sun, 21 Oct 2018 12:17:31 GMT

I thought I oncebheard that Paloalto automatically categorize unknown URLs. All the firewalls with URL filtering subscription ask the PANDB URL Cloud for the category of URLs (obviously) and thid way PaloAlto also receives information which URLs they need to add to their categorization process.