url database - learning new urls from cloud

[MP18]

when new websites comes up  we see that it is under unknown category

one option is to ask PA to re category that.

in some cases we see that after few days that websites is not under known category and is reachable.

How does PA cloud database keeps tracks of new new websites coming up everyday?

PA cloud database talks to which database on internet to get all this info?

[OtakarKlier]

Hello,

The PAN looks to updates.paloalto.com for its new definitions. Behind the scenes, their alogrythms make those changes for the most part.

Here is an article that kinda talks to that.

https://www.paloaltonetworks.com/documentation/80/pan-os/pan-os/url-filtering/pan-db-categorization

Regards,

[MP18]

Thanks for the update.

Need to know which other databases in internet it talk to get the new websites everyday?

[OtakarKlier]

Hello,

They use their own, how they obtain it, I cant say for sure.

Regards,

[BPry · Accepted solution]

@MP18,

The process that PA uses to analyze and categorize the websites aren't really talked about officially. They pull some of the information from partners, and they utilize their own indexing servers to assist in analyzing websites the same as someone like Google would. 

[MP18]

Many thanks for answering the question.

[Remo]

I thought I oncebheard that Paloalto automatically categorize unknown URLs. All the firewalls with URL filtering subscription ask the PANDB URL Cloud for the category of URLs (obviously) and thid way PaloAlto also receives information which URLs they need to add to their categorization process.