PAN-DB cloud list loading failed

[scottsander]

I've been getting alerts from all my PAN firewalls starting last night at 8:51pm EDT that they can't connect to the PAN cloud to update the PAN-DB URL database.

Anyone else seeing the same or a similar issue?

[ppater]

Hello,

Same problem here since today early in the morning.

I've noticed that it only happends the PAN tries to connect to 50.18.116.114.

Has someone a solution?

Best Regards,

Patrick

C:\Users\user>nslookup s0000.urlcloud.paloaltonetworks.com
Server: *****
Address: 10.12.208.10

Non-authoritative answer:
Name: s0000.urlcloud.paloaltonetworks.com
Addresses: 50.18.116.114
46.137.75.101
46.51.252.65
174.129.212.185

user@pan01(active)> show log system direction equal backward receive_time in last-24-hrs | match PAN-DB
2016/08/22 14:56:29 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Couldn't connect to server).
2016/08/22 14:22:43 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Couldn't connect to server).
2016/08/22 13:56:26 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 13:49:37 info url-fil ha-sync 0 PAN-DB sync with HA ended at 5342441.
2016/08/22 13:49:37 info url-fil ha-sync 0 Successfully synced PAN-DB to peer.
2016/08/22 13:49:36 info url-fil ha-sync 0 PAN-DB sync with HA started at 5342439.
2016/08/22 13:49:36 info url-fil url-bac 0 Backup of PAN-DB finished successfully.
2016/08/22 09:49:36 info url-fil ha-sync 0 PAN-DB sync with HA ended at 5328041.
2016/08/22 09:49:36 info url-fil ha-sync 0 Successfully synced PAN-DB to peer.
2016/08/22 09:49:34 info url-fil ha-sync 0 PAN-DB sync with HA started at 5328039.
2016/08/22 09:49:34 info url-fil url-bac 0 Backup of PAN-DB finished successfully.
2016/08/22 08:19:12 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:SSL connect error).
2016/08/22 08:04:52 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:SSL connect error).
2016/08/22 07:55:09 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 07:33:51 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 07:17:31 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 06:46:10 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:SSL connect error).
2016/08/22 06:16:02 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 06:00:30 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 05:53:33 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Couldn't connect to server).
2016/08/22 05:49:34 info url-fil ha-sync 0 PAN-DB sync with HA ended at 5313641.
2016/08/22 05:49:34 info url-fil ha-sync 0 Successfully synced PAN-DB to peer.
2016/08/22 05:49:33 info url-fil ha-sync 0 PAN-DB sync with HA started at 5313639.
2016/08/22 05:49:33 info url-fil url-bac 0 Backup of PAN-DB finished successfully.
2016/08/22 05:40:23 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Couldn't connect to server).
2016/08/22 05:24:47 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 05:20:17 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 05:15:13 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.812.
2016/08/22 05:10:27 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 05:04:49 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 04:55:42 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 04:50:25 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.810.
2016/08/22 04:47:24 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:SSL connect error).
2016/08/22 04:43:15 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 04:33:51 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 04:27:29 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 04:23:08 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 04:18:45 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.808.
2016/08/22 04:14:42 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 04:00:08 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 03:50:04 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 03:47:16 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.806.
2016/08/22 03:46:46 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:SSL connect error).
2016/08/22 03:40:23 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 03:33:19 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.805.
2016/08/22 03:31:12 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 03:27:50 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 03:23:53 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 03:13:38 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 03:08:33 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 03:03:03 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.803.
2016/08/22 02:59:01 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 02:50:26 medium url-fil url-dow 0 PAN-DB cloud list loading failed (ERROR:Timeout was reached).
2016/08/22 02:30:57 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.801.
2016/08/22 02:00:30 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.695.
2016/08/22 01:49:33 info url-fil ha-sync 0 PAN-DB sync with HA ended at 5299241.
2016/08/22 01:49:33 info url-fil ha-sync 0 Successfully synced PAN-DB to peer.
2016/08/22 01:49:32 info url-fil ha-sync 0 PAN-DB sync with HA started at 5299240.
2016/08/22 01:49:31 info url-fil url-bac 0 Backup of PAN-DB finished successfully.
2016/08/22 01:30:33 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.693.
2016/08/22 01:15:34 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.692.
2016/08/22 01:00:00 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.691.
2016/08/22 00:45:28 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.690.
2016/08/22 00:29:54 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.689.
2016/08/22 00:14:40 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.688.
2016/08/22 00:00:29 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.687.
2016/08/21 23:45:39 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.686.
2016/08/21 23:28:51 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.685.
2016/08/21 23:14:00 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.684.
2016/08/21 23:00:07 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.683.
2016/08/21 22:46:59 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.682.
2016/08/21 22:31:33 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.681.
2016/08/21 22:15:49 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.680.
2016/08/21 21:49:32 info url-fil ha-sync 0 PAN-DB sync with HA ended at 5284842.
2016/08/21 21:49:32 info url-fil ha-sync 0 Successfully synced PAN-DB to peer.
2016/08/21 21:49:30 info url-fil ha-sync 0 PAN-DB sync with HA started at 5284840.
2016/08/21 21:49:30 info url-fil url-bac 0 Backup of PAN-DB finished successfully.
2016/08/21 21:48:01 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.678.
2016/08/21 21:29:54 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.677.
2016/08/21 21:13:55 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.676.
2016/08/21 20:59:14 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.675.
2016/08/21 20:44:05 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.674.
2016/08/21 20:29:26 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.673.
2016/08/21 20:14:29 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.672.
2016/08/21 19:59:17 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.671.
2016/08/21 19:43:55 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.670.
2016/08/21 19:29:50 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.669.
2016/08/21 19:14:19 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.668.
2016/08/21 18:59:15 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.667.
2016/08/21 18:44:52 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.666.
2016/08/21 18:30:05 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.665.
2016/08/21 18:14:43 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.664.
2016/08/21 17:59:35 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.663.
2016/08/21 17:49:30 info url-fil ha-sync 0 PAN-DB sync with HA ended at 5270442.
2016/08/21 17:49:30 info url-fil ha-sync 0 Successfully synced PAN-DB to peer.
2016/08/21 17:49:29 info url-fil ha-sync 0 PAN-DB sync with HA started at 5270440.
2016/08/21 17:49:29 info url-fil url-bac 0 Backup of PAN-DB finished successfully.
2016/08/21 17:45:01 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.662.
2016/08/21 17:29:16 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.661.
2016/08/21 17:15:23 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.660.
2016/08/21 16:58:55 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.659.
2016/08/21 16:43:53 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.658.
2016/08/21 16:29:20 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.657.
2016/08/21 16:14:24 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.656.
2016/08/21 15:59:13 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.655.
2016/08/21 15:44:29 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.654.
2016/08/21 15:29:00 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.653.
2016/08/21 15:14:02 info url-fil upgrade 0 PAN-DB was upgraded to version 2016.08.19.652.
user@pan01(active)>

[scottsander]

I opened a support case and they acknowledge there is an issue and the backend team is working on it.  My case number is #00535092.

[Anon1]

Hi,

same here. All firewalls worldwide affected. Opened ticket with PANW, they replied it is PAN-DB cloud issue.

[jdelio]

I wanted to let you know that there was an issue with the PAN-DB cloud servers that began on Sunday, August 21 that was impacting customers’ ability to connect to the PAN-DB cloud service.  

This issue has since been resolved, and there should be a notification going out about that issue.

Sorry for the inconvenience and thanks for your patience with this issue.

[RobertStrik]

Annoucement here:

https://live.paloaltonetworks.com/t5/Customer-Advisories/Important-update-regarding-PAN-DB-issue/ta-...

It's fixed now.

[MWensyel]

Started getting SYSTEM ALERT : medium : PAN-DB cloud list loading failed (ERROR:Timeout was reached). this week from one of my firewalls.  Looks like this has been an issue before with the PA Back End, is there a problem again or has something on my device changed?

[BPry]

I'm thinking something changed on your end; I haven't gotten any issues with updating the DB this morning