PA 220 Dataplane restart automatically.

[VishnuPS]

Hi Team,

We have noticed that our PA 220 device data plane has been restarted automatically.

Pan OS: 10.0.6

Please find the logs below,

2021-09-24 10:36:23.126 +0530 INFO: flow_ctrl_pktlog_forwarding: exited, Core: False, Exit code: 0
2021-09-24 10:36:23.290 +0530 INFO: flow_mgmt: exited, Core: False, Exit code: 0
2021-09-24 10:36:23.487 +0530 INFO: tasks: exited
2021-09-24 10:36:26.790 +0530 INFO: comm: exited, Core: False, Exit code: 0
2021-09-24 10:36:26.957 +0530 INFO: supervisor: exited
2021-09-24 10:36:27.089 +0530 CRITICAL: supervisor: Exited 1 times, must be manually recovered.
2021-09-24 10:36:27.118 +0530 INFO: data_plane: group exiting because child supervisor exited
2021-09-24 10:36:27.261 +0530 INFO: data_plane: exited
2021-09-24 10:36:27.389 +0530 CRITICAL: The dataplane is restarting.
2021-09-24 10:36:33.499 +0530 CRITICAL: data_plane: restarts exhausted, rebooting system

We are not sure this is related to any os bug because 10.0.6 known issues we checked. Not seen anything related to this issue.

Kindly help us to get a RCA for this issue.

Regards,

Vishnu PS.

[MuradE]

Same exact issue on PA-220s run ver 9.1.3 not 10.0.6. It was found to be memory leak issue by TAC and suggestions to upgrade to 9.1.5 or 9.1.6

Please take a look Tech Support file to determine root cause & open ticket with TAC. 

Don't forget to share the solution for this issue.

Thanks!

[BPry]

@VishnuPS,

If you're looking for RCA you need to go to TAC and let them perform RCA for you with the help of your technical support file. The fact that you have a process crashing could be caused by a memory leak or a myriad of other issues.

Without a copy of the technical support file we don't have the appropriate log files to analyze the issue for you, nor would I ever recommend you share that file with strangers on the internet.

[Yared_Demissie]

Just an FYI, we're seeing "CRITICAL: data_plane: restarts exhausted, rebooting system" issue in 10.0.8 on a vm-series firewall in Azure. We're opening a ticket. Will update what we find out if anyone is interested.

[VishnuPS · Accepted solution]

Hi,

I have already raised TAC case and please find the TAC update below,
- The engineering team has confirmed that this issue is matching an internal issue reported in 10.1 for which is fix is not yet released and there is no ETA (for the fix in 10.1)
- If the customer would like to push for a fix in 10.0 since they are currently running this version - please contact the Account team SE to file a 'Backport' request (for fix in 10.0).

Thanks,

Vishnu

[Yared_Demissie]

Fantastic. Thank you!

[Olha_Osadcha]

pretty close situation in 10.2.0-h1 PA-220

[tshooter]

I am seeing this issue on PA-220 on 10.1.11. , anyone else on 10.1.X train on a PA-220, its horridly slow, and seems to lose dataplane connection when a HA1 link drops, a commit is in progress, or PAN commit is in progress..  Opening case. . 

[MarnusLombaard]

Hi @tshooter, 

Just want to find out if you maybe opened a case and received any feedback from TAC w.r.t the issue?