flow_fpga_ingress_exception_err and high latency

[Alex_Huthmacher]

Recently deployed several PA-5250s Running 10.1.3 and there is a issue that randomly comes and goes.

Latency for traffic going through the firewalls spikes to 100-500ms. I was able to capture one thing that looked peculiar and that was flow_fpga_ingress_exception_err counts were high (8169388322) and the rate was high (12468). But I can't seem to find a good definition as what this would indicate. 

I also caught the packet descriptor (on-chip) (average):  with 100 across the first two rows. 
I failed to capture the CPU Cores at the same time though. 
Any ideas?

[Gustavo_Aristi]

Known issue: PAN-141630 seems to match this scenario. Interestingly, 10.1.3 is the preferred 10.1 version as of today. Therefore, upgrade to 10.1.4 may not be the best solution (yet).

You may be able to get more context looking at global counters: show counter global | match fpga

[BPry]

@Alex_Huthmacher,

If this is mission critical hardware, and you don't require features in 10.1, I would highly recommend staying off of 10.1 for the time being. There's still bugs getting worked out in 10.1 and 10.0 is a fairly stable release at this point. 

[Alex_Huthmacher]

Thanks for the help, I asked TAC if we should downgrade and they replied with "why?". 

[Gustavo_Aristi]

I would ask the same question as you currently are running the preferred/stable version of 10.1.

However, instead of questioning you, I hope they are providing a solution as you seem to already have a case with them.

I am curious to hear what their solution was, if they provide one.