Cortex XDR 7.4.1 crashing server

cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Announcements
Please sign in to see details of an important advisory in our Customer Advisories area.
Palo Alto Networks Approved
Palo Alto Networks Approved
Community Expert Verified
Community Expert Verified

Cortex XDR 7.4.1 crashing server

L1 Bithead

After the installation of xdr 7.4.1, our domain controllers began crashing, and even after a reboot they would lock up.  Has anyone had any issues with the 7.4.1 release on Windows Server 2012 R2?

 

Based on a Windows Dump, Microsoft reported the following:

findings- We have checked high Contention Count threads where we were able to see Palo Alto Networks driver tedrdrv.sys in the stack trace which is getting loaded at the time of issue when hang happened.

Request you to remove it to isolate the issue, and check if the issue is happening or not.

 

Since then, we have uninstalled 7.4.1 and reinstalled 7.4.0 and the issues went away.  I have created a ticket with Palo Alto to investigate MS claim.

 

I have searched the forums and net but have not found any issues related to what we are experiencing.  If anyone has had similar issues, please report here.  I will keep this updated with new information as it arises.  Thank you.

 

Update 7/30:

 

Palo Alto tech support has confirmed other cases involving AD and DC servers where performance is being affected by agent 7.4.1.  Since this is a newly found bug, we are currently testing a deployed fix that occurred within the past 30 mins via our data cortex tenant.  For those that are having issues, Palo Alto recommends rolling back to the 7.4.0 agent. 

 

Content update 191-66972 is being tested on our data cortex tenant.

 

Will keep you posted on future updates.  Thank you.  

1 accepted solution

Accepted Solutions

L1 Bithead

Update 8/4/2021:

 

We have closed the ticket with Palo.  The fixed worked.  They will have it ready in the next release.  No ETA when that will occur.  Thank you for all your follow-up on this case. 

View solution in original post

11 REPLIES 11

L2 Linker

Hi Jason,

 

Definitely a valid case since the issue went away if you remove 7.4.1 and put 7.4.0. 

Palo Alto support should be able to isolate or possibly reproduce the issue.

Do you happen to remember the exact minor version number? 7.4.1.xxxx ?

L0 Member

Any updates to this issue? I think we are experiencing something very similar.

L2 Linker
I also had a server malfunction with version 7.4.1 I spoke to the support and they told me to install back to version 7.4.0 and at the moment everything is normal.

L2 Linker

Just put a ticket in with support. They acknowledged the bug causing DCs with the 7.4.1 client to lock up randomly. They are working to resolve. In the meantime, they recommended downgrading to 7.4.0. It is scheduled to be fixed in the 7.4.2 release

Hi,

 

The agent version is 7.4.1.31675.  They are currently testing our environment and, if successful, will deploy a fix soon.  Will keep everyone posted.

 

L1 Bithead

Does anyone have the process on how to downgrade?

L0 Member

We do the uninstall from the Cortex Admin console then create an .msi package, copy it locally to the server, and install as administrator.

Hello,

There are two ways to do the downgrade: 1) from the console, or 2) using Msiexec

 

The more direct approach is using Msiexec especially dealing with only a few endpoints.  Here is the link on how to complete this process: https://docs.paloaltonetworks.com/cortex/cortex-xdr/7-4/cortex-xdr-agent-admin/cortex-xdr-agent-for-...

 

L1 Bithead

8/2 Update:

 

Thus far no issues have been reported on our DCs on the fix provided by tech support on 7/30.  I Will post once the word is official.

 

For those that are on 7.4.x, Palo Alto recommends downgrading to 7.3 (Although the 7.4.0 agent worked fine for us once we downgraded). 

L1 Bithead

Update 8/4/2021:

 

We have closed the ticket with Palo.  The fixed worked.  They will have it ready in the next release.  No ETA when that will occur.  Thank you for all your follow-up on this case. 

L1 Bithead

Hi, what is currently stable version of XDR for windows file server?

I am about to install xdr on several servers (not all at once) and I am about to use new policy and profile (exploit, malware, agent blades) with all default setting. Are there any option that I should change before putting xdr into production environment?

  • 1 accepted solution
  • 8699 Views
  • 11 replies
  • 1 Likes
Like what you see?

Show your appreciation!

Click Like if a post is helpful to you or if you just want to show your support.

Click Accept as Solution to acknowledge that the answer to your question has been provided.

The button appears next to the replies on topics you’ve started. The member who gave the solution and all future visitors to this topic will appreciate it!

These simple actions take just seconds of your time, but go a long way in showing appreciation for community members and the LIVEcommunity as a whole!

The LIVEcommunity thanks you for your participation!