topic Re: Please help with log collectors and collector groups in Panorama mode! in General Topics

Please help with log collectors and collector groups in Panorama mode!

mr_almeida — Fri, 05 Aug 2022 08:27:19 GMT

Hello all!

We have had a single Panorama appliance running in Panorama mode as a local log collector in its own collector group. Firewall logs are sent to Panorama, and all is working well.

We now have procured a second Panorama appliance for HA. Hardware, disks etc., are all the same, and I've successfully set them up in HA, synced and healthy.

These two Panorama appliances are in different sites - though there is plenty of bandwidth and a few tens of ms latency between them. Currently, each appliance has only a single 2TB assigned to them. We don't plan to change from this setup or utilise dedicated log collectors anytime soon, and log retention fits within requirements.

The bit I am confused about is log collectors and collector groups. Cannot decide whether to have both appliances as either:

Single log collector per collector group
Put the secondary appliance in the same collector group as the primary appliance or multiple collectors in a single collector group.

Regarding multiple collectors in a collector group, I have read you can achieve redundancy, increase log retention and exceed logging rates. I am aware you need to check the box for enable log redundancy across collectors. I am also mindful that the logging rate is half - so I am not sure how the logging rates are exceeded if this happens?!

Regarding a single collector for each collector group, nothing seems to be mentioned or indicates anything about this. Why would I use this over multiple collectors in a single collector group? I know if the secondary appliance is down or lost, we lose those logs. I also assume you can still set the Log Forwarding Preferences list for both collectors in separate groups?

Hoping someone in this space can shed some light on what they have done or chime in on what you think!

Thank you for your time in reading and responding!

Re: Please help with log collectors and collector groups in Panorama mode!

PavelK — Fri, 05 Aug 2022 12:59:37 GMT

Thank you for the post @mr_almeida

you mentioned that latency is a few tens of milliseconds between each of the Panorama appliance. This could actually be an issue if both Panorama local log collectors are in the same log collector group. The latency between each of the log collector in the same log collector group should not exceed 10 milliseconds. Please have a look at this KB for more details: https://knowledgebase.paloaltonetworks.com/KCSArticleDetail?id=kA10g000000CmUnCAK

Second issue I am seeing, if your Panorama is running PAN-OS 10.0 and higher, there is a change in behavior compared to PAN-OS 9.1: https://docs.paloaltonetworks.com/pan-os/10-0/pan-os-release-notes/pan-os-10-0-release-information/changes-to-default-behavior

In nutshell, if you have 2 log collectors in a single collector group and one log collector is down, the other log collector will stop working as well. The workaround is either separate each log collector into own collector group or have 3 log collectors inside the same log collector group.

Given these 2 conditions, I personally feel that options No.1: Single log collector per collector group is better option in your case.

Kind Regards

Pavel

Re: Please help with log collectors and collector groups in Panorama mode!

mr_almeida — Mon, 08 Aug 2022 08:21:34 GMT

Thank you for your time and response, @PavelK!

Could you link me to the page that showed the collector group formula for the n/2+1? I must have read several pages but never once saw it!

If several log collectors are required for the multiple log collectors to work in a single collector group, then the only choice I have is to go with the single collector in a collector group.

Re: Please help with log collectors and collector groups in Panorama mode!

PavelK — Mon, 08 Aug 2022 12:31:56 GMT

Thank you for reply @mr_almeida

It is mentioned in this release note: https://docs.paloaltonetworks.com/pan-os/10-0/pan-os-release-notes/pan-os-10-0-release-information/changes-to-default-behavior (Scroll down to Collector Groups).

Regarding n/2+1, 2 log collectors in a single log collector group will work fine, however keep in mind that in worst case scenario if one log collector goes down, then the remaining one will not be operational until the one that went down comes back online. Unless you experience an outage on one log collector, you will not hit this limitation.

Kind Regards

Pavel