topic Re: What is the correct way to export traffic logs from a Panorama to the ML Expedition Server? in Expedition Discussions

What is the correct way to export traffic logs from a Panorama to the ML Expedition Server?

roland_sterkendries — Wed, 04 Mar 2020 14:49:12 GMT

Hello,

I am working in an environment in which all Palo Alto FWs are centrally managed by a Panorama instance. All traffic logs are sent to the Panorama.

If I follow the ML (Loggings Analysis) Guide, it is proposed to set a Scheduled Log Export from each individual FW towards the Expedition ML Server.

But what is the correct approach in case we are using a centralized Panorama instance which is already receiving all these traffic logs? Should I still configure each individual firewall with an Scheduled Log Export towards the Expedition server?

Thanks

Re: What is the correct way to export traffic logs from a Panorama to the ML Expedition Server?

azuniga — Wed, 04 Mar 2020 15:50:51 GMT

Hello,

You can import directly from Panorama in your situation.

Re: What is the correct way to export traffic logs from a Panorama to the ML Expedition Server?

roland_sterkendries — Thu, 05 Mar 2020 10:49:59 GMT

Hi Azuniga and thanks for answering.

Your proposition is actually what I did some days ago but it does not seem to work.

I can schedule the export on the Panorama instance. The scp "ping" works fine copying a dummy file named ssh-export-test-txt. However, later when the export should happen, it does not and the destination folder on the Expedition server remains empty.

The Destination folder has following rights:

Seen this before? Could it be a bug?

Thanks for any help/hint

Re: What is the correct way to export traffic logs from a Panorama to the ML Expedition Server?

azuniga — Thu, 05 Mar 2020 17:50:18 GMT

I checked my file permissions on my personal VM and noticed I have permissions of 755, I am wondering if your file permissions were changed? I see that yours is 750 so it might not matter if the permissions are altered unless expedition writes to the file as other. Would you mind changing that and confirming your machine learning file path is set to /data, it should be under settings > m. learning.

If you are still having issues please feel free to email us at fwmigrate (at) paloaltonetworks.com

Re: What is the correct way to export traffic logs from a Panorama to the ML Expedition Server?

dgildelaig — Thu, 05 Mar 2020 17:59:47 GMT

If you can see that the ssh-export-test-txt test file gets generated in the /logs folder in your Expedition, this means that you have the settings in Expedition allowing the logs to be sent.

If so, and you still do not get logs sent, it could be:

a) did you commit the configuration in your FW to do the schedule log export?

b) do you have traffic hitting rules in your firewall? (actually, I think you should get still traffic log files, but those would be empty in Expedition)

c) are you actually seeing the traffic logs in the /logs folder? In such case, remember that you will be able to process the files in Expedition if you have imported the firewalls that own those traffic log files. Get into your Panorama device (in Expedition) and click on retrieve connected devices.

Re: What is the correct way to export traffic logs from a Panorama to the ML Expedition Server?

roland_sterkendries — Wed, 11 Mar 2020 16:20:58 GMT

Hi Dgildelaig,

thanks for your answer.

I could solve the issue this week. I will post it here for documentation. It turns out csv traffic logs cannot be exported from the Panorama.

Even if you can configure a Scheduled Log Export centrally from the Panorama, this actually pushes the Scheduled Export to all FW devices and you still have to connect to all individual devices and click on their "SCP Test" button to exchange keys between FW-Expedition. This is because the exports are happening from the FWs and not from the Panorama.

Re: What is the correct way to export traffic logs from a Panorama to the ML Expedition Server?

dgildelaig — Thu, 12 Mar 2020 09:23:14 GMT

That's right.

An alternative is to use Expedition as a Syslog server and receive the traffic-logs on-realtime.

You may find some information about how to setup Expedition to activate the syslog server features in this forum

Re: What is the correct way to export traffic logs from a Panorama to the ML Expedition Server?

zGomez — Fri, 22 Apr 2022 13:46:53 GMT

Hi Roland,

As I understand correctly you ended up doing a scheduled export from all panorama manged deviced to Expedition.

I there no way to export the logs from panorama itself?