topic Re: Need help with Expedition ML not able to find file under directory created with Imported log fil in Expedition Discussions

Need help with Expedition ML not able to find file under directory created with Imported log files

vjalali — Wed, 22 Aug 2018 18:50:03 GMT

Team,

Need some help with ML process for Importing Log files imported into Expedition under /greenfieldLogs/ directory with all the 777 permissions including the log.csv file (exported) from firewalls.

I have the latest EX-1.0.102 version and all updates have been done to rule out any issues related to version.

While adding ML source path for processing log files It doesnot display anything while searching file sunder the directory

/GreenfieldLogs/*.

but I have Imported and able to see the files in cli.

Need some help...

Thanks

Re: Need help with Expedition ML not able to find file under directory created with Imported log fil

alestevez — Mon, 27 Aug 2018 14:35:18 GMT

Remember you will only see the files under your firewall if the serial used to define the firewall is the same serial reported inside the log.csv file. they MUST match, if not Expedition will filter out those files....

Re: Need help with Expedition ML not able to find file under directory created with Imported log fil

vjalali — Mon, 27 Aug 2018 18:34:25 GMT

Thanks for Explanation. That is what i am seeing and now I have figured it out based upon Firewall's Serial number. Appreciate your Reply

Re: Need help with Expedition ML not able to find file under directory created with Imported log fil

jgarg — Thu, 20 Dec 2018 13:37:54 GMT

Hi, I see the same serial number in csv file as in the device on expedition, what did you do to fix it?

Re: Need help with Expedition ML not able to find file under directory created with Imported log fil

sjanita — Wed, 26 Dec 2018 16:17:16 GMT

jgarg, did you open the file using excel or google docs by any chance? If yes they will remove any zeros in the beginning of the serial numbers and will save those changes to the csv file. If you used a text editor to open the csv file then the serial numbers should have retained the serial numbers as is.

Re: Need help with Expedition ML not able to find file under directory created with Imported log fil

jgarg — Thu, 27 Dec 2018 08:36:00 GMT

Hi, no I didnt open the file in xls of Gdocs, in the log file on expedition console, i see same serial number:

1,2018/12/19 09:26:08,015351000019499,TRAFFIC,end,2049,2018/12/19 09:26:08,192.168.45.20,192.168.45.65,,,allow all,,,incomplete,vsys1,trust,trust,ethernet1/2,ethernet1/2,Default-Logging-Profile,2018/12/19 09:26:08,1941,1,53782,5007,0,0,0x64,tcp,allow,296,296,0,4,2018/12/19 09:25:56,7,any,0,44030,0x8000000000000000,192.168.0.0-192.168.255.255,192.168.0.0-192.168.255.255,0,4,0,aged-out,12,0,0,0,,pan-panos-vm50,from-policy,,,0,,0,,N/A,0,0,0,0

from vm50:

Serial #

015351000019499

Re: Need help with Expedition ML not able to find file under directory created with Imported log fil

sjanita — Thu, 27 Dec 2018 09:07:55 GMT

can you try this:

Open your device (under devices).

Click on the M.LEARNING menu

Type in the directory path (do not click 'Search files' yet)

Click on 'Save' after entering the directory path

Open the device after saving go to M.LEARNING and click 'Search Files'

If the file is found, click to select (left hand button)

click 'Process files'

Let me know the result

Re: Need help with Expedition ML not able to find file under directory created with Imported log fil

jgarg — Thu, 27 Dec 2018 09:17:31 GMT

no luck:

expedition@pan-expedition:/PALogs$ ls -l

total 1144

-rwxrwxrwx 1 expedition expedition 1161655 Dec 20 05:30 pan-panos-vm50_traffic_2018_12_20_last_calendar_day.csv

-rwxrwxrwx 1 expedition expedition 944 Dec 24 05:30 pan-panos-vm50_traffic_2018_12_24_last_calendar_day.csv

-rwxrwxrwx 1 expedition expedition 17 Dec 22 02:36 ssh-export-test.txt

Re: Need help with Expedition ML not able to find file under directory created with Imported log fil

sjanita — Thu, 27 Dec 2018 17:07:59 GMT

Have you set the path for the machine learning database (See pic) prior to searching for th files?

Re: Need help with Expedition ML not able to find file under directory created with Imported log fil

dgildelaig — Mon, 31 Dec 2018 18:26:57 GMT

Check also the potential reasons explained in this related link:

https://live.paloaltonetworks.com/t5/Expedition-Discussions/Expedition-csv-logs-stuck-in-pending/m-p/244642/highlight/true#M949