This website uses cookies essential to its operation, for analytics, and for personalized content. By continuing to browse this site, you acknowledge the use of cookies.
For details on cookie usage on our site, read our Privacy Policy
For details on cookie usage on our site, read our Privacy Policy
About YungOng
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
- LIVEcommunity
- About YungOng
03-04-2019
4Posts
0Likes
0Solutions
Mar 04, 2019Last Visited
User
Activity
User
Profile
Latest posts by YungOng
| Subject | Views | Posted |
|---|---|---|
| 4270 | 03-03-2019 09:34 PM | |
| 4273 | 03-03-2019 09:30 PM | |
| 4501 | 02-28-2019 10:09 PM | |
| 5764 | 11-27-2018 02:46 PM |
Posts I Liked
| Subject | Likes | Author | Latest Post |
|---|---|---|---|
| 2 Likes | |||
| 1 Like | |||
| 2 Likes | |||
| 2 Likes |
User Badges
Community Statistics
| Member Since | 12-14-2015 06:29 PM |
| Date Last Visited | 03-04-2019 04:42 PM |
| Posts | 4 |
03-03-2019
09:34 PM
You're right, the processing to a parquet file from the logs make removing duplicates entries unnecessary.
... View more
03-03-2019
09:30 PM
Thanks @dgildelaig.
I 've increased the size for both packets and buffer and it did not help with the import of the large (~80k) number of rules. Also, in this state, I can't remove the 'ML Enabled' tag on the rules. It returns with the error dialog box. I deleted the project to get around this issue.
I have now set 'ML Enabled' only one of the rule to get some a managable size of rules.
Thanks,
Yung
... View more
02-28-2019
10:09 PM
Hi all,
The current issue I have is the export traffic logs are too large for Expedition ML and manipulation. 1 hour worth of logs is around 2GB. 2 days is around 100GB. After Machine Learning with the 100GB logs is done (around 80k rules) it fails to import to the project. An error dialog box pops up without much detail. Is there further error logs which might shed some light on the issue? Is there a limit on the number of logs/rules to be processed?
Tried ML on smaller 2GB file and it all works as expected.
We have tried to reduce the export log size by removing duplicates via Excel, however after scp copy to expedition, the new file is no longer listed as a file for M.Learning processing to a parquet format. (interestingly, even though no file is listed, pressing the 'Process Files' button the file is now seen and is processes and then it is recognised as 'Processed by User admin'. However a parquet file is not generated. no directory or data in /datastore)
reducing the duplicates reduces the log file by around 80%.
Current details.
Expedition version 1.1.7
6 vCPU
16GB RAM
200GB HDD
Any insights would be appreciated.
Thanks,
Yung
... View more
11-27-2018
02:46 PM
Hi experts,
I would like to confirm if a manual import of PA config is supported for Machine Learning in Expedition? Sorry if this has been asked before, searches and official guides does not indicate this.
Currently we have Expedition located in a lab environment and access is restricted. I would like to import config and logs manually to Expedition.
Thanks,
Yung
... View more
Contact Me
| Online Status |
Offline
|
| Date Last Visited |
03-04-2019
04:42 PM
|
LEGAL NOTICES
Copyright 2007 - 2023 - Palo Alto Networks