topic Re: "enhanced" YouTube Miner and Age_Out problem in General Topics

"enhanced" YouTube Miner and Age_Out problem

faeppli — Thu, 16 Feb 2017 15:06:41 GMT

I have rewritten the available YouTube Miner (https://github.com/PaloAltoNetworks/youtube-miner) since it only mines the first 30 Videos from a user.

It now uses the YouTube API (so you need an API Key) and it mines all videos in a playlist (playlist ID required).

These two variables are set via the coresponding yml file.

To Mine another YouTube Playlist I have to creat a "new prototype from this" and change the values in the config.

This works until all indicators are aged out although I set the age_out default to null in the config.

In my original prototype the indicators do not age out.

Attached you find the node.py and the yml file. (don't judge my "programing" skills :/)

TL/DR: why does my local prototype ignore the age_out setting?

how can I set the variables needed (API key and Playlist ID) in the MineMeld UI -> same as in the autofocus miner

Thanks

Felix

lmori — Thu, 16 Feb 2017 16:54:09 GMT

awesome ! Do you mind if I merge into the existing extension ? Are you OK with Apache 2 licensing ?

Thanks,

luigi

faeppli — Fri, 17 Feb 2017 13:23:25 GMT

Sure, I don't mind.

Thanks,

Felix

lmori — Tue, 21 Feb 2017 20:25:07 GMT

I have added it to the youtube-miner extension as a new Miner, PlaylistMiner.

Added your nick as AUTHOR, if you want me to add your full name and email just unicast me at lmori@paloaltonetworks.com.

Thanks !

luigi