topic Custom miner, class not found, no nodes.json file..? in General Topics

Custom miner, class not found, no nodes.json file..?

Philip_Wiberg — Thu, 28 Jun 2018 07:17:26 GMT

Hi,

I have an issue where the class of my miner is not found.

I saw lmori posting that you need to add your new class to the nodes.json file, however that file does NOT exist.

Tried both cloud init image and an own ubuntu 14.04 server.

Tried my own miner and the ytexample miner.

Tried to create the file but that did not help at all, even copied it into several directories.

Is there an updated guide somewhere?

Re: Custom miner, class not found, no nodes.json file..?

lmori — Thu, 28 Jun 2018 07:51:02 GMT

Hi @Philip_Wiberg,

please, could you add more details about how did you deploy the custom miner?

Thanks,

luigi

Re: Custom miner, class not found, no nodes.json file..?

Philip_Wiberg — Thu, 28 Jun 2018 08:26:10 GMT

I followed the same steps as in the ytexample guide.

https://github.com/PaloAltoNetworks/minemeld/wiki/How-To-Write-a-Simple-Miner

Created the miner based on ytexample.py, uploaded to the same folder as google.py and all other miners are located in.

Uploaded config in the gui.

Also the "/opt/minemeld/engine/core/minemeld/ft" does not exist, rather:

/opt/minemeld/engine/0.9.48.post1/lib/python2.7/site-packages/minemeld/ft

(Does not matter if I create it either)

Example from the log while loading ytexample.py config;:

2018-06-28T08:20:03 (2258)config._load_and_validate_config_from_file ERROR: Invalid config /opt/minemeld/local/config/committed-config.yml: Unknown node class minemeld.ft.ytexample.YTExample in testYT
2018-06-28T08:22:21 (2393)config._load_and_validate_config_from_file ERROR: Invalid config /opt/minemeld/local/config/committed-config.yml: Unknown node class minemeld.ft.ytexample.YTExample in testYT

Re: Custom miner, class not found, no nodes.json file..?

lmori — Thu, 28 Jun 2018 10:34:42 GMT

Hi @Philip_Wiberg,

we should update those instructions. There are 2 ways of solving this:

- change the nodes.json in /opt/minemeld/engine/current and add your new class

- use an external extension (preferred), sample extension here: https://github.com/PaloAltoNetworks/youtube-miner

External Extensions are preserved across upgrades and can be easily installed on brand new MineMeld installations.

Re: Custom miner, class not found, no nodes.json file..?

Philip_Wiberg — Thu, 28 Jun 2018 13:13:25 GMT

Thanks, I created the file there and it seems to have worked.

Re: Custom miner, class not found, no nodes.json file..?

Luke_RBNZ — Thu, 16 Apr 2020 04:11:22 GMT

Hi @Philip_Wiberg

Did you sole this by creating the nodes.json file in /opt/minemeld/engine/current?

Im having the same issue after trying to create a simple custom miner and following:

https://github.com/PaloAltoNetworks/minemeld/wiki/How-To-Write-a-Simple-Miner

There is no /opt/minemeld/engine/current/nodes.json file.

Any help appreciated.

Thanks

Luke