Custom miner, class not found, no nodes.json file..?

Reply
L2 Linker

Custom miner, class not found, no nodes.json file..?

Hi,

 

I have an issue where the class of my miner is not found. 

I saw lmori posting that you need to add your new class to the nodes.json file, however that file does NOT exist.

Tried both cloud init image and an own ubuntu 14.04 server.

 

Tried my own miner and the ytexample miner.


Tried to create the file but that did not help at all, even copied it into several directories.

 

Is there an updated guide somewhere?

L7 Applicator

Re: Custom miner, class not found, no nodes.json file..?

Hi @Philip_Wiberg,

please, could you add more details about how did you deploy the custom miner?

 

Thanks,

luigi

L2 Linker

Re: Custom miner, class not found, no nodes.json file..?

I followed the same steps as in the ytexample guide.

https://github.com/PaloAltoNetworks/minemeld/wiki/How-To-Write-a-Simple-Miner

 

Created the miner based on ytexample.py, uploaded to the same folder as google.py and all other miners are located in.

Uploaded config in the gui.

 

Also the "/opt/minemeld/engine/core/minemeld/ft" does not exist, rather: 

/opt/minemeld/engine/0.9.48.post1/lib/python2.7/site-packages/minemeld/ft

 

(Does not matter if I create it either)

 

Example from the log while loading ytexample.py config;:

2018-06-28T08:20:03 (2258)config._load_and_validate_config_from_file ERROR: Invalid config /opt/minemeld/local/config/committed-config.yml: Unknown node class minemeld.ft.ytexample.YTExample in testYT
2018-06-28T08:22:21 (2393)config._load_and_validate_config_from_file ERROR: Invalid config /opt/minemeld/local/config/committed-config.yml: Unknown node class minemeld.ft.ytexample.YTExample in testYT

L7 Applicator

Re: Custom miner, class not found, no nodes.json file..?

Hi @Philip_Wiberg,

we should update those instructions. There are 2 ways of solving this:

- change the nodes.json in /opt/minemeld/engine/current and add your new class

- use an external extension (preferred), sample extension here: https://github.com/PaloAltoNetworks/youtube-miner

 

External Extensions are preserved across upgrades and can be easily installed on brand new MineMeld installations.

L2 Linker

Re: Custom miner, class not found, no nodes.json file..?

Thanks, I created the file there and it seems to have worked.

Like what you see?

Show your appreciation!

Click Like if a post is helpful to you or if you just want to show your support.

Click Accept as Solution to acknowledge that the answer to your question has been provided.

The button appears next to the replies on topics you’ve started. The member who gave the solution and all future visitors to this topic will appreciate it!

These simple actions take just seconds of your time, but go a long way in showing appreciation for community members and the Live Community as a whole!

The Live Community thanks you for your participation!