Custom miner, 'Commit Failed: unknown node class', no nodes.json file

Luke_RBNZ — Thu, 16 Apr 2020 06:11:06 GMT

Hi All,

I followed the same steps as in the ytexample guide.

https://github.com/PaloAltoNetworks/minemeld/wiki/How-To-Write-a-Simple-Miner

Including putting my class in:

/opt/minemeld/engine/0.9.68/lib/python2.7/site-packages/minemeld/ft

By the way, this directory doesnt exist:

/opt/minemeld/engine/core/minemeld/ft

Im getting 'Commit Failed: unknown node class' when I try to commit the node which references the prototype created from the above article.

There was no /opt/minemeld/engine/current/nodes.json file. Indeed, I searched all of the Ubuntu VM hosting Minemeld and couldnt find a nodes.json anywhere.

Ive tried copying this nodes.json and adding my node to the bottom and putting in /opt/minemeld/engine/current/ along with my class:

https://github.com/PaloAltoNetworks/minemeld-core/blob/master/nodes.json

Which is as per this message from a couple years ago:

https://live.paloaltonetworks.com/t5/MineMeld-Discussions/Custom-miner-class-not-found-no-nodes-json-file/td-p/219607

However, I still get the same error.

Does anybody have any ideas?

Appreciate your help.

Thanks

Luke

Re: Custom miner, 'Commit Failed: unknown node class', no nodes.json file

Luke_RBNZ — Thu, 16 Apr 2020 19:53:33 GMT

Hi @Lmori

I can see you have helped a few people out with the same issue. Ive followed your steps (as much as possible) and still have the same issue. Are you able to offer any insight?

From the below, you can see I tried to follow what worked for somebody else here:
https://live.paloaltonetworks.com/t5/MineMeld-Discussions/how-to-write-a-simple-miner-documentation/td-p/156793

Not sure if its relevant, but Im running Minemeld on ubuntu 16.04 LTS.

This is my /opt/minemeld/engine/current directory:
luke@ubuntu16:/opt/minemeld/engine/current$ ll
total 48
drwxr-xr-x 7 minemeld minemeld 4096 Apr 16 17:32 ./
drwxr-xr-x 3 minemeld minemeld 4096 Apr 10 11:14 ../
drwxr-xr-x 2 minemeld minemeld 4096 Apr 10 11:14 bin/
drwxr-xr-x 3 minemeld minemeld 4096 Apr 10 11:14 include/
drwxr-xr-x 3 minemeld minemeld 4096 Apr 10 11:14 lib/
-rw-r--r-- 1 minemeld minemeld 1254 Apr 10 11:14 LICENSE.rst
drwxr-xr-x 2 minemeld minemeld 4096 Apr 10 11:14 local/
-rw-r--r-- 1 root root 4781 Apr 16 17:32 nodes.json
-rw-r--r-- 1 minemeld minemeld 789 Apr 10 11:14 README.rst
drwxr-xr-x 3 minemeld minemeld 4096 Apr 10 11:14 share/
-rw-r--r-- 1 root root 2154 Apr 16 15:50 ytexample.py

nodes.json (which didnt exist in /opt/minemeld/engine/current and so I had to import a copy from github)
in the above directory includes this:

"minemeld.ft.ytexample.YTExample": {
"class": "minemeld.ft.ytexample:YTExample"
},

I then tried to run "sudo -u minemeld /opt/minemeld/engine/current/bin/pip install -e /opt/minemeled/engine/core/"
which produced this error, even with -H on sudo:

DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
WARNING: The directory '/home/luke/.cache/pip' or its parent directory is not owned or is not writable by the current user. The cache has been disabled. Check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
ERROR: /opt/minemeled/engine/core/ is not a valid editable requirement. It should either be a path to a local project or a VCS URL (beginning with svn+, git+, hg+, or bzr+).

I have also put a copy of ytexample.py in what looks like the default directory for packages:
luke@ubuntu16:/opt/minemeld/engine/current/lib/python2.7/site-packages/minemeld/ft$ ll | grep le.py
-rw-r--r-- 1 minemeld minemeld 4704 Apr 10 11:14 google.py
-rw-r--r-- 1 minemeld minemeld 4886 Apr 10 11:14 google.pyc
-rw-r--r-- 1 minemeld minemeld 17277 Apr 10 11:14 table.py
-rw-r--r-- 1 minemeld minemeld 15122 Apr 10 11:14 table.pyc
-rw-rw-rw- 1 root root 2154 Apr 16 11:28 ytexample.py

I very much appreciate any help you can give.

Thanks

Luke

topic Custom miner, 'Commit Failed: unknown node class', no nodes.json file in General Topics

Custom miner, 'Commit Failed: unknown node class', no nodes.json file

Re: Custom miner, 'Commit Failed: unknown node class', no nodes.json file