Bad Gateway error

Reply
L0 Member

Bad Gateway error

Hello All,

 

I installed minemeld on aws instance, when I am trying to logging getting "Error checking credential: bad gateway". I checked Minemeld services and getting error as :

 

minemeld-engine                  FATAL     Exited too quickly (process log may have details)
minemeld-supervisord-listener    RUNNING   pid 1921, uptime 0:08:47
minemeld-traced                  RUNNING   pid 1923, uptime 0:08:47
minemeld-web                     FATAL     Exited too quickly (process log may have details)

 

Please let me know if I missed somthing in new deplymenet.

L5 Sessionator

Re: Bad Gateway error

Hi @sam2016,

 

looks like one of the dependencies did not install correctly during the setup. You might want to take a quick look to log files in /opt/minemel/log (minemeld-engine.log, minemeld-web.log, ...) for an error trace that could provide a lead.

L0 Member

Re: Bad Gateway error

Hi @xhoms

 

Thanks for your response.

 

In minemeld-web.log: I can see errors as "[11811] [ERROR] Exception in worker process"

In minemeld-engine.log : I can see

 

2018-04-15T07:12:26 (11529)launcher.main INFO: Starting mm-run.py version 0.9.44
2018-04-15T07:12:26 (11529)launcher.main INFO: mm-run.py arguments: Namespace(config='/opt/minemeld/local/config', multiprocessing=0, nodes_per_chassis=15.0, verbose=False)
Traceback (most recent call last):
  File "/opt/minemeld/engine/current/bin/mm-run", line 11, in <module>
    sys.exit(main())
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/launcher.py", line 218, in main
    config = minemeld.run.config.load_config(args.config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 567, in load_config
    return _load_config_from_dir(config_path)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 382, in _load_config_from_dir
    ccvalid, cconfig = _load_and_validate_config_from_file(ccpath)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 281, in _load_and_validate_config_from_file
    valid = resolve_prototypes(config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 477, in resolve_prototypes
    prototypes_entrypoints = minemeld.loader.map(minemeld.loader.MM_PROTOTYPES_ENTRYPOINT)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 105, in map
    _initialize_entry_point_group(entrypoint_group)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 55, in _initialize_entry_point_group
    installed = _installed_versions()
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 29, in _installed_versions
    installed_dists = pip.get_installed_distributions()

 

I am not sure if this is issue is with newer version. attaching log file for refrence.

L7 Applicator

Re: Bad Gateway error

Hi @sam2016,

the last lines of the errors are missing. Please, could you paste the entire Exception?

 

Thanks!

luigi

L0 Member

Re: Bad Gateway error

Hello - I'll add a "me, too".  Getting the same error on a fresh install.  The log/minemeld-engine.log reports:

 

2018-04-17T13:40:15 (12683)launcher.main INFO: mm-run.py arguments: Namespace(config='/opt/minemeld/local/config', multiprocessing=0, nodes_per_chassis=15.0, verbose=False)
Traceback (most recent call last):
  File "/opt/minemeld/engine/current/bin/mm-run", line 11, in <module>
    sys.exit(main())
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/launcher.py", line 218, in main
    config = minemeld.run.config.load_config(args.config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 567, in load_config
    return _load_config_from_dir(config_path)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 382, in _load_config_from_dir
    ccvalid, cconfig = _load_and_validate_config_from_file(ccpath)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 281, in _load_and_validate_config_from_file
    valid = resolve_prototypes(config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 477, in resolve_prototypes
    prototypes_entrypoints = minemeld.loader.map(minemeld.loader.MM_PROTOTYPES_ENTRYPOINT)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 105, in map
    _initialize_entry_point_group(entrypoint_group)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 55, in _initialize_entry_point_group
    installed = _installed_versions()
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 29, in _installed_versions
    installed_dists = pip.get_installed_distributions()
AttributeError: 'module' object has no attribute 'get_installed_distributions'

 

Perhaps my sys.path is getting messed up?

L2 Linker

Re: Bad Gateway error

I just tried to deploy MineMeld in Azure using the official template and got the same error.

 

admin@vm1:~$ sudo -u minemeld /opt/minemeld/engine/current/bin/supervisorctl -c /opt/minemeld/local/supervisor/config/supervisord.conf status
minemeld-engine                  FATAL     Exited too quickly (process log may have details)
minemeld-supervisord-listener    RUNNING   pid 11603, uptime 0:01:29
minemeld-traced                  RUNNING   pid 11605, uptime 0:01:29
minemeld-web                     RUNNING   pid 12267, uptime 0:00:01
admin@vm1:~$ less /opt/minemeld/log/
minemeld-engine.log                                           minemeld-supervisord-listener-stdout---supervisor-y5ajV9.log  minemeld-web.log
minemeld-engine-stderr---supervisor-M96AeT.log                minemeld-traced.log                                           minemeld-web-stderr---supervisor-fsqwLy.log
minemeld-supervisord-listener.log                             minemeld-traced-stderr---supervisor-_qh1ic.log                supervisord.log
admin@vm1:~$ less /opt/minemeld/log/minemeld-engine.log
2018-04-17T22:01:59 (11604)launcher.main INFO: Starting mm-run.py version 0.9.44
2018-04-17T22:01:59 (11604)launcher.main INFO: mm-run.py arguments: Namespace(config='/opt/minemeld/local/config', multiprocessing=0, nodes_per_chassis=15.0, verbose=False)
Traceback (most recent call last):
  File "/opt/minemeld/engine/current/bin/mm-run", line 11, in <module>
    sys.exit(main())
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/launcher.py", line 218, in main
    config = minemeld.run.config.load_config(args.config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 567, in load_config
    return _load_config_from_dir(config_path)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 382, in _load_config_from_dir
    ccvalid, cconfig = _load_and_validate_config_from_file(ccpath)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 281, in _load_and_validate_config_from_file
    valid = resolve_prototypes(config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 477, in resolve_prototypes
    prototypes_entrypoints = minemeld.loader.map(minemeld.loader.MM_PROTOTYPES_ENTRYPOINT)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 105, in map
    _initialize_entry_point_group(entrypoint_group)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 55, in _initialize_entry_point_group
    installed = _installed_versions()
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 29, in _installed_versions
    installed_dists = pip.get_installed_distributions()
AttributeError: 'module' object has no attribute 'get_installed_distributions'
2018-04-17T22:02:02 (11748)launcher.main INFO: Starting mm-run.py version 0.9.44
2018-04-17T22:02:02 (11748)launcher.main INFO: mm-run.py arguments: Namespace(config='/opt/minemeld/local/config', multiprocessing=0, nodes_per_chassis=15.0, verbose=False)
Traceback (most recent call last):
  File "/opt/minemeld/engine/current/bin/mm-run", line 11, in <module>
    sys.exit(main())
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/launcher.py", line 218, in main
    config = minemeld.run.config.load_config(args.config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 567, in load_config
    return _load_config_from_dir(config_path)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 382, in _load_config_from_dir
    ccvalid, cconfig = _load_and_validate_config_from_file(ccpath)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 281, in _load_and_validate_config_from_file
    valid = resolve_prototypes(config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 477, in resolve_prototypes
    prototypes_entrypoints = minemeld.loader.map(minemeld.loader.MM_PROTOTYPES_ENTRYPOINT)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 105, in map
    _initialize_entry_point_group(entrypoint_group)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 55, in _initialize_entry_point_group
    installed = _installed_versions()
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 29, in _installed_versions
    installed_dists = pip.get_installed_distributions()
AttributeError: 'module' object has no attribute 'get_installed_distributions'
2018-04-17T22:02:06 (11770)launcher.main INFO: Starting mm-run.py version 0.9.44
2018-04-17T22:02:06 (11770)launcher.main INFO: mm-run.py arguments: Namespace(config='/opt/minemeld/local/config', multiprocessing=0, nodes_per_chassis=15.0, verbose=False)
Traceback (most recent call last):
  File "/opt/minemeld/engine/current/bin/mm-run", line 11, in <module>
    sys.exit(main())
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/launcher.py", line 218, in main
    config = minemeld.run.config.load_config(args.config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 567, in load_config
    return _load_config_from_dir(config_path)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 382, in _load_config_from_dir
    ccvalid, cconfig = _load_and_validate_config_from_file(ccpath)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 281, in _load_and_validate_config_from_file
    valid = resolve_prototypes(config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 477, in resolve_prototypes
    prototypes_entrypoints = minemeld.loader.map(minemeld.loader.MM_PROTOTYPES_ENTRYPOINT)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 105, in map
    _initialize_entry_point_group(entrypoint_group)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 55, in _initialize_entry_point_group
    installed = _installed_versions()
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 29, in _installed_versions
    installed_dists = pip.get_installed_distributions()
AttributeError: 'module' object has no attribute 'get_installed_distributions'
2018-04-17T22:02:10 (11798)launcher.main INFO: Starting mm-run.py version 0.9.44
2018-04-17T22:02:10 (11798)launcher.main INFO: mm-run.py arguments: Namespace(config='/opt/minemeld/local/config', multiprocessing=0, nodes_per_chassis=15.0, verbose=False)
Traceback (most recent call last):
  File "/opt/minemeld/engine/current/bin/mm-run", line 11, in <module>
    sys.exit(main())
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/launcher.py", line 218, in main
    config = minemeld.run.config.load_config(args.config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 567, in load_config
    return _load_config_from_dir(config_path)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 382, in _load_config_from_dir
    ccvalid, cconfig = _load_and_validate_config_from_file(ccpath)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 281, in _load_and_validate_config_from_file
    valid = resolve_prototypes(config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 477, in resolve_prototypes
    prototypes_entrypoints = minemeld.loader.map(minemeld.loader.MM_PROTOTYPES_ENTRYPOINT)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 105, in map
    _initialize_entry_point_group(entrypoint_group)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 55, in _initialize_entry_point_group
    installed = _installed_versions()
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 29, in _installed_versions
    installed_dists = pip.get_installed_distributions()
AttributeError: 'module' object has no attribute 'get_installed_distributions'
L0 Member

Re: Bad Gateway error

Me too...

minemeld-engine.log on new install of ubuntu 14

2018-04-17T16:00:09 (1579)launcher.main INFO: Starting mm-run.py version 0.9.44
2018-04-17T16:00:09 (1579)launcher.main INFO: mm-run.py arguments: Namespace(config='/opt/minemeld/local/config', multiprocessing=0, nodes_per_chassis=15.0, verbose=False)
Traceback (most recent call last):
  File "/opt/minemeld/engine/current/bin/mm-run", line 11, in <module>
    sys.exit(main())
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/launcher.py", line 218, in main
    config = minemeld.run.config.load_config(args.config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 567, in load_config
    return _load_config_from_dir(config_path)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 382, in _load_config_from_dir
    ccvalid, cconfig = _load_and_validate_config_from_file(ccpath)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 281, in _load_and_validate_config_from_file
    valid = resolve_prototypes(config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 477, in resolve_prototypes
    prototypes_entrypoints = minemeld.loader.map(minemeld.loader.MM_PROTOTYPES_ENTRYPOINT)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 105, in map
    _initialize_entry_point_group(entrypoint_group)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 55, in _initialize_entry_point_group
    installed = _installed_versions()
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 29, in _installed_versions
    installed_dists = pip.get_installed_distributions()
AttributeError: 'module' object has no attribute 'get_installed_distributions'
2018-04-17T16:00:14 (1601)launcher.main INFO: Starting mm-run.py version 0.9.44
2018-04-17T16:00:14 (1601)launcher.main INFO: mm-run.py arguments: Namespace(config='/opt/minemeld/local/config', multiprocessing=0, nodes_per_chassis=15.0, verbose=False)
Traceback (most recent call last):
  File "/opt/minemeld/engine/current/bin/mm-run", line 11, in <module>
    sys.exit(main())
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/launcher.py", line 218, in main
    config = minemeld.run.config.load_config(args.config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 567, in load_config
    return _load_config_from_dir(config_path)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 382, in _load_config_from_dir
    ccvalid, cconfig = _load_and_validate_config_from_file(ccpath)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 281, in _load_and_validate_config_from_file
    valid = resolve_prototypes(config)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/run/config.py", line 477, in resolve_prototypes
    prototypes_entrypoints = minemeld.loader.map(minemeld.loader.MM_PROTOTYPES_ENTRYPOINT)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 105, in map
    _initialize_entry_point_group(entrypoint_group)
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 55, in _initialize_entry_point_group
    installed = _installed_versions()
  File "/opt/minemeld/engine/0.9.44/local/lib/python2.7/site-packages/minemeld/loader.py", line 29, in _installed_versions
    installed_dists = pip.get_installed_distributions()
AttributeError: 'module' object has no attribute 'get_installed_distributions'
L7 Applicator

Re: Bad Gateway error

Hi all,

this is was a conflict with the latest release of a python package. The fix has been merged and we will make available the fixed release today or tomorrow. Sorry for the incovenience.

 

https://github.com/PaloAltoNetworks/minemeld-core/issues/270

 

A quick workaround is using Ansible (https://github.com/PaloAltoNetworks/minemeld-ansible) to install MineMeld or the MineMeld docker.

 

EDIT

While waiting for the fix, a workaround is forcing the previous version of the package:

sudo service minemeld stop
sudo -H -u minemeld /opt/minemeld/engine/current/bin/pip install pip==9.0.3
sudo service minemeld start
Like what you see?

Show your appreciation!

Click Like if a post is helpful to you or if you just want to show your support.

Click Accept as Solution to acknowledge that the answer to your question has been provided.

The button appears next to the replies on topics you’ve started. The member who gave the solution and all future visitors to this topic will appreciate it!

These simple actions take just seconds of your time, but go a long way in showing appreciation for community members and the Live Community as a whole!

The Live Community thanks you for your participation!