topic Miner Node show error "HTTPSConnectionPools" and "ConnectTimeoutError" in General Topics

Miner Node show error "HTTPSConnectionPools" and "ConnectTimeoutError"

iThreatHunt — Mon, 28 Aug 2017 08:14:30 GMT

I have errors from retieve feed file form any source. It shows "HTTPSConnectionPool (host='source',port=443): Max retries exceeded with url: xxxx.txt (Caused by ConnectTimeoutError (<requests.packages.urllib3.connection.Verified object at 0x7fdd988ad310>, 'Connection to souce timed out. (connect timeout=20)'))

But I can use wget file from same website.

Could you advise for this issue?

Thank you

Re: Miner Node show error "HTTPSConnectionPools" and "ConnectTimeoutError"

xhoms — Mon, 28 Aug 2017 14:50:03 GMT

@iThreatHunt: if I'm not mistaken there is an error in your /etc/default/minemeld configuration file. To use a proxy for https you should set the enviromental variable as

HTTPS_PROXY="http://10.192.0.108:8080"

instead of

HTTPS_PROXY="https://10.192.0.108:8080"

Re: Miner Node show error "HTTPSConnectionPools" and "ConnectTimeoutError"

iThreatHunt — Tue, 29 Aug 2017 07:49:20 GMT

Thanks @xhoms but I found new issue.

Is there a way to manually remove/re-install minemeld if it has been interrupted?

Re: Miner Node show error "HTTPSConnectionPools" and "ConnectTimeoutError"

lmori — Tue, 29 Aug 2017 13:47:56 GMT

Hi @iThreatHunt,

MineMeld Miners automatically retries the connection in case of error.

In your case it seems that the Miner is not able to verify the remote cert. Are you doing SSL Decryption on the proxy or on the firewall between MM and the remote site ?

Re: Miner Node show error "HTTPSConnectionPools" and "ConnectTimeoutError"

iThreatHunt — Wed, 30 Aug 2017 00:16:10 GMT

Hi @Imori,

This server is behind Proxy. Now I define my proxy on /etc/environment and /etc/default/minemld. You can see above posts.
How do I fix this issue?

Thank you

Re: Miner Node show error "HTTPSConnectionPools" and "ConnectTimeoutError"

iThreatHunt — Mon, 04 Sep 2017 09:15:36 GMT

Now I bypass Proxy. It is work normally.

Re: Miner Node show error "HTTPSConnectionPools" and "ConnectTimeoutError"

lmori — Tue, 05 Sep 2017 12:28:20 GMT

Is your proxy doing SSL decryption ?

luigi