topic Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class in General Topics

Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class of prototype

danilo.souza — Fri, 24 Aug 2018 14:20:02 GMT

Hi guys,

I'm dealing with a issue new to me, but perhaps somebody else has already resolved it. I built a new local IPv4 prototype based on the malwaredomainlist.ip. The configuration is:

age_out:
default: null
sudden_death: true
attributes:
confidence: 95
share_level: green
type: IPv4
interval: 300
indicator:
regex: ([0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3})
transform: \1
source_name: ag_log
url: http://xxx/static/log.txt

The point is, I only get the "__str__ returned non-string (TypeError)" error when I commit my configuration with the new node included, as shown the figure 1. The structure of the url mined is shown in figure 2. May be I'm wrong, but the miner is not being able to deal with the url mined, or the indicators mined. Am I wrong?

Thank you in advanced.

Best regards.

Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

xhoms — Fri, 24 Aug 2018 14:57:12 GMT

@danilo.souza,

could you, please, take a look at the engine log (/opt/minemeld/log/minemeld-engine.log) and look for corresponding error messages?

Share them in the discussion to try identify the root cause.

But, in the meanwhile, you could try this alternative regex and template:

indicator:
  regex: .*((\s)+([0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3})).*
  transform: \3

Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

danilo.souza — Fri, 24 Aug 2018 16:43:14 GMT

Hi @xhoms

I created a new prototype based in the regex you sent, but I got the same behaviour. I'm adding a figure with the extract of the log related with this node specifically. Do you see anything relevant? I don't. May be certificate in the URL mined?

Best regards.

Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

xhoms — Sat, 25 Aug 2018 09:35:49 GMT

@danilo.souza, something is preventing MineMeld from successfully reaching the URL providing the feed. Could you, please, run the shell command curl <URL> from the OS hosting MineMeld to verify you can reach the feed?

Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

danilo.souza — Mon, 27 Aug 2018 11:40:10 GMT

Hi @xhoms,

I think I was right. The problem seems to be with the certificate. Look what I get (figure) running the shell command curl <URL>. My machine doesn't belive in the certificate chain. Is it?

Best regards.

Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

xhoms — Mon, 27 Aug 2018 11:52:20 GMT

You're right. MineMeld is not trusting the certificate of your feed. The Python engine MineMeld relies on has its own certificate store. So, if you want to import the certificate chain of your feed then you must import it onto Python's trust store (not your host trust certificate store).

Another option is to set the "verify_cert" class configuration attribute to false.

Both options explained bu Luigi in the following response https://live.paloaltonetworks.com/t5/MineMeld-Discussions/Minemeld-SSL-Certificates/m-p/113561/highlight/true#M345

topic Re: Getting "__str__ returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class in General Topics

Getting "__str__ returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class of prototype

Re: Getting "__str__ returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

Re: Getting "__str__ returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

Re: Getting "__str__ returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

Re: Getting "__str__ returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

Re: Getting "__str__ returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

topic Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class in General Topics

Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class of prototype

Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class

Re: Getting "str returned non-string (TypeError)" for a minemeld.ft.http.HttpFT class