topic Re: Web Scrapping in Cortex XSOAR Discussions

Web Scrapping

Syedhkt — Tue, 09 Jul 2024 06:45:32 GMT

Hi All,

I have some website for news and i want to get content of that webiste and send email using xsoar. Any useful integrations?

Re: Web Scrapping

jfernandes1 — Wed, 10 Jul 2024 02:24:03 GMT

Hi @Syedhkt, you could try the Web Scraper pack. Refer - https://cortex.marketplace.pan.dev/marketplace/details/WebScraper/

Please note this is community contributed content.

Re: Web Scrapping

Syedhkt — Wed, 10 Jul 2024 05:03:21 GMT

Thanks for your info but this content pack is not working fine and I believe this is only one available content pack for xsoar available. However the second option is to write custom automation but I am trying to find solution with existed content packs

Re: Web Scrapping

jfernandes1 — Thu, 11 Jul 2024 02:51:12 GMT

Hi @Syedhkt, works for me. Screenshot below for your reference.

Re: Web Scrapping

Syedhkt — Thu, 11 Jul 2024 09:06:11 GMT

thanks for your well details information. I have one more question i want to scrap a website and send notification with scrapped result every day from xsoar. I need to use playbook so without creating incident can i run playbook after every 24 hours ? or any other approach

Re: Web Scrapping

cbrake1 — Thu, 11 Jul 2024 13:38:20 GMT

Hi Syedhkt,

If you want this to occur every day, I recommend using the 'Jobs' function in XSOAR. You'll be able to use that to set the playbook to run automatically at a specified time interval (every day at X time). Just navigate to Jobs > New Job (In the upper righthand corner) > Check Reoccurring > Use the UI to select when you'd like, or use a Cron expression like 0 16 * * 0-6 (this example will make it run every day at 4pm) > Set information like the Type, Owner, Severity, Playbook, etc. Jobs are like scheduled incidents, but can be excluded from queries by adding '-category:job'.

Re: Web Scrapping

Syedhkt — Fri, 12 Jul 2024 04:04:46 GMT

thank you for well detailed answer