Extract Emails from 1 million+ URLs with ScrapeBox

Hey, guys

Scrapebox is a great tool, with good proxies the amazing tool helps me to scraped 1 million URLs that might contain email addresses like a breeze.
But the next problem is to extract the emails from the URLs, compares to scrape search engine the process for is a pain in the ass.

There seems to have limitations with the builtin email grabber,
1. URL list size, greater than 50K grabber is likely to crash
2. When scanned more than 5K URLs, the grabber will slow down
(I check my CPU & RAM usage, around 40% when it happened, so not a performance issue)

This is not what I remember that Scrapebox used to work, a few years ago, the amazing tool can done scrape and grab like breeze. So, I am considering buying the premium grabber or other tools.

Could premium email grabber conquer the imitations, or is there any other tool that can get this job done?

DannyOrder said:

Hey, guys

Scrapebox is a great tool, with good proxies the amazing tool helps me to scraped 1 million URLs that might contain email addresses like a breeze.
But the next problem is to extract the emails from the URLs, compares to scrape search engine the process for is a pain in the ass.

There seems to have limitations with the builtin email grabber,
1. URL list size, greater than 50K grabber is likely to crash
2. When scanned more than 5K URLs, the grabber will slow down
(I check my CPU & RAM usage, around 40% when it happened, so not a performance issue)

This is not what I remember that Scrapebox used to work, a few years ago, the amazing tool can done scrape and grab like breeze. So, I am considering buying the premium grabber or other tools.

Could premium email grabber conquer the imitations, or is there any other tool that can get this job done?

Click to expand...

The email scraper can handle loading a million urls at a time.

If its crashing, then you can send the bugreport.txt file (found in your main scrapebox folder) to support to find out why its crashing.

Its not been an issue for me to work with large lists.

On the slowing, it sounds like you are running into locked threads. This could be anything from security software, to 3rd party apps to your router.

So add an exception for the entire scrapebox folder in any security software, try whitelisting scrapebox in your router if possible, and try closing down any non crucial apps as a test.

you can then turn apps back on 1 by 1 till you find the culprit. Skype, utorrent etc... anything that accesses the internet can lock threads.

Further pc optimization software can do it so you can close it down as well if your using any.

While I would personally probably not load in 1 million urls into the email scraper at once, Id probably do 100K to 500K and test it out etc.. The email scraper can functionally handle you loading in 10 million urls.

@https://www.blackhatworld.com/members/loopline.30935/, Thanks for the reply

I sort it out, it's caused by my VPN, too many connections so slow the process down.
Now, I lower the threads and use different sets of VPN and proxies and it works much faster now. Thanks

Just wget all the pages onto a linux server and grep the emails out man, easy.

DannyOrder said:

@loopline, Thanks for the reply

I sort it out, it's caused by my VPN, too many connections so slow the process down.
Now, I lower the threads and use different sets of VPN and proxies and it works much faster now. Thanks

Click to expand...

ahh makes sense. Glad you got it sorted!