I have 200k list of domains i need to scrap emails from each domain. I am using atomic email hunter but its taking 20 hours to do that task, Do we have some alternate tool which can help scrap lot faster then atomic email hunter, Please advice.
As mentioned in our PM discussion what you need can be done with SB but not directly.
The OP needs a software where he can add a lists of domains and the software should take each domain and crawl the entire website and extract emails.
The problem is that this can't be done directly with SB. When I say directly I mean that there is no "button to push" to do that.
With SB we can do this:
Load the domains list in the harvester keyword list and harvest search engines with "site:" operator.
The resulted list will be loaded in the link extractor and we extract internal links.
After we clean the resulted list from the link extractor we load it again in the link extractor and we do this few more times (use automator plugin).
At the end we will have a list with almost all the internal links of the domains in the first list and we will use "grab emails" to extract email from that list.
As said, depending on your resources on a list of 200k domains this can take from 1 to few days.
If you need to harvest all urls from these domains and then find out the email ids on each page, it can still be done with scrapebox but with a lot of manual intervention as described by poster above.
Otherwise, get yourself some custom bot created for the same. PM me if you want something custom made.
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.