Can Scrapebox scan the whole web ?

V

vjbeng

Newbie
Joined
Jun 9, 2015
Messages
8
Reaction score
0
Hello all,

I discovered this forum by reading this excellent thread about Scrapebox :
[Tutorial] How I Generate Niche Targeted Email Lists/Leads With Scrapebox


Actually, I consider buying this software, would you please take a look to see whether Scrapebox can do this :

1) Scan all domains in *.fr,
2) looking for pages whose url include a specific KEYWORD in it
3) and sorting the results with a 2 columns table : URL / email found

Thanx guys for your skilled advice !
Vjbeng
 
Advertise on BHW
Aske_senteria said:
1. yes
2. yes
3. what do you mean by url / email
Click to expand...

Thanks, good news :)
I mean an excel spreadsheet to organize the data, with column A : "Site's domain" and Column B : "email scraped"

At ZennoBlaster : thanks for the precision.
 
Scrapebox can only scrape was has been indexed by search engines... Majority of the web but not all.
 
Okay. Scrapebox CAN scrape the whole web IF you get it the LINKS to start it from
It can scrape everything indexed by search engine.
It has scrapping ability. But it needs a base/data to start from, and that's google and hence it's limited to what google sees
 
vjbeng said:
Hello all,

I discovered this forum by reading this excellent thread about Scrapebox :
[Tutorial] How I Generate Niche Targeted Email Lists/Leads With Scrapebox


Actually, I consider buying this software, would you please take a look to see whether Scrapebox can do this :

1) Scan all domains in *.fr,
2) looking for pages whose url include a specific KEYWORD in it
3) and sorting the results with a 2 columns table : URL / email found

Thanx guys for your skilled advice !
Vjbeng
Click to expand...

Yes to all 3, except number 3. It wouldn't be in excel by default, its a text file, but you could put it in excel and separate the data easily.

However its not going to be a push button solution, your going to have to be very involved and it will take time, lots of time.

You can harvest for .fr domains
use the page scanner to find the urls with the keyword
use the email grabber to grab the emails and save them to file, so long as they are not in javascript etc..., the mails have to just be in the html of the page.
 
eyashwant said:
Okay. Scrapebox CAN scrape the whole web IF you get it the LINKS to start it from
It can scrape everything indexed by search engine.
It has scrapping ability. But it needs a base/data to start from, and that's google and hence it's limited to what google sees
Click to expand...


Thanks a lot guys, I think I am going to read the documentation on their site.

There used to be a discount coupon for people from BHW, no ?

Yes to all 3, except number 3. It wouldn't be in excel by default, its a text file, but you could put it in excel and separate the data easily.

However its not going to be a push button solution, your going to have to be very involved and it will take time, lots of time.
Click to expand...

Goog to know, thanks! Do you know if in the text file, you can gather different fields of data, like say, "domain harvested" and "email found" ?
 
Hi guys,

I recall a discount coupon to get ScrapeBox at 57$, nobody remembers it maybe ?
 
loopline said:
Yes to all 3, except number 3. It wouldn't be in excel by default, its a text file, but you could put it in excel and separate the data easily.

(...)
You can harvest for .fr domains
use the page scanner to find the urls with the keyword
use the email grabber to grab the emails and save them to file, so long as they are not in javascript etc..., the mails have to just be in the html of the page.
Click to expand...

I got my licence and spent a few hours on this great soft. Now getting back to this answer, would you enlighten me a little ?

with a search in scrapebox like
inurl:keyword and inurl:fr

questions 1 and 2 are solved (except I still have to find how to get more than 1000 urls)

but I can't figure out #3 : How to sort harvested emails with the corresponding domains ?

Any emails grabbed so far is just plain email without any other data.


and thanks for the awesome tuts btw Loopline ;)
 
Last edited:
Ok, why do I need that ?

So far, the SB email grabber only gives back emails. And it's quite hard to cold email someone (or a mass) without any other info.

If I get results like :

domain1|email1
domain2|email2
etc

then, I'll be able to send somehow personalized emails to John and Georgio :

I visited your site domain1 and blabla bla

So please, how to get the harvested domain with the grabbed email ?
 
A tool that will do what you are looking for is GSA email spider.
 
vjbeng said:
Ok, why do I need that ?

So far, the SB email grabber only gives back emails. And it's quite hard to cold email someone (or a mass) without any other info.

If I get results like :

domain1|email1
domain2|email2
etc

then, I'll be able to send somehow personalized emails to John and Georgio :

I visited your site domain1 and blabla bla

So please, how to get the harvested domain with the grabbed email ?
Click to expand...

If you are using ScrapeBox v1 then go to Options >> Email grabber: Save urls with email, and it will save it exactly like email|domain

Or if you are using ScrapeBox v2, which you should because it's got a native 64-bit version which can handle hundreds of millions of urls, and it also has a site spider email grabber which can crawl a site not just scrape emails from the loaded urls. The option to save the urls with the emails is right on the email scrapers.
 
vjbeng said:
I got my licence and spent a few hours on this great soft. Now getting back to this answer, would you enlighten me a little ?

with a search in scrapebox like
inurl:keyword and inurl:fr

questions 1 and 2 are solved (except I still have to find how to get more than 1000 urls)

but I can't figure out #3 : How to sort harvested emails with the corresponding domains ?

Any emails grabbed so far is just plain email without any other data.


and thanks for the awesome tuts btw Loopline ;)
Click to expand...

Glad you like the tutorials. :)

if you are searching for .fr domains you can try site:.fr

The site operator seems to get banned less quickly then inurl, although it may not make much difference as you already have an inurl operator in there too.

However to get more then 1000 results you can tack keywords or letters. The keyword scraper has the option to append a-z to the end and then google will return different sets of results from its database of thousands and then you can just remove duplicate urls when you are done.
 
A tool that will do what you are looking for is GSA email spider.
Click to expand...
Thx Stipen for the alternative. Good to know, even if not free.

If you are using ScrapeBox v1 then go to Options - Email grabber: Save urls with email, and it will save it exactly like email - domain
Click to expand...
Ok, thanks SweetFunny, sorry of being such a newbie. I found my way with this option, and using this tool to trim URLs down to domain names : ninjaseotools


Glad you like the tutorials.

The site operator seems to get banned less quickly then inurl, although it may not make much difference as you already have an inurl operator in there too.
Click to expand...

A thank you is still free ! got it for inurl, I'll keep this in mind.

However to get more then 1000 results you can tack keywords or letters. The keyword scraper has the option to append a-z to the end and then google will return different sets of results from its database of thousands and then you can just remove duplicate urls when you are done.
Click to expand...

thanks 1 more time ! nice way to overcome this 1000 results limit

PS : this "no url no emails" policy for newcomers is quite a pain... 15 minutes to find out that SMILEYS are forbidden....
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top