Can Scrapebox scan the whole web ?

[vjbeng]

Hello all,

I discovered this forum by reading this excellent thread about Scrapebox :
[Tutorial] How I Generate Niche Targeted Email Lists/Leads With Scrapebox


Actually, I consider buying this software, would you please take a look to see whether Scrapebox can do this :

1) Scan all domains in *.fr,
2) looking for pages whose url include a specific KEYWORD in it
3) and sorting the results with a 2 columns table : URL / email found

Thanx guys for your skilled advice !
Vjbeng

 

[Aske_senteria]

1. yes
2. yes
3. what do you mean by url / email

 

[ZennoBlaster]

No, not the whole web. There are vast sections that aren't indexed, i.e. the dark web, or the Warrior forum.

 

[vjbeng]

1. yes
2. yes
3. what do you mean by url / email

Thanks, good news
I mean an excel spreadsheet to organize the data, with column A : "Site's domain" and Column B : "email scraped"

At ZennoBlaster : thanks for the precision.

 

[scoobyrobert]

Scrapebox can only scrape was has been indexed by search engines... Majority of the web but not all.

 

[eyashwant]

Okay. Scrapebox CAN scrape the whole web IF you get it the LINKS to start it from
It can scrape everything indexed by search engine.
It has scrapping ability. But it needs a base/data to start from, and that's google and hence it's limited to what google sees

 

[loopline]

Hello all,

I discovered this forum by reading this excellent thread about Scrapebox :
[Tutorial] How I Generate Niche Targeted Email Lists/Leads With Scrapebox


Actually, I consider buying this software, would you please take a look to see whether Scrapebox can do this :

1) Scan all domains in *.fr,
2) looking for pages whose url include a specific KEYWORD in it
3) and sorting the results with a 2 columns table : URL / email found

Thanx guys for your skilled advice !
Vjbeng

Yes to all 3, except number 3. It wouldn't be in excel by default, its a text file, but you could put it in excel and separate the data easily.

However its not going to be a push button solution, your going to have to be very involved and it will take time, lots of time.

You can harvest for .fr domains
use the page scanner to find the urls with the keyword
use the email grabber to grab the emails and save them to file, so long as they are not in javascript etc..., the mails have to just be in the html of the page.

 

[ConvertiVid]

No, not the whole web. There are vast sections that aren't indexed, i.e. the dark web, or the Warrior forum.

What in the world is the dark web?

 

[vjbeng]

Okay. Scrapebox CAN scrape the whole web IF you get it the LINKS to start it from
It can scrape everything indexed by search engine.
It has scrapping ability. But it needs a base/data to start from, and that's google and hence it's limited to what google sees

Thanks a lot guys, I think I am going to read the documentation on their site.

There used to be a discount coupon for people from BHW, no ?

Yes to all 3, except number 3. It wouldn't be in excel by default, its a text file, but you could put it in excel and separate the data easily.

However its not going to be a push button solution, your going to have to be very involved and it will take time, lots of time.

Goog to know, thanks! Do you know if in the text file, you can gather different fields of data, like say, "domain harvested" and "email found" ?

 

[simply]

What in the world is the dark web?

http://en.wikipedia.org/wiki/Dark_Web

 

[vjbeng]

Hi guys,

I recall a discount coupon to get ScrapeBox at 57$, nobody remembers it maybe ?

 

[loopline]

Hi guys,

I recall a discount coupon to get ScrapeBox at 57$, nobody remembers it maybe ?

http://www.scrapebox.com/bhw

 

[vjbeng]

Amazing, thanks !

 

[sxtcsctc]

yes it can but you have to feed it the links

 

[vjbeng]

Yes to all 3, except number 3. It wouldn't be in excel by default, its a text file, but you could put it in excel and separate the data easily.

(...)
You can harvest for .fr domains
use the page scanner to find the urls with the keyword
use the email grabber to grab the emails and save them to file, so long as they are not in javascript etc..., the mails have to just be in the html of the page.

I got my licence and spent a few hours on this great soft. Now getting back to this answer, would you enlighten me a little ?

with a search in scrapebox like
inurl:keyword and inurl:fr

questions 1 and 2 are solved (except I still have to find how to get more than 1000 urls)

but I can't figure out #3 : How to sort harvested emails with the corresponding domains ?

Any emails grabbed so far is just plain email without any other data.


and thanks for the awesome tuts btw Loopline

 

[vjbeng]

Ok, why do I need that ?

So far, the SB email grabber only gives back emails. And it's quite hard to cold email someone (or a mass) without any other info.

If I get results like :

domain1|email1
domain2|email2
etc

then, I'll be able to send somehow personalized emails to John and Georgio :

I visited your site domain1 and blabla bla

So please, how to get the harvested domain with the grabbed email ?

 

[Deleted member 120847]

A tool that will do what you are looking for is GSA email spider.

 

[Sweetfunny]

Ok, why do I need that ?

So far, the SB email grabber only gives back emails. And it's quite hard to cold email someone (or a mass) without any other info.

If I get results like :

domain1|email1
domain2|email2
etc

then, I'll be able to send somehow personalized emails to John and Georgio :

I visited your site domain1 and blabla bla

So please, how to get the harvested domain with the grabbed email ?

If you are using ScrapeBox v1 then go to Options >> Email grabber: Save urls with email, and it will save it exactly like email|domain

Or if you are using ScrapeBox v2, which you should because it's got a native 64-bit version which can handle hundreds of millions of urls, and it also has a site spider email grabber which can crawl a site not just scrape emails from the loaded urls. The option to save the urls with the emails is right on the email scrapers.

 

[loopline]

I got my licence and spent a few hours on this great soft. Now getting back to this answer, would you enlighten me a little ?

with a search in scrapebox like
inurl:keyword and inurl:fr

questions 1 and 2 are solved (except I still have to find how to get more than 1000 urls)

but I can't figure out #3 : How to sort harvested emails with the corresponding domains ?

Any emails grabbed so far is just plain email without any other data.


and thanks for the awesome tuts btw Loopline

Glad you like the tutorials.

if you are searching for .fr domains you can try site:.fr

The site operator seems to get banned less quickly then inurl, although it may not make much difference as you already have an inurl operator in there too.

However to get more then 1000 results you can tack keywords or letters. The keyword scraper has the option to append a-z to the end and then google will return different sets of results from its database of thousands and then you can just remove duplicate urls when you are done.

 

[vjbeng]

A tool that will do what you are looking for is GSA email spider.

Thx Stipen for the alternative. Good to know, even if not free.

If you are using ScrapeBox v1 then go to Options - Email grabber: Save urls with email, and it will save it exactly like email - domain

Ok, thanks SweetFunny, sorry of being such a newbie. I found my way with this option, and using this tool to trim URLs down to domain names : ninjaseotools

Glad you like the tutorials.

The site operator seems to get banned less quickly then inurl, although it may not make much difference as you already have an inurl operator in there too.

A thank you is still free ! got it for inurl, I'll keep this in mind.

However to get more then 1000 results you can tack keywords or letters. The keyword scraper has the option to append a-z to the end and then google will return different sets of results from its database of thousands and then you can just remove duplicate urls when you are done.

thanks 1 more time ! nice way to overcome this 1000 results limit

PS : this "no url no emails" policy for newcomers is quite a pain... 15 minutes to find out that SMILEYS are forbidden....