[GET]Huge keyword list for scraping with scrapebox

sbw27

sbw27

Regular Member
Joined
Jan 6, 2008
Messages
390
Reaction score
445
This list consists of just under half a million keywords. I built it myself using a smaller list of high paying keywords, then expanding it using the Scrapebox keyword scraper.

It's genral niche, very useful for large scrapes. Just load your footprint up top, and this list into the keyword box and scrape.

Code: 
http://www.mediafire.com/?nk7qxll0cw779l7
 
Advertise on BHW
Nice but what if I only want to use 300 or so words from there? Have to do it via notepad?
 
djstanley said:
Nice but what if I only want to use 300 or so words from there? Have to do it via notepad?
Click to expand...

I'd recommend using a better utility such as Notepad++, it will be much faster to load and organize large text files such as this.
 
djstanley said:
Nice but what if I only want to use 300 or so words from there? Have to do it via notepad?
Click to expand...

If you only want 300 keywords, use the built in keyword scraper...put a seed keyword, and scrape.
 
Thanks for the list! Ironically now scrapebox keeps crashing. Had to make it so that combined with my footprints, scrapebox was only searching for 700K combined searches.

My system has plenty of power too:

i7-3610qm
16gb ram
 
Markthedude said:
Thanks for the list! Ironically now scrapebox keeps crashing. Had to make it so that combined with my footprints, scrapebox was only searching for 700K combined searches.

My system has plenty of power too:

i7-3610qm
16gb ram
Click to expand...

I put in 5000 keywords at a time. If SB gets close to 1 million scraped URL's it crashes.
I rarely use more than 25,000 keywords (5 lists of 5000).
I only use 100 private proxies and 5 threads so 5000 keywords often gets me more or less the 1 million URL's - though with some footprints it can be a lot more so have to split the list further. Often a "remove dupes" is enough to carry on with.

Scritty
 
A better idea i find is to use a program like keyword researcher that you can get it to search for all phrases on google that end in for example "* in usa".

Then use the find and replace feature in notepad to remove the "in usa" from all your results and you're left with many random phrases / words. This way your list of keywords is way more diverse than what scrapebox gives, since that seems to repeat the same keywords over and over with just a slight change meaning you're basically scraping the same url's over and over again.

What i like to do then is head over to the google translate tool (http://translate.google.com/) and convert these keywords into some top languages like spannish, german, french, and italian, delete all dups and scrape using these keywords which gives a lot better i.p diversity and generally finds less spammed url's to post on :)
 
Last edited:
Wow Scritty and Rua999, great tips!

I was actually looking for you Scritty after trying to scrape and having SB crash to see if you sold any lists, PM if you do or would like to trade. I'm only after a couple platforms.

And Rua999, never thought of that before, it's true what you said, I get kind of tired of having the same url scraped over and over in one sessions. I've started to dread deleting dupe domains since a huge number of the scrape urls are always delete.
 
@Rua999 great idea I am going to try that out later tomorrow as my SB is scraping right now.
 
Rua999 said:
A better idea i find is to use a program like keyword researcher that you can get it to search for all phrases on google that end in for example "* in usa".

Then use the find and replace feature in notepad to remove the "in usa" from all your results and you're left with many random phrases / words. This way your list of keywords is way more diverse than what scrapebox gives, since that seems to repeat the same keywords over and over with just a slight change meaning you're basically scraping the same url's over and over again.

What i like to do then is head over to the google translate tool (http://translate.google.com/) and convert these keywords into some top languages like spannish, german, french, and italian, delete all dups and scrape using these keywords which gives a lot better i.p diversity and generally finds less spammed url's to post on :)
Click to expand...

Good tip. Scraping in foreign languages is a little known secret in the IM world. However, you can't just translate the words. that really won't work (I mean it can, but..). you need the actual foreign characters and words
 
Roland32 said:
Good tip. Scraping in foreign languages is a little known secret in the IM world. However, you can't just translate the words. that really won't work (I mean it can, but..). you need the actual foreign characters and words
Click to expand...

There are addons for scrapebox to do that with the mad foreign languages like arabic and chinese, but that's why i only mentioned spannish, german, french, and italian to keep it simple since there's no need to convert these :)
 
For any one who wonder why and what to do with this keyword list , It can be used effectively on Scrapebox or GSA for better results..

Nice share ,
 
Great share, I just wondered what to do whit this list and I saw "dotgirish" post above where he/she explains my wondering in my mind, may I ask what is GSA . Thank's :)
 
This list is also great for HRefer. Just throwing that out there.

sbw27 said:
This list consists of just under half a million keywords. I built it myself using a smaller list of high paying keywords, then expanding it using the Scrapebox keyword scraper.

It's genral niche, very useful for large scrapes. Just load your footprint up top, and this list into the keyword box and scrape.

Code: 
http://www.mediafire.com/?nk7qxll0cw779l7
Click to expand...
 
Still a great list.

Worth noting that using SB to split the list into 10,000 blocks then using the automator plugin that is now available for SB to run each of the 40 odd lists one at a time.
Also worth shuffling the lists because I've noticed that Google is quicker to ban if you have similar searches too often, and in some places on this list there are many hundreds of very similar terms in a row, even with 100 proxies you're going to do several very similar searches quite quickly.

Again SB itself can mix these up

Scritty
 
Scritty said:
Worth noting that using SB to split the list into 10,000 blocks then using the automator plugin that is now available for SB to run each of the 40 odd lists one at a time
Click to expand...

2 questions regarding this:

1) in the automator plugin... it would be 40 different "harvest urls" steps?
2) export harvested urls... can these be the same file specified in all 40 steps? more specifically, would sb merge the newly scraped to the same file or will sb overwrite?

thanks for the help
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top