1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Want to Harvest Huge Lists of Domains Using ScrapeBox? Check This Out!

Discussion in 'Black Hat SEO Tools' started by crazyflx, Dec 10, 2010.

  1. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    I've separated this post into two areas:

    1: Why I had the software made (after programming it myself with uBot)
    2: What it does specifically


    Why I had it made:

    One of the biggest problems I had when trying to harvest huge lists with ScrapeBox, was that I couldn't get enough keywords...or a diverse enough list of keywords.

    I know a lot of other people have the same problem, because I get two or three PM's a day from people asking me where to get enough words/phrases to scrape with and how to get huge lists of words/phrases to scrape with...it apparently is a road block for a lot of people.

    When I first started generating HUGE lists, I would use word lists I could find on the web like (each is also a link to each list, in case you're interested ;) ):

    "Every" word in the English language lists
    Most commonly used words
    Lists of verbs (scroll down to the bottom of that page)
    Lists of nouns (scroll down to the bottom of that page)
    Lists of adverbs (scroll down to the bottom of that page)
    etc.
    etc.

    I would use the words from those lists as my keywords and harvest with them. Then I would then use those words as "seed" words in the ScrapeBox Keyword Scraper, and generate new keywords/phrases and scrape more blogs with those.

    The thing is, a single word like "games" or "television" will only generate so many suggestions. Even with the Wonder Wheel Scraper, you're still only getting suggestions back that are based on your input word. There are THOUSANDS of commonly searched words/phrases that you'll miss out on, because you're not using, or going to find, the appropriate keyword to start with.

    On top of that, with a phrase like "online gaming" returning over nineteen million results, you're only getting a super small fraction of those results back to you, because you can only scrape the first one thousand results that Google returns to you. You need TONS of long-tail keywords to really get every single result back (if that's even possible).

    With that in mind, I made myself a tool using uBot that would generate enormous lists of keywords...but more importantly, keywords that people read about & search for every single day. The bot would scrape the Google Suggestions that appear beneath the query bar at Google as you type in your search phrase...but with a twist (I'll get to that in a second).

    The bot worked great, but it was rather slow, because uBot doesn't fully support multi-threading as of right now. So I went to a freelancer, and had an appropriate bit of software made (the one I'm giving to you) It cost me $170 to have made...I'll share the link with you to the ScriptLance job if you'd like.

    The only point of this software, is to generate MASSIVE amounts of keywords based on the suggestions that Google says are the most relevant and most searched for, based on the word you've typed in the query bar. This gives you literally all the keywords/phrases you'll need to generate the largest lists of diverse domains that you could even imagine.

    What the software does specifically:

    Here is the twist that makes this software different from every other Google Suggestion Scraper out there...this software scrapes the suggestions after EVERY NEW LETTER IS ENTERED. Since Google returns ten suggestions beneath it, that means that a four letter word can actually provide forty suggestions (ten new suggestions after each letter is keyed in)...not just the ten that the whole word typed out suggests. Also, remember, since it's scraping what appears beneath the query bar, you know you're getting keywords that people are actually looking for...if people are looking for them, it's a good bet that there are a lot of people writing about them.

    It does a little more too...it has an option for "levels deep". What that means is this:

    Lets say my input word is "home"

    The software will type into the Google query bar, letter-by-letter, the word "home". After each letter is typed, it scrapes the ten suggestions and removes the duplicates (on the fly). So after it finishes typing "home", if there were no duplicates, you now have 40 new words.

    That's what 1 level deep does.

    Level 2 does what level 1 did, but FOR EVERY WORD IT JUST SCRAPED. So you've got forty new words generated from going 1 level deep. Lets just say for examples sake that all forty of those newly scraped words were four letters long. Each of those newly scraped words is going to generate forty new suggestions. That's 40 X 40 = 1600! Sixteen hundred keywords/phrases generated from one single word.

    Level 3 will do exactly the same thing for ALL OF THOSE newly generated words (that is, type out each of the 1600 words letter by letter scraping all the suggestions beneath the query bar).

    All the while it will be removing the duplicates "on the fly".

    So this software generates both "shorttail" & "longtail" (very longtail) keywords...and again, all of them will be things that people are actually looking for...which likely means they are written about (when was the last time you did a google search and didn't find what you were looking for?)

    You can download the software from the bottom of the first post in my other thread here: http://www.blackhatworld.com/blackh...han-every-other-one-generates-huge-lists.html

    So that's it. That's how I've been generating my keyword lists for the massive amounts of blogs that I scrape on a daily basis...and now you can do it too :)
     
    • Thanks Thanks x 32
  2. bizroot

    bizroot Supreme Member

    Joined:
    Feb 25, 2008
    Messages:
    1,345
    Likes Received:
    912
    Location:
    In My Computer
    Yesterday I bought one dedi apart from VPS and now you gave me keywords LOL I am gonna make some big list... My sites needed extra push...

    Thanks and +rep added
     
    • Thanks Thanks x 1
  3. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    Haha, now you're really going to be busy.

    Enjoy it man!
     
  4. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    Here are 3 output files, 1, 2 & 3 "levels deep" using the following phrase:

    "ab" (without quotes)

    Just so you can see what the software can really do and how it can really get you all the words/phrases you need to generate huge lists:

    Code:
    http://www.mediafire.com/?vs9epta2vbx8it3
     
    • Thanks Thanks x 4
  5. marrrko

    marrrko Jr. VIP Jr. VIP

    Joined:
    Oct 10, 2009
    Messages:
    3,896
    Likes Received:
    1,611
    Location:
    Good Old Europe
    Home Page:

    Thanks, will try it right now :)
    I also need some good lost of KW
     
  6. greenleaf4u

    greenleaf4u BANNED BANNED

    Joined:
    Jan 18, 2010
    Messages:
    762
    Likes Received:
    190
    good tip thanks
     
  7. Stu784

    Stu784 Regular Member

    Joined:
    Nov 2, 2009
    Messages:
    426
    Likes Received:
    106
    I agree with Greenleaf.
    Posted via Mobile Device
     
  8. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    Happy to help you guys out, and I'm glad you enjoy the share...however, next time you might want to be careful with the short "nice share" type replies.

    Mods kind of frown upon those.
     
  9. aWas1

    aWas1 Registered Member

    Joined:
    Mar 31, 2010
    Messages:
    90
    Likes Received:
    7
    The lists helped me quite a bit..Got about 100k domains and then aborted the harvesting process..I guess its spam time? lol
     
  10. horang007

    horang007 Junior Member

    Joined:
    Oct 24, 2008
    Messages:
    192
    Likes Received:
    20
    Thanks for the awesome share. The new generated keyword file also had some links and domains ?? Is anyone else facing this problem ??
     
  11. Asmall71187

    Asmall71187 Newbie

    Joined:
    Aug 8, 2016
    Messages:
    15
    Likes Received:
    2
    Gender:
    Male
    Hey guys. getting a message that says "incorrect command line." Is this still working?
     
  12. andrew1978

    andrew1978 Regular Member Premium Member

    Joined:
    May 13, 2012
    Messages:
    411
    Likes Received:
    24
    Gender:
    Male
    Occupation:
    Internet Marketer
    Home Page:
    this helped me out, i just tried today and got 77k in quick time
    thanks for the share
     
  13. Sweetfunny

    Sweetfunny Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 13, 2008
    Messages:
    1,747
    Likes Received:
    5,039
    Location:
    ScrapeBox v2.0
    Home Page:
    crazyflx has not been online in a couple of years, which is a shame he was a great guy. But he made this way back in 2010 when ScrapeBox didn't have such a feature however now ScrapeBox does this and a lot more with 13 suggest sources like Amazon, Ebay, Wikipedia, Google Play, YouTube etc. See here http://www.scrapebox.com/keyword-scraper
     
  14. Joseph Lich

    Joseph Lich BANNED BANNED Premium Member

    Joined:
    Nov 25, 2015
    Messages:
    402
    Likes Received:
    78
    He had four powerful server scraping list and had unique way remove duplications. crazyflx is very crazy.

    Where is the guy?