1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

*SICK* ScrapeBox Method for Finding & AUTOMATICALLY GETTING Your Competitors Backlinks

Discussion in 'Black Hat SEO' started by crazyflx, Jun 13, 2010.

  1. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    The first part of what I'm going to share may or may not have been shared somewhere else before (the finding of your competitors backlinks), however the second part, the part that makes this method super sick, HAS NOT been shared elsewhere.

    I'll tell you what the method is going to allow you to do and how you can do it.

    The method will allow you to find all of the backlinks your competitor has (ALL of them) but we're only going to be talking about the ones from blogs, filter them by PR (if you choose to do so) and ALSO then automatically get those very same backlinks for your site! <- Allowing you to match your competition link for link!

    Here is how you do it:

    1. You go into ScrapeBox and select custom footprint. Then, you type in link:domainyourcompetingwith.com

    Then you select harvest. This is going to get all the sites that link back to your competitors site from Google & Bing. Save that list to a .txt file.

    2. Now, go to ScrapeBox Add-Ons and download the ScrapeBox Backlink Checker. This add-on allows you to get all the sites that link back to a domain from Yahoo Site Explorer (which typically shows WAY more backlinks than any other search engine).

    Use that to find the backlinks for the same domain you used in step 1.

    Add these to the .txt file you saved in step 1. Put them all in ScrapeBox and remove duplicate URLs. Save this new list to a .txt file.

    Up until now, you may or may not have known how to do the above. However, the next part is the really cool part.

    3. Go back to ScrapeBox Add-Ons and download the ScrapeBox Blog Analyzer add-on. Open it up, and import the .txt file you just saved. Hit start.

    ScrapeBox will go through every single backlink you just scraped and check them to see if they are a blog that ScrapeBox currently supports commenting on. If it is, it turns green. If it isn't, it turns red. After it is finished, you can "clean" the list by having it remove unsupported sites.

    What you're going to be left with is ALL of the blogs your competitor has backlinks from, and more importantly, they are all capable of being commented on using ScrapeBox!!

    Save that "clean" list to a file, import it as the list of blogs you want to comment on, and then follow the same steps you would normally follow to comment on blogs. Inside of 10 minutes you'll have all your comps blog backlinks (which can be filtered by PR if you'd like) and you'll be able to comment on all of them inside of a twenty minutes (as the list probably won't be HUGE).

    Want to push this even further?? Of course you do, you're on BHW :)

    Every step is the same as above with the exception of one little thing and the addition of an extra step.

    Instead of just using one footprint in your initial harvests (both from SB's regular user interface and then also the backlink checker add-on) you're going to be using a TON of them. Here is what you do to take this to a whole new level.

    First, you're going to harvest all the URLs from AOL, Yahoo, Bing & Google using this footprint:

    site:domainyourcompetingwith.com

    That is going to return ALL the currently indexed pages of the domain. Remove duplicate URLs and save that to a .TXT file.

    Now, you're going to add the following in the front of each of those URLs:

    link:

    Now follow all of the steps as outlined above. What this does is get all of the backlinks to EVERY page of your competitors site.

    Since Yahoo Backlink Checker is only capable of grabbing the first 1k URLs from Yahoo (as that is all Yahoo allows you to view) you might have missed out on a decent amount of blog backlinks if they were past the first 1k results. So doing the above extra steps means that each new page of the site you check for backlinks means a new and different set of a list of backlinks that is potentially 1k links long.

    Now that you know how to find, filter and steal your competitors backlinks, stop reading and go and do it!
     
    • Thanks Thanks x 243
    Last edited: Jun 13, 2010
  2. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    If the list isn't too large, I would also recommend that you use the "manual commenter" module within SB. It only takes a couple of seconds to skim the article and write a relevant comment that is likely to be approved.
     
    • Thanks Thanks x 3
  3. THUNDERELVI

    THUNDERELVI Elite Member

    Joined:
    Sep 12, 2009
    Messages:
    2,202
    Likes Received:
    1,726
    Gender:
    Male
    Location:
    W3
    Damn, that's a super cool trick, many thnx for this and rep given too!

    P.S. Also, this finds blog backlinks from competitor sites which are usually low quality in the eyes of G. Any way to find other backlinks(such as high quality ones)?
     
    • Thanks Thanks x 1
  4. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    Thanks, glad you like it :)

    As for the second part of your comment, I'm not sure what you mean exactly. The first part of the method I outlined gets you ALL the backlinks a site has...all of them. You can then check the PR if you'd like, and filter them that way.

    The second part of my method outlined above simply filters ALL of the sites backlinks to just backlinks that they have from blogs. All blog backlinks are not low quality in the eyes of Google...some maybe, but not every blog out there is a low quality backlink.

    Care to elaborate so I can maybe provide a better answer?
     
    • Thanks Thanks x 1
  5. THUNDERELVI

    THUNDERELVI Elite Member

    Joined:
    Sep 12, 2009
    Messages:
    2,202
    Likes Received:
    1,726
    Gender:
    Male
    Location:
    W3
    You gave me the answer I wanted, thnx again, sorry I didn't read carefully, I thought this trick found only the blog backlinks and not ALL of them!
     
  6. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    It does find all of them (the first part). The second part filters out only the blog backlinks so that you can use ScrapeBox to automatically comment (and therefore get backlinks from) all the same blogs your competitor has backlinks from.

    EDIT: I just re-read what you said and I I think you and I are "on the same page" so to speak.
     
    • Thanks Thanks x 1
  7. nixnash

    nixnash Power Member

    Joined:
    Oct 26, 2009
    Messages:
    581
    Likes Received:
    204
    Occupation:
    Student
    Location:
    BHW
    hi thanks for the share...I just happen to see a hubpage going to first page of google in 14 hours ,this guy joined hubpages just yesterday , keyword receives about 200k exact searches a month with total searches of about 5,800,000 and is also listed in "hub tub".
    Number of links , listed in yahoo explorer are 27k and i checked the pages page rank this morning...all were between PR 1-6(Pages not website) , and best part is product which he is promoting makes $30/sale.

    I have been trying to figure out the footprints he might be using to find smilar blogs...
    Anyways....
    Is there a way to get all his backlinks urls , Thats what i have been trying all morning:D.
    Nix
     
  8. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    I'm not sure if I wrote something wrong in my OP, as you're the second person to ask this question.

    The first step of the method outlined above gets you ALL the backlinks to a site.

    The second part of the method filters out the blog backlinks from all their backlinks so that you can use ScrapeBox to automatically comment (and therefore get backlinks from) all the same blogs the site your competing with has.
     
  9. vickygarg

    vickygarg Power Member

    Joined:
    Jan 25, 2010
    Messages:
    646
    Likes Received:
    531
    nixnash i think it will be tough to find all of them but through his method u can find many.
    Crazyflx thanks for the post. I think what nixnash means is that the hubpage has 27k links in two days and he needs to find it all,idk if its right that a person can create 27k links to one hubpage in two days and get all of them indexed?
    Nixnash what niche is it in, maybe try the same keywords and get more blogs + these two methods can help too.
     
  10. SuperBlackHat

    SuperBlackHat Power Member

    Joined:
    Feb 2, 2009
    Messages:
    576
    Likes Received:
    116
    ima try this out as soon as i get my scrapebox tech issues resolved
     
  11. honeyandthemoon

    honeyandthemoon Regular Member

    Joined:
    Dec 2, 2009
    Messages:
    280
    Likes Received:
    530
    Occupation:
    Designer!
    Location:
    Manchester, UK
    Hey crazyfix

    Thanks for this, looks very promising :) However, I'm using the add-on Backlink Checker and the domain I add finds 8011 backlinks. How do I export all 8011? I click on the 'Show' button, but it only shows me 1000 of them.

    Thanks :)
    Steve.
     
    • Thanks Thanks x 1
  12. dfrancon

    dfrancon Regular Member

    Joined:
    Jan 26, 2009
    Messages:
    287
    Likes Received:
    83
    Good solid info. Thanks for the post!
     
    • Thanks Thanks x 1
  13. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    Hey steve, no problem, I'm glad you like the share.

    To answer your question, I'm afraid I'll have to redirect you back up to my OP as I actually mention that problem in there.

    Go back up and re-read whats under "want to take this even further?" (it's in bright red).
     
    • Thanks Thanks x 1
  14. honeyandthemoon

    honeyandthemoon Regular Member

    Joined:
    Dec 2, 2009
    Messages:
    280
    Likes Received:
    530
    Occupation:
    Designer!
    Location:
    Manchester, UK
    Ah, I see, thanks very much :) I didn't get that far into the original post as I didn't want to get ahead of myself too quickly, just try the initial idea before taking it that step further ;) Thanks for clearing that up, I'll give you rep if I can also, this could help a great deal :)

    Steve.
     
    • Thanks Thanks x 1
  15. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    I appreciate it Steve, thanks. Also, just as a sidenote for you (and anybody else reading this) it isn't an error with ScrapeBox that it can't scrape more than the first 1k results from Yahoo Site Explorer (Yahoos backlink checker) it is simply the way Yahoo is set up.

    Even if you go to Yahoo Site Explorer yourself manually, you won't be able to view more than the first 1k results.

    That's the main reason for checking the backlinks to all indexed pages of their site, because there will be plenty of others that you couldn't see on the first list that you'll see on other lists.

    Any competitor that requires actual competition to outrank is doing deeplinking...and you want those links too :)
     
  16. honeyandthemoon

    honeyandthemoon Regular Member

    Joined:
    Dec 2, 2009
    Messages:
    280
    Likes Received:
    530
    Occupation:
    Designer!
    Location:
    Manchester, UK
    You've been really in depth about this method, so I appreciate it ;)

    Rep was given, as promised, thanks once more for a very interesting looking method :)

    Steve.
     
    • Thanks Thanks x 1
  17. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    Again, you're welcome :) I hope you're able to put it to good use. As for me being in depth, that's what sharing a real method is all about ;)
     
    • Thanks Thanks x 1
  18. Dayum

    Dayum BANNED BANNED

    Joined:
    Mar 22, 2010
    Messages:
    271
    Likes Received:
    90
    Thanks very useful, quick question though when finding links for all the pages of your competitor, can you just put in "link:" into the custom footprint, then import the websites into the keyword box? Or do we have to go through and harvest each page individually in the custom footprint box, like "link:competitor.com/1" then harvest, then once completed do "link:competitor.com/2"
     
    • Thanks Thanks x 1
  19. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    Here is literally, the step-by-step way that I do it:

    Step 1: harvest from all 4 search engines using footprint -> site:domainimcompetingwith.com Remove duplicate URLs. Save to .TXT file.

    Open .TXT file in microsoft excel. Move the entire column of URLs one column to the right. I type link: into the first top left hand corner cell of excel (cell A1). I copy that. I highlight all the cells beneath it and hit paste.

    I then select all the cells with content in from in both column A and column B (column A should have "link:" in it and column B should have all your harvested page URLs in them). I then copy those and paste it into notepad. Then, I use "find replace" in notepad to replace all the blank spaces in between link: and the URLs (its a tab character).

    Now I have all the pages of the site I'm competing with in this format:

    link:domain.com/page1
    link:domain.com/page2
    link:domain.com/page3

    I then paste that list into ScrapeBox, select custom footprint and hit harvest. ScrapeBox will automatically move from each custom footprint you put in after it has harvested all the available results for each one. So no, you don't have to manually do each one, one-by-one.

    Then, I put that same list into the Yahoo Backlink Checker add-on within the ScrapeBox Add-On's and hit harvest.

    Hopefully that all made sense. If it doesn't, literally do one step at a time as you read it.
     
    • Thanks Thanks x 11
    Last edited: Jun 14, 2010
  20. pk_69

    pk_69 Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 3, 2010
    Messages:
    701
    Likes Received:
    388
    Location:
    Interwebz
    Thanks crazyfix, great share.
    a little twist on your second part - once you harvest all your competitors backlinks you can trim them to the root first and then find backlinks to domain by adding link: to the each domain - this will give way more results than backlinks to each individual page
    you can use either way depending on your need.

    pk
     
    • Thanks Thanks x 1
    Last edited: Jun 14, 2010