1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrape Box Gurus - Massive High PR Blog List But....

Discussion in 'Black Hat SEO Tools' started by cflanagan, Sep 23, 2010.

  1. cflanagan

    cflanagan Newbie

    Joined:
    Apr 17, 2010
    Messages:
    1
    Likes Received:
    0
    Guys,

    First off let me say Scrapebox ROCKS! The more I use it the more things I can use it for. The best $50 you'll ever spend (I have 4 Licenses on 4 machines.. hehe)

    Ok, so here's the problem. I am pretty much a scrape master, even before SB came along. Not that long ago I scraped a huge list of blogs, sorted them by category and by PR.

    So now I have a list of these blogs (Root domain only). Now I want to know how I might scrape for comment boxes on a KNOWN list of URL's. This would be the equivalent of using the (Site: [Domain] Keyword) feature except on thousands of blogs at different domains.

    For Example: In the "Technology" Topic I have
    PR10 - 4 Sites
    PR9 - 44 Sites
    PR8 - 103 Sites
    PR 7 - 360 Sites
    PR5 - 1682 Sites
    PR4 - 2508 Sites
    PR 3 - 2050 Sites

    Now before you go saying that's ez.. I ONLY have the root domain which is itself not necessarily a postable / commentable page. Ergo, I need to look for the blogfootprint within the site.. You dig? I.e. need to find a commentable page.

    So rather than just using the keyword scraper to find the first 1000 blogs on the SE's (many of which will have low pr's of course) , I want it to find them from a KNOWN SET of domains.

    Closest I've come to is setting up a custom Google search, (This will allow me to search ONLY a known set of domains) but it's not a perfect solution.

    Any ideas?
     
  2. mark0v

    mark0v Junior Member

    Joined:
    May 6, 2010
    Messages:
    114
    Likes Received:
    20
    if I'm reading this correctly, I think you've almost answered your own question :)

    take your list of domains in notepad and replace "http" with "site:http"
    copy/paste that list into the keywords
    start harvesting.
    that should return up to 1000 pages for each of those blogs. you may want to break that into several groups so that the results are not too large.
    take that list and run it through blog analyzer to find open comment forms etc. or check for PR on each of those pages, etc.

    I think that there is also an addon which reads a sitemap or something from each blog, but I don't know how that works.
     
    • Thanks Thanks x 1
  3. thachcaodotcom

    thachcaodotcom Junior Member

    Joined:
    Oct 21, 2009
    Messages:
    121
    Likes Received:
    151
    Hi,
    How can I get SB for $50 ? Is there a discount for BHW members? I found on their HP it is $97.
    Thanks
     
  4. xinoanet

    xinoanet Regular Member

    Joined:
    Aug 8, 2009
    Messages:
    216
    Likes Received:
    30
    Location:
    Kitchener, Ontario
    Look for the official thread here at BHW
     
  5. Physaux

    Physaux Regular Member

    Joined:
    Sep 21, 2009
    Messages:
    201
    Likes Received:
    618
    I think scrapebox has a feature that you can scrape the sitemap of domains. You could use this on all your domains. Then you could run the blog analyzer, to try to filter pages that can be commented on. Export this list, and sort by PR of individual pages. Tada!
     
  6. turbopugsleylx

    turbopugsleylx Jr. VIP Jr. VIP Premium Member

    Joined:
    Jun 6, 2008
    Messages:
    3,151
    Likes Received:
    965
    Occupation:
    www.xgcmedia.com
    Location:
    www.xgcmedia.com
    Home Page:
    Doesnt the Link extractor addon do this?


    IE looking for internal links will show all the internal pages that he then can PR and blog check?
     
  7. Florist88

    Florist88 Newbie

    Joined:
    Jul 24, 2009
    Messages:
    43
    Likes Received:
    7
    I prefer to use the site: command as you then get the pages which G knows about as opposed to the ones that come off the Scrapebox Sitemap Scraper addon.
    Like the above post mentioned, once you have that list, use the BlogAnalyzer addon to determine which ones you can comment on.

    Split it all up into smaller lists though in case you need to restart due to proxies timing out or any other type of interference.