Checking PageRank of over 100,000 domains

Discussion in 'Black Hat SEO' started by n30nGUY, Jun 9, 2012.

  1. n30nGUY

    n30nGUY Newbie

    Joined:
    May 25, 2012
    Messages:
    33
    Likes Received:
    5
    What's the best and quickest way to check over 100,000 domains for PageRank?

    I have Scrapebox, although have moved machine and it hasn't been reactivated yet...
     
  2. iulianh

    iulianh Regular Member

    Joined:
    Feb 3, 2008
    Messages:
    349
    Likes Received:
    502
    Scrapebox and Private Proxies the fastest and cheapest way to do that :)
     
  3. Em][n3m

    Em][n3m Power Member

    Joined:
    Dec 8, 2010
    Messages:
    558
    Likes Received:
    147
    Occupation:
    Student
    Location:
    City of Lost Heaven
    i belive scrapebox with private proxy is the best option
     
  4. xxtoni

    xxtoni Junior Member

    Joined:
    Jul 5, 2010
    Messages:
    172
    Likes Received:
    213
    I would recommend Scrapebox as well but wouldn't go the private proxy route. That can get expensive, especially considering that you want to check 100k, but if speed is a factor go for it.

    Otherwise just get a few hundred public proxies and let it rip.
     
  5. mikeoff

    mikeoff Junior Member

    Joined:
    Dec 15, 2011
    Messages:
    170
    Likes Received:
    32
    I'm using free proxies, works fine with scrapebox as well.
     
  6. n30nGUY

    n30nGUY Newbie

    Joined:
    May 25, 2012
    Messages:
    33
    Likes Received:
    5
    I tried with 10 private proxies and it soon failed. Think I'll probably need around 100 different IPs to cycle through.

    Any idea where I can get freebie proxies from? As long as it finishes within 12hours it'll be cool. Thanks.
     
  7. SuperLinks

    SuperLinks Elite Member

    Joined:
    Jul 14, 2008
    Messages:
    2,903
    Likes Received:
    848
    Location:
    New York
    Ya, private proxies won't work unless you have hundreds.

    Just use public proxies, just make sure you have a couple hundred G passed proxies and you shouldn't have a problem.
     
  8. Fathom

    Fathom Power Member

    Joined:
    Jul 1, 2011
    Messages:
    518
    Likes Received:
    282
    Location:
    Hertfordshire
    Scrapebox and private proxies. You will need to change ip every 5000 - 10000 pagerank requests so you will need 20 private proxies.

    A cheaper alternative is hma pro which has always been effective for myself.

    You should also experiment with loading 10,000 domains into Scrapebox at a time as it seems to scrape the pagerank so much faster.

    If you are looking to purchase pr domains I would recommend using the namejet daily list. You can find bargains when a pr update happens as tools like Registercompass can take a few weeks to update.
     
  9. Fathom

    Fathom Power Member

    Joined:
    Jul 1, 2011
    Messages:
    518
    Likes Received:
    282
    Location:
    Hertfordshire
    Do not use public proxies for scraping mass pagerank, you could miss out on some real gems
     
  10. n30nGUY

    n30nGUY Newbie

    Joined:
    May 25, 2012
    Messages:
    33
    Likes Received:
    5
    I presume Scrapebox will rotate etc as I need automatically. Will get 20 proxies and see how I go, thanks.
     
  11. Aty

    Aty Jr. VIP Jr. VIP

    Joined:
    Jan 27, 2011
    Messages:
    6,140
    Likes Received:
    4,180
    Home Page:
    I checked today with SB about 50k pages with 700 free proxies in about 3 hours.