1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How fast do you collect links in hrefer?

Discussion in 'Black Hat SEO Tools' started by lagrimas175, Feb 21, 2010.

  1. lagrimas175

    lagrimas175 Regular Member

    Joined:
    Sep 4, 2009
    Messages:
    277
    Likes Received:
    442
    Occupation:
    I work on the computer.
    Location:
    Tokyo, Japan
    I made a post about how fast you can post links with xrumer... but what about hrefer?

    Recently I added an additive word list from someone which brought my total words up to 674.

    I'm doing an hrefer collection run on 1000+ keyword list (mostly based around computer programming) and here are the results so far:

    Total links collected: 202,374
    Filtered Duplicated Hosts: 9329889

    Parsing time (so far): 1 day, 1 hour.

    It has only reached 9 of those blue blocks on the status meter so I assume it has a long ways to go until it reaches the end.

    Is this normal? How fast are you guys able to get your linklists using hrefer? Is my hrefer being super slow? Is there any way to speed it up?

    Thanks!
     
  2. dzoniij

    dzoniij Regular Member

    Joined:
    May 24, 2009
    Messages:
    469
    Likes Received:
    111
    Your proxy list probably is bad. I do not use proxy for hrefer never... ( I have soft which change IP automatically every 10 minutes) I recently tried to harvest forum list got 700K list in one hour. Harvested half million blog list in 10 minutes and 8 million list in 3 days. Initially harvesting go fast but then it starts to filter out many many duplicates and that's why harvesting go slower.
    Of course very important is word list. If used words are not so popular harvesting goes much slower.
     
  3. mrtenev

    mrtenev Junior Member

    Joined:
    Jan 22, 2008
    Messages:
    125
    Likes Received:
    23
    It all depends on your internet connection speed and also if you are using proxies or not. I am on a dynamic ip so I don't use any proxies with hrefer. I am able to get more than 100k unique forums for 8-9 mins.
     
  4. reinie

    reinie Elite Member

    Joined:
    Jan 16, 2009
    Messages:
    1,574
    Likes Received:
    1,040
    It depends on your proxies, internet speed and your PC.
    I had Hrfer on a shitty laptop and it would take me a week to get that amount of links.

    About a month ago, i got a new 5i with 12 gig ram, and hrefer is FLYING now.

    It never runs more than 30 minutes
     
  5. reinie

    reinie Elite Member

    Joined:
    Jan 16, 2009
    Messages:
    1,574
    Likes Received:
    1,040
    oh...and i use proxies