1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Hrefer too slow?

Discussion in 'Black Hat SEO' started by evilartemis, Apr 23, 2012.

  1. evilartemis

    evilartemis Junior Member

    Joined:
    May 30, 2009
    Messages:
    155
    Likes Received:
    13
    Hi, I'm using the built-in proxies that can be scraped by Hrefer, and using those in Hrefer to scrape for forums. However I notice that after 9 days, I only have 10,000 links scraped! Is this the normal speed? I'm running on a BHS VPS.

    Additionally, the keyword phrase currently being harvested usually have a [RETRY 3] or [RETRY #] beside it and isnt getting any links or going to any pages. What is happening here? Thanks!
     
  2. ziplack

    ziplack Senior Member

    Joined:
    Feb 18, 2010
    Messages:
    1,193
    Likes Received:
    603
    Location:
    BHW
    if u are getting RETRY 3]
    its that your proxys are not good enough
     
  3. evilartemis

    evilartemis Junior Member

    Joined:
    May 30, 2009
    Messages:
    155
    Likes Received:
    13
    Do you use private proxies for Hrefer? Seems to be that they'll be banned by Google pretty fast? If so, how many Hrefer threads can I run with 12 private proxies?
     
  4. ziplack

    ziplack Senior Member

    Joined:
    Feb 18, 2010
    Messages:
    1,193
    Likes Received:
    603
    Location:
    BHW
    this its what i do
    i take a list of about 4-5k working proxys
    added to xproxy.txt
    and let it run it
    in about 10-12 hours i stop it
    close hrefer
    change the proxys
    and start again
    Also when u are using footprints like inurl:whatever
    proxys get banned faster by google.