1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Hrefer - Proxy/VPN solution?

Discussion in 'Black Hat SEO Tools' started by Ambassy, Oct 16, 2011.

  1. Ambassy

    Ambassy BANNED BANNED

    Joined:
    Apr 13, 2011
    Messages:
    642
    Likes Received:
    163
    Basically I've come to realize that I can't live with public proxies. What are the options for hrefer?
    I mean how many private proxies would I need to run hrefer 6 hours a day?

    I've heard about using VPN and changing proxies every 10 minutes. Would that work? If so, what VPN should I use?
     
  2. marrrko

    marrrko Jr. VIP Jr. VIP

    Joined:
    Oct 10, 2009
    Messages:
    3,895
    Likes Received:
    1,610
    Location:
    Good Old Europe
    Home Page:
    I using each day more than 100 proxies, and i want to rise that number, because xrefer is a beast :)
     
  3. Ambassy

    Ambassy BANNED BANNED

    Joined:
    Apr 13, 2011
    Messages:
    642
    Likes Received:
    163
    Are you using private, shared or public proxies?
     
  4. 2makemoney

    2makemoney Regular Member

    Joined:
    Oct 10, 2011
    Messages:
    434
    Likes Received:
    92
    Location:
    USA
    I sent you a pm. Free VPN

    VPNOD is giving away free vpn and it located in USA 30mbp connection so it is extreamly fast for a free service.
     
  5. marrrko

    marrrko Jr. VIP Jr. VIP

    Joined:
    Oct 10, 2009
    Messages:
    3,895
    Likes Received:
    1,610
    Location:
    Good Old Europe
    Home Page:

    All of them are private, because if you using shared especially public proxies your success rate will be pretty lower.
    In my case it was lower for 40%
     
  6. Ambassy

    Ambassy BANNED BANNED

    Joined:
    Apr 13, 2011
    Messages:
    642
    Likes Received:
    163
    It might be a rookie question but can I change ip's when I'm on a VPN by using a tool like angry IP scanner?

    Where do you buy your proxies? And how long can you harvest without getting banned? (and at what speed)

    Thanks for your answers btw.
     
  7. 2makemoney

    2makemoney Regular Member

    Joined:
    Oct 10, 2011
    Messages:
    434
    Likes Received:
    92
    Location:
    USA
    That would make it even slower. that Like using a proxy to connect to another proxy. It increase unnecessary connections.
     
  8. Ambassy

    Ambassy BANNED BANNED

    Joined:
    Apr 13, 2011
    Messages:
    642
    Likes Received:
    163
    Okay but how would a VPN help me when using hrefer then? I mean isn't it just 1 ip? I'd assume it would get banned within minutes.
     
  9. flintR

    flintR Newbie

    Joined:
    Oct 16, 2011
    Messages:
    27
    Likes Received:
    1
    why dont you buy shared ip list ?
    its cost you less, good for hrefer i think,

    VPN is usually give you 1-10max IP
     
  10. Ambassy

    Ambassy BANNED BANNED

    Joined:
    Apr 13, 2011
    Messages:
    642
    Likes Received:
    163
    But how many proxies will I need to succesfully harvest urls a few hours every day?
     
  11. rickstar

    rickstar Elite Member

    Joined:
    Dec 9, 2009
    Messages:
    1,979
    Likes Received:
    871
    Home Page:
    Here's a good article about VPN providers. I would typically either recommend HMA, StrongVPN or iVPN.

    Code:
    http://torrentfreak.com/which-vpn-providers-really-take-anonymity-seriously-111007/
     
  12. Ambassy

    Ambassy BANNED BANNED

    Joined:
    Apr 13, 2011
    Messages:
    642
    Likes Received:
    163
    Thanks I read it through. However I still don't understand why a VPN is needed? I mean isn't a VPN just like 1 proxy? Won't it get banned by google within minutes?
     
  13. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    Hardcore hrefer harvesting won't work with a VPN. I harvest using 1000 threads maxed out. Does about 40 mbps. I use a list of about 2000 G passed public proxies.

    You are gonna have to live with public proxies, because getting private proxies in such volumes is extremely expensive.
     
  14. Ambassy

    Ambassy BANNED BANNED

    Joined:
    Apr 13, 2011
    Messages:
    642
    Likes Received:
    163
    Thanks for your answer.
    Would you mind roughly telling me where you're getting your proxies from? When I proxy cvheck from sites such as scrapeboxproxies . net I only get around 100-150 working proxies per day.
     
  15. kinox

    kinox Registered Member

    Joined:
    Jan 30, 2010
    Messages:
    59
    Likes Received:
    6
    Location:
    The Shire
    2000? Leave some proxies for the rest of us! :) Seriously though, that is pretty hardcore after all...
     
  16. kokoloko75

    kokoloko75 Elite Member

    Joined:
    Jan 1, 2011
    Messages:
    1,628
    Likes Received:
    1,935
    Occupation:
    Design director
    Location:
    Paris (France)
    With Hrefer I use only public proxies, around 500-1000 Google Passed (IP Test).
    Results are excellent, Hrefer is so fast.

    Here some tips to get good proxies :

    Use proxies daily provided in Proxy section of BHW :
    Code:
    http://www.blackhatworld.com/blackhat-seo/f103-proxy-lists/
    Explore ProxyFire forum to get a bit more :
    Code:
    http://www.proxyfire.net/
    To find sources for scraping proxies, try this footprint on Google :
    Code:
    inurl:"/proxyc/engine.php"
    Then, choose one result and change in URL "engine.php" by "list.txt".

    These are the simplest ways.
    Good luck !

    Beny