1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

1st silly Hrefer question

Discussion in 'Black Hat SEO Tools' started by fad3r, Apr 6, 2012.

  1. fad3r

    fad3r Power Member

    Joined:
    Sep 17, 2011
    Messages:
    733
    Likes Received:
    115
    Location:
    nyc
    I have finally moved on to studying xrumer (really hard to gather up documentation to learn from if u dont speak russian).

    When scraping proxies with hrefer are you guys using sock or http and are you using the default source that it comes with or is there a better one I should be aware of.

    Thanks in advance.
     
  2. TheBacklinkProdigy

    TheBacklinkProdigy BANNED BANNED

    Joined:
    Apr 1, 2012
    Messages:
    70
    Likes Received:
    136
    Default source has been working great for me for a long time so I would use them there's really no need at all to spend the extra money on private proxies to harvest urls. Just use the main source & you're good to go :)
     
  3. shakemelikeapig

    shakemelikeapig Junior Member

    Joined:
    Dec 10, 2009
    Messages:
    153
    Likes Received:
    27
    the default is used by everyone. why do I want to use it? like the default lists..
     
  4. fad3r

    fad3r Power Member

    Joined:
    Sep 17, 2011
    Messages:
    733
    Likes Received:
    115
    Location:
    nyc
    When I try to use the default it doesn't even do anything. It just sits there says the last update was 11/27/11. Maybe something on my end. I guess I could reinstall hrefer. It scrapes fine just won't gather proxies
     
  5. shakemelikeapig

    shakemelikeapig Junior Member

    Joined:
    Dec 10, 2009
    Messages:
    153
    Likes Received:
    27
    pretty sure something is on your end. you need proxies to get better results!
     
  6. kokoloko75

    kokoloko75 Elite Member

    Joined:
    Jan 1, 2011
    Messages:
    1,628
    Likes Received:
    1,935
    Occupation:
    Design director
    Location:
    Paris (France)
    Botmaster didn't update their proxy sources.
    You'll not find public sources with a good amount of valid proxies...

    You should use public proxies posted on BHW or use a service like Proxygo does (daily proxy lists checked for Google scraping).

    Beny
     
    • Thanks Thanks x 1
  7. fad3r

    fad3r Power Member

    Joined:
    Sep 17, 2011
    Messages:
    733
    Likes Received:
    115
    Location:
    nyc
    So you are saying the default link for scraping proxies in hrefer no longer works?
     
  8. kokoloko75

    kokoloko75 Elite Member

    Joined:
    Jan 1, 2011
    Messages:
    1,628
    Likes Received:
    1,935
    Occupation:
    Design director
    Location:
    Paris (France)
    The default links are old and not updated in recent versions of Hrefer.
    It seems that it's not the priority of BotmasterLabs...

    Beny
     
    • Thanks Thanks x 1
  9. 0_00_0

    0_00_0 Senior Member

    Joined:
    Oct 7, 2010
    Messages:
    1,024
    Likes Received:
    486
    Location:
    Canada
    I use scrapebox to gather a huge list of proxies and plug them into Hrefer. I then tell it not to automatically look for new ones I was never a fan of its proxy functionality.
     
  10. fad3r

    fad3r Power Member

    Joined:
    Sep 17, 2011
    Messages:
    733
    Likes Received:
    115
    Location:
    nyc
    I just reinstalled Hrefer and still the default source seems broken it says starting and never seems to go anywhere. The rest of it works fine just the proxy scraping seems not to work. I already have proxies via buy proxies maybe I will just use those instead.
     
  11. kokoloko75

    kokoloko75 Elite Member

    Joined:
    Jan 1, 2011
    Messages:
    1,628
    Likes Received:
    1,935
    Occupation:
    Design director
    Location:
    Paris (France)
    Yes, don't use proxy source refresh.
    Personally I use static lists, and after few hours I stop scraping, get a fresh proxy list, and resume the scraping process.

    Beny
     
    • Thanks Thanks x 1
  12. marrrko

    marrrko Jr. VIP Jr. VIP

    Joined:
    Oct 10, 2009
    Messages:
    3,895
    Likes Received:
    1,610
    Location:
    Good Old Europe
    Home Page:
    The best solution for me at this moment is VPN... there is a ton of them on the web and you can SPAM every month another one.. ;)
     
    • Thanks Thanks x 1
  13. fad3r

    fad3r Power Member

    Joined:
    Sep 17, 2011
    Messages:
    733
    Likes Received:
    115
    Location:
    nyc

    Thanks you are very helpful
     
  14. fad3r

    fad3r Power Member

    Joined:
    Sep 17, 2011
    Messages:
    733
    Likes Received:
    115
    Location:
    nyc
    The answer is here: http://en.botmastersupport.com/showthread.php?t=2945 it is def something on botmaster's side so whoever it is working properly is wrong. It is a well known issue.
     
  15. dealfindersmd

    dealfindersmd Newbie

    Joined:
    Aug 24, 2011
    Messages:
    35
    Likes Received:
    0
    I have my Herefer through Black Hat Solutions VPS (the vps that comes with all of the SEO tools installed), and as such they do not give us access to the specific login for out VPS for obvious reasons. Could you please be so kind and simply tell me what that forum post said?
     
  16. Tealk

    Tealk Newbie

    Joined:
    Oct 18, 2009
    Messages:
    1
    Likes Received:
    0
    fad3r, i'm native russian, and a newbie in xrumer. If you have other questions - i try to answer
     
  17. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    Use:

    1. Proxygo
    2. hidemyass daily lists
    3. Scrapebox internal proxies

    Combine them, remove duplicates using notepad++ textfx tools, test in proxymultiply. Don't check Google passed proxies, just anonymous. You will have 1-2k good proxies to harvest Google with. Use 4:1 proxy:thread harvesting ratio. Save file as xproxy.txt in hrefer folder. Uncheck in proxy settings the option to regularly check for proxies. You will be doing manual replacement of proxies which will require rechecking of above 3 sources every 24-48 hours and you must close hrefer and re-open for your new xproxy.txt file to take effect.
     
    • Thanks Thanks x 2
  18. lantingdx

    lantingdx Newbie

    Joined:
    Jan 11, 2013
    Messages:
    4
    Likes Received:
    0
    I also buy proxy, but i dont know how to use it into hrefer. Can you help me solve it?
     
  19. cooooookies

    cooooookies Senior Member

    Joined:
    Oct 6, 2008
    Messages:
    1,008
    Likes Received:
    216
    Dont waste your time with public proxies, really. There are many reasons why they suck.

    Do you know btw the >> poor man's XRumer<< ? It was announced somewhere some while ago: you open a public proxy server and change the requests slightly: whenever a POST request (form) is done, you change the links inside to your sites. Funny, right?