1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Are shared proxies recommended for Scrapebox harvesting?

Discussion in 'Black Hat SEO' started by FuryKyle, Jun 27, 2011.

  1. FuryKyle

    FuryKyle Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 19, 2010
    Messages:
    2,395
    Likes Received:
    1,369
    Public proxies are a big pain for me. I get like 1% success and by the time I'm done checking, they're dead already. So I was wondering what whether shared proxies are useful?

    I checked Proxy Bonanza and they have 130 proxies for only $40 a month but limited to 30GB bandwidth, and Squid has 100 for $75 but no bandwidth. What do you guys suggest? Go with shared proxies for harvesting or? Thanks :)
     
  2. Autumn

    Autumn Elite Member

    Joined:
    Nov 18, 2010
    Messages:
    2,197
    Likes Received:
    3,041
    Occupation:
    I figure out ways to make money online and then au
    Location:
    Spamville
    For scraping SE results I prefer open proxies because a) you can get hundreds and hundreds of proxies for free and they're always changing and b) you don't want to burn your paid IPs by getting them flagged by Google (and thus getting captchas, limited results etc).

    If you're only getting 1% success then you need to improve your proxy scraping strategy and find better sources of proxies to scrape. There a tons of strategies and sources posted on the board if you hunt around.

    Bandwidth isn't a huge issue when scraping serps because you're generally just fetching text only pages, and Google compresses the fuck out of their pages anyway.

    Paid proxies are a useful but limited stop gap measure, but for really hardcore bulk scraping you either need a good open proxy scraping setup or a LOT of private IPs. Even 100+ IPs is eventually of limited value if you are scraping hard 24/7 using known footprints.
     
    • Thanks Thanks x 1
  3. FuryKyle

    FuryKyle Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 19, 2010
    Messages:
    2,395
    Likes Received:
    1,369