1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[Scrapebox] Harvester with proxies, not working across 4 VPS's

Discussion in 'Black Hat SEO' started by skohh, Jun 18, 2012.

  1. skohh

    skohh Regular Member

    Joined:
    Sep 27, 2010
    Messages:
    341
    Likes Received:
    70
    So guys, sorry if I missed it, tried to search but I am having serious problems scraping with scrapebox across many different PC's / Installs. I can scrape fine with no proxies, but even after a fresh harvest of proxies, nothing seems to be working. Anyone else experiencing this?
     
    • Thanks Thanks x 1
  2. CyberknightTully

    CyberknightTully Junior Member Premium Member

    Joined:
    Feb 19, 2010
    Messages:
    136
    Likes Received:
    148
    Occupation:
    "Retired" and TIRED of it! Going to work for ME!
    Location:
    The Superstition Mountains Looking For The Lost Du
    You are being a cheapskate! No insult intended but the free proxies are already done to death by the time you find them. You also have to check the proxies before you use them to find out whether or not they are already banned by the God of The Internet you worship. I not only recommend Scrapebox but I use it myself and I am a heretic, not bowing down to that "God".

    I hate G**gle.

    Tully.
     
  3. LakeForest

    LakeForest Supreme Member

    Joined:
    Nov 11, 2009
    Messages:
    1,269
    Likes Received:
    1,802
    Location:
    Location Location
    Go easy on the lad!

    Nothing wrong at all using public/free proxies to scrape with, I find a LOT of good ones to use, but OP, you have to test the proxies first and only use google passed ones.

    Lately I've actually been thinking that the proxies that simply turn out as Anonymous can be used to scrape with and the fact they don't google pass is either they're temp blocked or it's a false negative.

    When things went wrong and the developers had to make updates because of the proxy issue, almost no proxy would google pass, though a decent amount would be labeled Anonymous, and I was able to scrape using the Anonymous proxies that failed the google test.

    SB is both great for/with proxies and very stubborn, which I guess is why I like it so much.
     
    • Thanks Thanks x 1
  4. CyberknightTully

    CyberknightTully Junior Member Premium Member

    Joined:
    Feb 19, 2010
    Messages:
    136
    Likes Received:
    148
    Occupation:
    "Retired" and TIRED of it! Going to work for ME!
    Location:
    The Superstition Mountains Looking For The Lost Du
    Yes indeed! Sorry to have come off so tough but it has been an interesting day here around my place and I am a bit stressed, so therefore perhaps a bit intolerant. Thank you for your advice and apologies to the OP!

    Tully.
     
  5. skohh

    skohh Regular Member

    Joined:
    Sep 27, 2010
    Messages:
    341
    Likes Received:
    70
    Not being a cheapskate, if I have to buy proxies to scrape I will. I thought the general rule of thumb was to scrape with public and post with private?
     
  6. CyberknightTully

    CyberknightTully Junior Member Premium Member

    Joined:
    Feb 19, 2010
    Messages:
    136
    Likes Received:
    148
    Occupation:
    "Retired" and TIRED of it! Going to work for ME!
    Location:
    The Superstition Mountains Looking For The Lost Du
    Yep, you are right and again, sorry if I read as being tough on you.

    You should harvest as many free proxies as you can but when you do, remember that those proxies are normally good only for the day that you get them or maybe only for a few hours! When you find them, use them fast before one of The Mad Russians bans them! I normally use several hundred freebies to harvest to keep from getting nailed quickly and to get around those which are banned even as I am loading them.

    That may be a bit much for you but I got some deals going in which I need all those things to hide behind and I am using multiple licenses with mulitple instances on big assed Windows boxes.

    LOL!

    Tully.
     
  7. BigFatWallet

    BigFatWallet Power Member

    Joined:
    May 21, 2010
    Messages:
    705
    Likes Received:
    927
    Although it is advised to use public proxies for scraping but I don't want to go through the whole process of testing the public proxies again and again so I use about 50 private proxies for scraping without any issues of them getting banned + scraping with private proxies is much faster compared to public proxies that are used by thousands of people at the same time.
     
    • Thanks Thanks x 1
  8. CyberknightTully

    CyberknightTully Junior Member Premium Member

    Joined:
    Feb 19, 2010
    Messages:
    136
    Likes Received:
    148
    Occupation:
    "Retired" and TIRED of it! Going to work for ME!
    Location:
    The Superstition Mountains Looking For The Lost Du
    What you have written is another way to go at it but I don't like to use the same set of paid proxies to harvest and post. I have seen many problems there but again, I'm running multiple instances.

    Tully.
     
  9. BigFatWallet

    BigFatWallet Power Member

    Joined:
    May 21, 2010
    Messages:
    705
    Likes Received:
    927
    I'm using these private proxies to harvest and post across 3 different VPS without any issues whatsoever. :)

    Could you please elaborate a bit more on what sort of issues do you face while scraping and posting with the same set of private proxies?
     
  10. CyberknightTully

    CyberknightTully Junior Member Premium Member

    Joined:
    Feb 19, 2010
    Messages:
    136
    Likes Received:
    148
    Occupation:
    "Retired" and TIRED of it! Going to work for ME!
    Location:
    The Superstition Mountains Looking For The Lost Du
    I have found that using the same privates to scrape and post results in the proxies being banned in scrape mode by the Big G and then successful posting numbers go to shit. G also quickly shuts down the privates in scraping mode which yields shitty numbers. This only my experience and may not apply to others but this is what I have found.

    Tully.
     
  11. BigFatWallet

    BigFatWallet Power Member

    Joined:
    May 21, 2010
    Messages:
    705
    Likes Received:
    927
    Yeah the proxies may get banned if you are scraping 24x7, however I don't think using proxies that are banned by G for scraping the shit out of their serps would make a difference to the posting success rate.
     
  12. Junkfood00

    Junkfood00 Elite Member

    Joined:
    Sep 13, 2011
    Messages:
    1,949
    Likes Received:
    1,336
    Same here, I'm unable to scrape Google with proxies (only). I've tried several sources and it's the same thing. Something must be off in the configuration. Can someone help?
     
  13. oreilly2311

    oreilly2311 Regular Member

    Joined:
    May 19, 2009
    Messages:
    219
    Likes Received:
    117
    Also having the same issue here. When scraping without proxies on my VPS it works fine. But using the proxies doesn't return any results. Whats up? :S
     
  14. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,384
    Likes Received:
    1,801
    Gender:
    Male
    Home Page:
    If it works without proxies, and it doesn't work with proxies, its easy. Its the proxies. Plain and simple. The request that gets passed thru the proxies is the same request that gets passed without proxies. So the proxies are either not working in general, aka dead. Or the IP is banned. If they passed the proxy test then the IP is banned for whatever you are trying to scrape. I made a video about it a couple months back, see here:

    [video=youtube_share;P9CbGhfc1aY]http://youtu.be/P9CbGhfc1aY[/video]
     
  15. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,384
    Likes Received:
    1,801
    Gender:
    Male
    Home Page:
    Also a general harvesting video in which I cover the vast majority of common harvesting issues.

    [video=youtube_share;2QaLWgTXsRo]http://youtu.be/2QaLWgTXsRo[/video]


    I have scraped tens of millions of urls in the past few days alone from google, using both private and public proxies. Including multiple instance on multiple servers scraping with proxies from google as I type this message. It works fine, check the vids.
     
  16. arnoldblack

    arnoldblack Newbie

    Joined:
    Sep 3, 2010
    Messages:
    32
    Likes Received:
    2
    might be a country specific issue, based in asia i have been unable to get any free proxies to work, private shared proxies still work fine though.
     
  17. Junkfood00

    Junkfood00 Elite Member

    Joined:
    Sep 13, 2011
    Messages:
    1,949
    Likes Received:
    1,336
    As I said, I tried tons of proxy sources, forums, sites, lists, including proxygo's proxies (free ones). Something must be wrong, I believe it's something else. Also the manager says all proxies are google passed.
     
  18. Junkfood00

    Junkfood00 Elite Member

    Joined:
    Sep 13, 2011
    Messages:
    1,949
    Likes Received:
    1,336
    Ok, please forget about this shit. It must be the proxies, people are hitting them harder than before. But how come SB marks them as google passed?
     
  19. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,384
    Likes Received:
    1,801
    Gender:
    Male
    Home Page:
    I answer this exact question in the video I posted above, but Ill post it again. :)

    The issue is there are LOTS of different kinds of google IP bans, and while 1 type of query can ban an IP, another type of query will still deliver results for the same IP.

    The proxy checker only checks for 1 type of query, not all of them, so you could be getting "passed" but its actually banned for the type of query you want to use. If you search this forum, you can see this discussed a hundred times, which is why I made the video. If the proxy checker tested for all types of queries, the sheer volume of people testing for some of the types of queries, would block the proxies for those types. So you could never use them, as they would all be blocked just from the testing.

    Here is the vid
    http://www.youtube.com/watch?v=P9CbGhfc1aY&feature=player_embedded

     
    • Thanks Thanks x 1
    Last edited by a moderator: May 18, 2016
  20. zee007

    zee007 Senior Member

    Joined:
    Jun 25, 2012
    Messages:
    806
    Likes Received:
    95
    Location:
    Texas
    Hi Everyone,

    So I went ahead and bought scrapebox after reading all the positive reviews on this forum.

    It worked great a for a few hours, but then it suddenly wouldent harvest anything from Google (without any error message). I thought it must have been due to public proxies. So I went ahead and bought some private ones. The problem still remains. I try to harvest for a simple keyword in Google and I get back 0 results with no errors. It only works when I dont use any proxies.

    Whats going on here?

    Any suggestions from the BHW community?

    Cheers!