1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrapebox Proxy Question

Discussion in 'Black Hat SEO Tools' started by jb2008, Jan 1, 2011.

  1. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    I've always scraped Yahoo only because of the need for proxies when scraping Google, but for some reason Yahoo is messing up with me giving 403 errors all over the place. I am wondering if this is due to the Yahoo API change which is due, er, today.

    Anyway, whatever the case, I need to scrape Google as Yahoo doesn't appear to allow special characters such as those with accents. Or as I said it may just be Yahoo shutting down altogether.

    For Google I need proxies but I have always found that I get a REALLY shitty success rate in terms of the number of keywords successfully completed at the end of a harvest, even with the excellent proxies from proxygo, then tested/filtered in SB and high latency proxies removed. The public proxies just seem to die to easily. Even when I use around 600 working proxies all with latency of under 1000 (!! ) I still get most of my keywords in the red (not completed).

    Now my question is, if a proxy dies mid-keyword, or even at the beginning of a keyword, shouldn't the proxy be rotated and the same keyword be scraped again, until completion? Because I seem to be getting a hell of a lot of red 'not completed' keywords in Google when this darn thing should be rotating. How can you say the harvest is 'completed' when 85% of the keywords are not done due to proxies either dying or timing out?
     
  2. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    anyone?
     
  3. rigoleta

    rigoleta Newbie

    Joined:
    Nov 10, 2010
    Messages:
    32
    Likes Received:
    4
    Occupation:
    web designer, web developer, webmaster affiliate
    Location:
    Romania
    I am interested in this subject too as I have bad results with Google when harvesting using public proxies, or it harvest too little than it should or not at all when results should be.
     
  4. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,295
    Likes Received:
    8,715
    u would have thought if the proxie died mid keyword search
    it would switch to the next live proxies and continue
    rinse and repeat - as i dont use scrapebox as a tool only
    a tester im guessing if the proxie fails mid scrape its going
    to the next proxie and keyword ? if thats so
    its a fix need for s/box to roate the keyword only after a successful
    scrape not because the proxie died -- agreed ?
     
  5. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    YES - that's exactly what I was thinking.

    At the moment it just seems to go to the next keyword, leaving the previous keyword not complete.
     
  6. gregstereo

    gregstereo Elite Member

    Joined:
    Oct 5, 2009
    Messages:
    1,833
    Likes Received:
    1,027
    Occupation:
    I'm known to locate certain things from time to ti
    Location:
    Moose Factory, ON
    If I remember correctly, the proxy management cycles to the next working proxy on fail when doing its magic in just about every sbox operation.

    That said, I have read a bit lately about certain goog operations in sbox having some funkiness...not related to proxies per se, or even really an sbox bug, as much as another time goog changed something up...just a post I saw today about some probs with goog searches using...dammit I can't remember, certain operators...I'll take a look and see if I can find the post, unless another one of the helpers can recall.

    peace - gregs.
     
  7. proxygo

    proxygo Jr. VIP Jr. VIP Premium Member

    Joined:
    Nov 2, 2008
    Messages:
    10,295
    Likes Received:
    8,715
    well least that asnwers its not
    the proxies i do or u would have
    said something greg
     
  8. jb2008

    jb2008 Senior Member

    Joined:
    Jul 15, 2010
    Messages:
    1,158
    Likes Received:
    972
    Occupation:
    Scraping, Harvesting in the Corn Fields
    Location:
    On my VPS servers
    No bro your proxies are great, but even your proxies die from time to time ;) Especially when they're doing very, very heavy lifting.