Constant 999 Error With Yahoo Site Explorer

Discussion in 'Black Hat SEO' started by hispdcha, May 31, 2011.

  1. hispdcha

    hispdcha Regular Member

    Joined:
    May 24, 2011
    Messages:
    290
    Likes Received:
    133
    Hey all,

    I am new to SB but I have read and read these forums to get a good idea on how to use it, plus videos. I am constantly getting error 999 in Yahoo Site Explorer. Here is my setup:

    $35 VPS from XSserver
    55 Private Proxies From Squidproxies
    Low connections set to 5 on YSE.

    Now, I have a huge list of URL's I have to run through YSE, currently around 1 million. I have broken this list into 20k URL's each and start harvesting backlinks from YSE using the Backlink Extractor Addon.

    After about 30 to 40 minutes in, I am getting error 999. I have waited a good 24 hours before doing it again and I still get the same error roughly within the same time frame of 30 to 40 minutes.

    Do I need more proxies? Is Squidproxies at fault here as they have switched my proxies once already and still getting the same problem? Again, I have my connections only set to 5 to keep it minimal with 55 private proxies. Why am I still getting 999 after just 30 minutes??

    Thanks for any help!!
     
  2. homenet

    homenet Senior Member

    Joined:
    Jan 5, 2009
    Messages:
    800
    Likes Received:
    349
    Location:
    Dimension X
    You need more proxies simple as that. The 999 error is a temporary IP block. Trying to run 1 million url's through YSE is a bad idea, your going to need a shit load of proxies for that.

    My advice: split the list down into 4 x 250,000 lists and see how you get on with that.
     
    • Thanks Thanks x 1
  3. Patel

    Patel Jr. VIP Jr. VIP

    Joined:
    Mar 1, 2011
    Messages:
    1,156
    Likes Received:
    1,507
    Location:
    On the coast
    or just get YahooBossApp
     
  4. hispdcha

    hispdcha Regular Member

    Joined:
    May 24, 2011
    Messages:
    290
    Likes Received:
    133
    What is Yahoo Boss App? Is that a program to have access to the Yahoo API?
     
  5. hispdcha

    hispdcha Regular Member

    Joined:
    May 24, 2011
    Messages:
    290
    Likes Received:
    133
    Homenet

    How many proxies are you thinking? It freezes after just checking 5k to 10k links on a 5 thread connection.

    YSE is a major bottleneck for me right now, I need to find a way to fix this problem asap! :)
     
  6. flyingbear

    flyingbear Junior Member

    Joined:
    Mar 7, 2011
    Messages:
    195
    Likes Received:
    19
    it is because your IP sent too many query to yahoo. either slows down, or, use more proxies. no other way to get around this.
     
  7. homenet

    homenet Senior Member

    Joined:
    Jan 5, 2009
    Messages:
    800
    Likes Received:
    349
    Location:
    Dimension X
    truthfully, I wouldnt know how many proxies you would need, usually I start getting the 999 error after around 15 attempts from a single IP.

    What you could do is set the connections down to 1 or 2 on the backlink checker. It will require an overnight job to get through those url's (maybe longer) but you shouldn't get the 999 error.
     
    • Thanks Thanks x 1
  8. hispdcha

    hispdcha Regular Member

    Joined:
    May 24, 2011
    Messages:
    290
    Likes Received:
    133
    Thanks for the advice. That just seems extremely tedious. I guess I need to go slower, but dang that's going to take a long time with so many backlinks to scrub. Do you have any better suggestions?

    Here is what I am doing:

    I harvest a few AA links and then I go on those pages and get all external links using the addon.

    Once I have all of the commenters websites harvested I will then use the site:website footprint to get all of their indexed pages.

    After getting their indexed pages, I am usually left with hundreds of thousands of pages to send through the YSE backlink extractor in order to scrub their AA comments. I then scrub this list against previous lists so I can trim it down and not waste time on URL's I have already scraped.

    Then I am left with a few hundred thousand links to send through YSE. Is there any other way to get those backlinks off of a website than through YSE?

    Thanks for any advice, and I gave you some thanks for answering my previous questions. :)
     
  9. homenet

    homenet Senior Member

    Joined:
    Jan 5, 2009
    Messages:
    800
    Likes Received:
    349
    Location:
    Dimension X
    I'm afraid I don't know of any other site that does what YSE does, it's the one thing that slows down my scrapebox effort though and it's a pain in the ass.

    If anyone has another solution I'd love to hear it though.