1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Constant 999 Error With Yahoo Site Explorer

Discussion in 'Black Hat SEO' started by hispdcha, May 31, 2011.

  1. hispdcha

    hispdcha Regular Member

    Joined:
    May 24, 2011
    Messages:
    289
    Likes Received:
    133
    Hey all,

    I am new to SB but I have read and read these forums to get a good idea on how to use it, plus videos. I am constantly getting error 999 in Yahoo Site Explorer. Here is my setup:

    $35 VPS from XSserver
    55 Private Proxies From Squidproxies
    Low connections set to 5 on YSE.

    Now, I have a huge list of URL's I have to run through YSE, currently around 1 million. I have broken this list into 20k URL's each and start harvesting backlinks from YSE using the Backlink Extractor Addon.

    After about 30 to 40 minutes in, I am getting error 999. I have waited a good 24 hours before doing it again and I still get the same error roughly within the same time frame of 30 to 40 minutes.

    Do I need more proxies? Is Squidproxies at fault here as they have switched my proxies once already and still getting the same problem? Again, I have my connections only set to 5 to keep it minimal with 55 private proxies. Why am I still getting 999 after just 30 minutes??

    Thanks for any help!!
     
  2. homenet

    homenet Power Member

    Joined:
    Jan 5, 2009
    Messages:
    790
    Likes Received:
    338
    Location:
    Dimension X
    You need more proxies simple as that. The 999 error is a temporary IP block. Trying to run 1 million url's through YSE is a bad idea, your going to need a shit load of proxies for that.

    My advice: split the list down into 4 x 250,000 lists and see how you get on with that.
     
    • Thanks Thanks x 1
  3. Patel

    Patel Senior Member

    Joined:
    Mar 1, 2011
    Messages:
    1,116
    Likes Received:
    1,503
    Location:
    On the coast
    or just get YahooBossApp
     
  4. hispdcha

    hispdcha Regular Member

    Joined:
    May 24, 2011
    Messages:
    289
    Likes Received:
    133
    What is Yahoo Boss App? Is that a program to have access to the Yahoo API?
     
  5. hispdcha

    hispdcha Regular Member

    Joined:
    May 24, 2011
    Messages:
    289
    Likes Received:
    133
    Homenet

    How many proxies are you thinking? It freezes after just checking 5k to 10k links on a 5 thread connection.

    YSE is a major bottleneck for me right now, I need to find a way to fix this problem asap! :)
     
  6. flyingbear

    flyingbear Junior Member

    Joined:
    Mar 7, 2011
    Messages:
    195
    Likes Received:
    19
    it is because your IP sent too many query to yahoo. either slows down, or, use more proxies. no other way to get around this.
     
  7. homenet

    homenet Power Member

    Joined:
    Jan 5, 2009
    Messages:
    790
    Likes Received:
    338
    Location:
    Dimension X
    truthfully, I wouldnt know how many proxies you would need, usually I start getting the 999 error after around 15 attempts from a single IP.

    What you could do is set the connections down to 1 or 2 on the backlink checker. It will require an overnight job to get through those url's (maybe longer) but you shouldn't get the 999 error.
     
    • Thanks Thanks x 1
  8. hispdcha

    hispdcha Regular Member

    Joined:
    May 24, 2011
    Messages:
    289
    Likes Received:
    133
    Thanks for the advice. That just seems extremely tedious. I guess I need to go slower, but dang that's going to take a long time with so many backlinks to scrub. Do you have any better suggestions?

    Here is what I am doing:

    I harvest a few AA links and then I go on those pages and get all external links using the addon.

    Once I have all of the commenters websites harvested I will then use the site:website footprint to get all of their indexed pages.

    After getting their indexed pages, I am usually left with hundreds of thousands of pages to send through the YSE backlink extractor in order to scrub their AA comments. I then scrub this list against previous lists so I can trim it down and not waste time on URL's I have already scraped.

    Then I am left with a few hundred thousand links to send through YSE. Is there any other way to get those backlinks off of a website than through YSE?

    Thanks for any advice, and I gave you some thanks for answering my previous questions. :)
     
  9. homenet

    homenet Power Member

    Joined:
    Jan 5, 2009
    Messages:
    790
    Likes Received:
    338
    Location:
    Dimension X
    I'm afraid I don't know of any other site that does what YSE does, it's the one thing that slows down my scrapebox effort though and it's a pain in the ass.

    If anyone has another solution I'd love to hear it though.