1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to add Yandex, Baidu and AOL in Scrapebox

Discussion in 'Black Hat SEO' started by Sburator, Jan 17, 2017.

  1. Sburator

    Sburator Newbie

    Joined:
    Jun 28, 2016
    Messages:
    39
    Likes Received:
    4
    Gender:
    Male
    Location:
    DACIA FELIX
    Hello,

    Is there any way to add Yandex, Baidu and AOL search engines in Scrapebox?

    I've seen Yandex and AOL were present in some older Scrapebox versions, but they are not available anymore.

    Thank you very much.
     
  2. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,729
    Likes Received:
    1,995
    Gender:
    Male
    Home Page:
    I don't know of any prebuilt engines, I can tell you if they aren't there its because they either can't be or its not practical. AOL used to be constantly changing its format and would break scrapebox literally every few days, requiring an engine update.

    Either Baidu could only get like the first page because future pages were protected with javascript or internal redirects. Yandex blocks non javascript requests (which is what scrapebox uses due to raw sockets and threads) after as little as 1 request. So if you wanted to scrape thru 10 pages of Yandex for the term Car, you would need to burn thru 10 proxies. So it would requires tens of thosuands of working proxies to accomplish anything of note with Yandex.

    So basically its just not practical.
     
    • Thanks Thanks x 1
  3. Sburator

    Sburator Newbie

    Joined:
    Jun 28, 2016
    Messages:
    39
    Likes Received:
    4
    Gender:
    Male
    Location:
    DACIA FELIX
    Now I see.

    Thank you very much for your help.
     
  4. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,729
    Likes Received:
    1,995
    Gender:
    Male
    Home Page: