1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scraping Y Answers... does it work in big?

Discussion in 'Black Hat SEO' started by cooooookies, Apr 6, 2009.

  1. cooooookies

    cooooookies Senior Member

    Joined:
    Oct 6, 2008
    Messages:
    1,008
    Likes Received:
    216
    Hi,

    I want to use the Y answers api to get Q and A in mass. Does anyone here have experience how many posts I can steal until my Y api id gets banned? Or can you buy Y api ids?

    Thanks,
    cooooookies
     
  2. detox1978

    detox1978 Junior Member

    Joined:
    Jan 16, 2009
    Messages:
    110
    Likes Received:
    33
    It's not stealling, they created the API for this very purpose.

    When I setup scrapper (3 months ago), I read the limit was 5,000 per day. That should be more than enough.

    If you really want more, setup additional API ID's - they are free.
     
  3. cooooookies

    cooooookies Senior Member

    Joined:
    Oct 6, 2008
    Messages:
    1,008
    Likes Received:
    216
    Thanks detox. I want to build up a content database, so I need many more, but 5k sounds quite good for starting.
     
  4. detox1978

    detox1978 Junior Member

    Joined:
    Jan 16, 2009
    Messages:
    110
    Likes Received:
    33
    That's 5k per day, how many posts did you want?

    Can I ask what you have in mind for them ?
     
  5. cooooookies

    cooooookies Senior Member

    Joined:
    Oct 6, 2008
    Messages:
    1,008
    Likes Received:
    216
    Exactly. Not more and not less.

    Actually, my PLR articles - have many of them - are mostly crap and I am looking for better content to fill my autoblogs. Are there legal issues when using those Q/A? My host is based in luxembourg.
     
  6. detox1978

    detox1978 Junior Member

    Joined:
    Jan 16, 2009
    Messages:
    110
    Likes Received:
    33
    You need to read the Yahoo API T&C's, it's really short (one page i think from memory).

    All they ask is for a text link "Powered by Yahoo! Answers" to be displayed on your website.
     
  7. jimbobo2779

    jimbobo2779 Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 17, 2008
    Messages:
    3,245
    Likes Received:
    2,397
    Occupation:
    Software Engineer
    Location:
    UK
    Home Page:
    Its not 5k a day its 5k search requests daily and that can add up to, with max of 100 results per query, 500k questions and answers daily. Im sure you could probably deal with this daily limit lol.

    Don't forget though that not all searches will return 100 results but 5k requests is enough for any webhost to start complaining about B/W lol. Some of those results can be pretty dang large guys so take that into consideration.

    This is from someone who uses Yahoo APIs daily, the Q&A API can return some large XML.

    Jim
     
  8. detox1978

    detox1978 Junior Member

    Joined:
    Jan 16, 2009
    Messages:
    110
    Likes Received:
    33
    Yeah, 5,000 requests per day.


    If you want to make more than 5,000 requests it's quite easy;

    "Yahoo! Web Search web services are limited to 5,000 queries per IP per day per API"

    http://developer.yahoo.com/answers/
     
  9. cooooookies

    cooooookies Senior Member

    Joined:
    Oct 6, 2008
    Messages:
    1,008
    Likes Received:
    216
    Thanks guys, this is great. I will flood the web :)