1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Needing This........

Discussion in 'Black Hat SEO' started by LameO, Apr 10, 2013.

  1. LameO

    LameO Newbie

    Joined:
    Jul 16, 2012
    Messages:
    35
    Likes Received:
    3
    I am needing a scraper/rss scraper that can go to any website and scrape/put to a feed the contents of that site. I have found several that can make a rss feed from a singal page, but I would need it to do the following:


    1. I would go to a specific website and search for articles using a specific keyword and the results would be similar to this

    Article 1
    Brief Desc
    Link to Full Article

    Article 2
    Brief Desc
    Link to Full Article

    .
    .
    .
    Article 10
    Brief Desc
    Link to full Article

    Page 1 of 250

    2. I need a program to where I can enter the the URL of the search above into it and it will either scrape or make a rss feed.

    3. The kicker is I want it to follow the Links to the full articles and scrape/make a feed to them. So in the example above it would be able to pull 2500 full articles into a feed.


    Similar to how WPROBOT works, but I need it to work for a specific site.


    Sorry I am not very knowledgeable about this type of stuff, so any help is appreciated!!
     
  2. mikeydell

    mikeydell Senior Member

    Joined:
    Dec 16, 2012
    Messages:
    870
    Likes Received:
    499
    You should look at
    Code:
    [URL]http://magpierss.sourceforge.net/[/URL]
    Ive used that in quite a few projects, easy to work with as well.
     
  3. LameO

    LameO Newbie

    Joined:
    Jul 16, 2012
    Messages:
    35
    Likes Received:
    3
    Thanks I downloaded it and looking at it now!