1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Best scrapping tools

Discussion in 'Black Hat SEO Tools' started by capflam, Sep 1, 2009.

  1. capflam

    capflam Junior Member

    Joined:
    Aug 7, 2008
    Messages:
    141
    Likes Received:
    3
    I am looking for scrapping specific pieces of information from various sites in a specific industry.
    I need to know what information they publish everyday.
    Each site I am trying to scrape has its own format. But often have RSS feeds.

    What type of tool can you guys suggest? Or do you know someone that can build one for me?
     
  2. yazzou

    yazzou Registered Member

    Joined:
    Dec 19, 2008
    Messages:
    61
    Likes Received:
    7
    screen scraper is the best for me. Got a server edition and cron, works with php, asp, and other languages
     
  3. Djingel

    Djingel Junior Member

    Joined:
    Apr 9, 2007
    Messages:
    150
    Likes Received:
    84
    does anyone know if its possible to scrape more than one page, and let the script automatically recognize a page two?
     
  4. hotcheats

    hotcheats Regular Member

    Joined:
    Dec 2, 2008
    Messages:
    328
    Likes Received:
    74
    Location:
    EU
    Check dapper.net or openkapow - I think they both can do that, but these are online tools.
     
  5. MDSOperandi

    MDSOperandi Regular Member

    Joined:
    Jul 10, 2009
    Messages:
    224
    Likes Received:
    192
    Occupation:
    Senior Software Engineer / Internet Marketing
    Location:
    Australia
    Home Page:
    Also, on the off chance that you are going to get something built in .NET / C++ the HtmlAgility pack is awesome.

    hxxp://htmlagilitypack.codeplex.com/

    You can use XPath queries to parse HTML documents... I have made extensive use of it to scrape search engine results and the pages from those results.

    Regards
    MDS
     
    • Thanks Thanks x 1
  6. boffmaster

    boffmaster Junior Member

    Joined:
    Jun 1, 2009
    Messages:
    144
    Likes Received:
    32
    How about "google reader"
     
  7. ukescuba

    ukescuba Jr. VIP Jr. VIP Premium Member

    Joined:
    Feb 24, 2008
    Messages:
    994
    Likes Received:
    634
    Occupation:
    Mobile Marketer & QR Code Junkie
    Location:
    San Antonio, TX
    Home Page:
    this looks good - yazzou is this what your talking about???

    Code:
    http://www.screen-scraper.com/