Web Scraping

Discussion in 'Black Hat SEO' started by phyregold, Jul 28, 2010.

  1. phyregold

    phyregold Newbie

    Joined:
    Jul 10, 2010
    Messages:
    11
    Likes Received:
    0
    Can anybody recommend a good web scraping product? All I really want it to do is go to any website i point it at, scrape all the links and the description that goes with the link and write it out to a file.
     
  2. glew

    glew Junior Member

    Joined:
    Feb 10, 2008
    Messages:
    141
    Likes Received:
    93
    You are going to have a tough time finding something like that. Why? Because not all sites are coded the same. Malformed, non-valid html and flash problems just to name a few. You might want to look into screen scraping with imacros. Just do a search and you can find some info out there.