1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Web Scraping

Discussion in 'Black Hat SEO' started by phyregold, Jul 28, 2010.

  1. phyregold

    phyregold Newbie

    Joined:
    Jul 10, 2010
    Messages:
    11
    Likes Received:
    0
    Can anybody recommend a good web scraping product? All I really want it to do is go to any website i point it at, scrape all the links and the description that goes with the link and write it out to a file.
     
  2. glew

    glew Junior Member

    Joined:
    Feb 10, 2008
    Messages:
    141
    Likes Received:
    93
    You are going to have a tough time finding something like that. Why? Because not all sites are coded the same. Malformed, non-valid html and flash problems just to name a few. You might want to look into screen scraping with imacros. Just do a search and you can find some info out there.