Hey guys I am looking for a tool or website that will scrape a site and input all the pages that site contains...any ideas? I have looked around but found nothing... -Turbo
If you're running Windows, just like CyberWizard mentioned: + http://www.httrack.com/ If you're running MacOSX (even iPhone version), try: + http://www.sitesucker.us/home.html If you're running Linux or BSD, try: + http://www.gnu.org/software/wget/ If you're actually trying to extract specific parts of a certain website, try using iMacros (http://www.iopus.com/iMacros/)
Some of these are good...but I am looking for something basic...something that just scrapes the site and give u a list of links/pages within it....anything else?
If you know some php - i could give you my classes i programmed once. with those classes it is a breeze to create any scraper and data analyzer you need. Let me know via PM if you are interested. Cheers catman
I'm currently in the process of doing the same thing with Website Ripper Copier. You can export a list of files. Are you just wanting the URL's? If so, just go online and create a sitemap and use that as your site. Try this: http://www.microsystools.com/products/sitemap-generator/faq/unlimited-sitemap-generator-pages/
