sitemap tool needed

[Claudiu]

hi,

i'm looking for a tool that can generate a sitemap of other people's websites.

the sitemap tool that i'm looking for should not try to connect to the pages, but just provide me the links to the website's pages.

i need to skip the connectivity part and grab only the sitemap, as it takes to long for me to analyze the websites that way.

your input would be appreciated

 

[remmaps]

did you try with some of online generators like xml-sitemaps.com for example? you can download Sitemap in text file

 

[hunghtq]

Just googling! Here you are: http://www.xml-sitemaps.com

 

[thetraveller]

I found sitemapdoc.com more stable, but still limited to 500 pages.

 

[Claudiu]

yeah, 500 limit is also an issue ... i need to be able to crawl 50k

 

[Toples]

i think you will not find any free tool that will crawl 100k...

 

[Claudiu]

i think you will not find any free tool that will crawl 100k...

well, not an online one .. (tho i know of one, issue with it is that it crawls for connectivity, which is something i need to be skipped as it takes to much time), but a dektop one will sure do. at least i hope so.

if not a dektop one, maybe a php,asp, etc one

 

[Sven84]

If you know PHP, it's pretty easy to output a sitemap file with that. Plus, sitemap files are also limited to 50k urls.

 

[remmaps]

gsitecrawler (dot) com

you can export in txt. it is pretty fast

 

[llewopsnimajneb]

Scrapbox can do it

site:www.thedudessite.com

no keyword