View All Pages of a website ?

mtime88

Regular Member

Mar 10, 2008

329

84

• Dec 13, 2009

• #1

I am looking for a tool that will list all the urls on a specific website or page.

 

I

Iwona

Junior Member

Nov 22, 2009

156

3

• Dec 13, 2009

• #2

https://siteexplorer.search.yahoo.com/

I hope this will help you.

 

mtime88

Regular Member

Mar 10, 2008

329

84

• Dec 14, 2009
• Thread Starter Thread Starter

• #3

that will only work if the site is indexed i believe

 

N

nat.soft

Junior Member

Aug 17, 2009

110

42

• Dec 14, 2009

• #4

Does that website you are looking for have a sitemap, if so, you can see all the pages. Try searching google "url + sitemap" maybe.

 

M

machiko999

Newbie

Dec 9, 2009

13

28

• Dec 14, 2009

• #5

try intelitamper

but it won't work if they asking password for such member area

 

homenet

Senior Member

Jan 5, 2009

982

504

• Dec 14, 2009

• #6

Failing that you could try using web reaper

Code:

http://www.webreaper.net/

 

sikandar

Supreme Member

Mar 15, 2008

1,296

1,150

• Dec 14, 2009

• #7

Most free online tools for analyzing metatags or spider simulator also display all links from the page. You can also download HTTrack Website copier to copy the website to your hard disk.