need a tool open all website pages
- Thread starter sidaz
- Start date
sidaz
Regular Member
- Jan 25, 2010
- 403
- 108
I need a tool that could make
website.1.html
website.2.html
.....
and so on list, i know http://www.xml-sitemaps.com/ but that make list from indexed pages from google
website.1.html
website.2.html
.....
and so on list, i know http://www.xml-sitemaps.com/ but that make list from indexed pages from google
myapps43
Regular Member
- Mar 17, 2010
- 357
- 421
First do a basic google site search:
This gives you pages that are indexed by google. If you cant find what you are looking for then try:
This doesnt work all the time but sometimes it gives you pages on the site that are not indexed. I have gotten some valuable Clickbank products this way. Hope this helps!
Code:
site:targetwebsite.com
Code:
http://targetwebsite.com/robots.txtThis doesnt work all the time but sometimes it gives you pages on the site that are not indexed. I have gotten some valuable Clickbank products this way. Hope this helps!
