Discussion in 'BlackHat Lounge' started by Akita, Mar 19, 2010.
Not how many are indexed by g00gle or yah00 but how many are in total...
Welcome to the Forum
The easiest way would be to use a sitemap builder. Either offline or online.
The best online sitemap builder would have to be : http://www.xml-sitemaps.com/
Offline : http://gsitecrawler.com/
If the site doesn't have that many pages, you can use something like the xml-sitemaps option. But I believe they have a limit of 500 pages. Otherwise use the offline gsitecrawler. Personally i use that for my sites with 2k+ pages and there is no problems (Does take a while to process however).
Using sitemap generators will only work if you have a good linking structure between all the pages. If they are simple auto generated on the fly every view, then it may not work so well. Or if the pages are "Orphan" pages and are not linked to from other parts on your site. Then you won't be able to use a sitemap generator to find the number of pages out.
If this is the case. I think you would be a bit stumped. Short of you actually owning the site (I'm assuming not), then there isnt anything external you can do to count them.
spider it yourself.
try this.. open Google..type in.... site:anysitename.com
Dont put www ot http in there.. just as shown.
when you click search, google will show you a list of all pages on that site..
kewl,,because sometime it shows way more than is on the site itself.
Separate names with a comma.