1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How do you find out how many pages a website has ?

Discussion in 'BlackHat Lounge' started by Akita, Mar 19, 2010.

  1. Akita

    Akita Newbie

    Joined:
    Mar 10, 2010
    Messages:
    4
    Likes Received:
    20
    Occupation:
    Merchandiser
    Not how many are indexed by g00gle or yah00 but how many are in total...:)
     
  2. pyronaut

    pyronaut Executive VIP

    Joined:
    Dec 9, 2008
    Messages:
    1,229
    Likes Received:
    1,425
    Welcome to the Forum :)

    The easiest way would be to use a sitemap builder. Either offline or online.

    The best online sitemap builder would have to be : http://www.xml-sitemaps.com/

    Offline : http://gsitecrawler.com/

    If the site doesn't have that many pages, you can use something like the xml-sitemaps option. But I believe they have a limit of 500 pages. Otherwise use the offline gsitecrawler. Personally i use that for my sites with 2k+ pages and there is no problems (Does take a while to process however).

    Using sitemap generators will only work if you have a good linking structure between all the pages. If they are simple auto generated on the fly every view, then it may not work so well. Or if the pages are "Orphan" pages and are not linked to from other parts on your site. Then you won't be able to use a sitemap generator to find the number of pages out.

    If this is the case. I think you would be a bit stumped. Short of you actually owning the site (I'm assuming not), then there isnt anything external you can do to count them.
     
  3. TheLoser

    TheLoser Registered Member

    Joined:
    Feb 5, 2009
    Messages:
    72
    Likes Received:
    13
    spider it yourself.
     
  4. gazinbali

    gazinbali Registered Member

    Joined:
    Nov 5, 2009
    Messages:
    69
    Likes Received:
    5
    try this.. open Google..type in.... site:anysitename.com

    Dont put www ot http in there.. just as shown.
    when you click search, google will show you a list of all pages on that site..
    kewl,,because sometime it shows way more than is on the site itself.

    Gazinbali