1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

need a tool open all website pages

Discussion in 'Black Hat SEO Tools' started by sidaz, Sep 18, 2010.

  1. sidaz

    sidaz Regular Member

    Joined:
    Jan 25, 2010
    Messages:
    381
    Likes Received:
    104
    I want to get all website pages which are not indexed by google

    website.1.html
    website.2.html
    .....
    and so on
     
  2. bbrez1

    bbrez1 Power Member

    Joined:
    Feb 21, 2009
    Messages:
    675
    Likes Received:
    2,360
    I don't get it. You need a tool that opens all pages on a website that are not indexed by google?
     
  3. sidaz

    sidaz Regular Member

    Joined:
    Jan 25, 2010
    Messages:
    381
    Likes Received:
    104
    I need a tool that could make
    website.1.html
    website.2.html
    .....
    and so on list, i know http://www.xml-sitemaps.com/ but that make list from indexed pages from google
     
  4. myapps43

    myapps43 Regular Member

    Joined:
    Mar 17, 2010
    Messages:
    320
    Likes Received:
    405
    First do a basic google site search:

    Code:
    site:targetwebsite.com
    
    This gives you pages that are indexed by google. If you cant find what you are looking for then try:

    Code:
    http://targetwebsite.com/robots.txt
    This doesnt work all the time but sometimes it gives you pages on the site that are not indexed. I have gotten some valuable Clickbank products this way. Hope this helps!
     
  5. lvsniper

    lvsniper Registered Member

    Joined:
    Aug 15, 2010
    Messages:
    76
    Likes Received:
    9
    Xenu's Link Sleuth

    google that, i cant post the url