1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Browsing non-indexed site?

Discussion in 'Black Hat SEO' started by Micah Rutter, Jul 13, 2017.

  1. Micah Rutter

    Micah Rutter Newbie

    Joined:
    Nov 24, 2016
    Messages:
    21
    Likes Received:
    5
    Gender:
    Male
    I'm trying to find a way to get a list of all the pages of a site that aren't indexed.

    I tried the site:(url) method

    And I tried to do the method where you put one letter of the alphabet from abcdefjhijklmnopqrstuvwxyz.

    I also tried finding a sitemap.xml - no luck with that...

    I tried Xenu Link Sleuth and that didn't bring up anything.

    Any ideas?

    Thanks!

    - MIcah
     
  2. Nargil

    Nargil Jr. VIP Jr. VIP

    Joined:
    May 10, 2012
    Messages:
    4,629
    Likes Received:
    2,973
    Location:
    Europe
    Home Page:
    Go to Scrapebox, scrape the same site until your eyes bleed, then run all URLs through index checker. Done.
     
  3. jojoofu

    jojoofu Newbie

    Joined:
    Jul 12, 2017
    Messages:
    8
    Likes Received:
    0
    Gender:
    Male
    Occupation:
    Free Lancer
    Location:
    USA
    If you own the site then you can register for webmaster tools for the major search engines google and bing. You can use their tools to send out a crawl bot to index everything. I'm assuming that's what you're trying to do.