1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Best Way to Index Pages in a Site

Discussion in 'White Hat SEO' started by yasin10, Jul 5, 2010.

  1. yasin10

    yasin10 Registered Member

    Joined:
    Jan 6, 2010
    Messages:
    99
    Likes Received:
    15
    Location:
    c:\home\infront_of_pc\working_internet
    Hi

    What the Best Way to Index Pages from a site.?

    The Site is already Indexed in Google But some of the pages are not :eek:

    How Can i Index my unindex pages in the site?

    Thanks.
     
  2. sksugo

    sksugo Junior Member

    Joined:
    Jun 13, 2010
    Messages:
    121
    Likes Received:
    18
    i have the same problem as you.. My privacy policy and about us page is indexed and some of my main pages are not!!
     
  3. bizroot

    bizroot Supreme Member

    Joined:
    Feb 25, 2008
    Messages:
    1,346
    Likes Received:
    914
    Location:
    In My Computer
    Submit your sitemap to search engines and ping them... You can use your webmaster section for it... Bookmarking is also another good option for fast indexing... You can also use in-linking to get it done...
     
  4. xboxps3wow

    xboxps3wow Power Member

    Joined:
    Jan 15, 2010
    Messages:
    737
    Likes Received:
    239
    Occupation:
    student
    Location:
    Chicago
    Get some high PR links to those pages and it will be indexed. Ping that page you get a link on and it will be almost instant. I use one website and it took 8 minutes to index a new website.
     
  5. niayoos

    niayoos Registered Member

    Joined:
    Jun 28, 2010
    Messages:
    82
    Likes Received:
    2
    Also you can try to post the links in some forums that the links are ****************
     
  6. ultimategamechain

    ultimategamechain Power Member

    Joined:
    Apr 22, 2010
    Messages:
    528
    Likes Received:
    76
    Location:
    Here!
    bookmark your pages and also check your sitemap and submit it to google.
     
  7. strictnein

    strictnein Newbie

    Joined:
    Feb 17, 2009
    Messages:
    10
    Likes Received:
    4
    I don't think I can post links yet, so check out:
    google webmaster tools
    bing webmaster tools
    yahoo site explorer

    Add your sitemaps, check out if you have any issues, add your RSS feeds, etc.
     
    • Thanks Thanks x 1
  8. myshoeslace

    myshoeslace Regular Member

    Joined:
    Nov 4, 2009
    Messages:
    272
    Likes Received:
    27
    Gender:
    Female
    Occupation:
    Freelancer
    Location:
    India
    Place all the internal links in some directories or blog or forums.

    also submit sitemap in webmasters tool!
     
  9. ipopbb

    ipopbb Power Member

    Joined:
    Feb 24, 2008
    Messages:
    626
    Likes Received:
    844
    Occupation:
    SEO & Innovative Programming
    Location:
    Seattle
    Home Page:
    I give 75% odds that adding canonical tags to every page fixes this problem.

    25% that your site is too slow and googlebot slows down to not be a denial of service.

    Googlebot quits when the dupe to non-dupe ratio favors dupes. This makes googlebot think it has most of the content and its just in infinite loops on your site.

    The other way googlebot quits is when the crawl efficiency becomes too low over a period of time. Page response times are vital... A really good performance benchmark for your server is the difference and % difference of a page's load time versus a static html page load time on the same server. This makes relative adjustments for your location's bandwidth as well as your server's bandwidth. This ratio is what googlebot sees when your server is not under load... if you can find a load testing tool configure it for 11 simultaneous connections and crawl the site... This is twice max googlebot crawl speed, but lets assume you have users other than googlebot... this load will simulate peak volumes of about 250K visitors per day. If your site gets too slow... googlebot removes crawl speed options from webmaster tools and doesn't give them back until you make your site faster.

    With static HTML and canonical tags I was able to get googlebot to visit 300K pages in under 5 weeks. Google estimated I had 750K pages but their math is wrong. I also make reports when indexing a new site to show me which pages still haven't been visited by googlebot yet according to the referer logs. This helps me find and fix any bugs or quirks in site design that prevent googlebot from visiting everypage... example... once I found that having "items per page" at the top of my category pages short-circuited gbot's crawl of my categories... Making them nofollow doesn't stop googlebot. I moved the links to the bottom of the page and kept them visually in the same place with css and googlebot started crawling whole categories without interruption.


    Note: the bastard stepchild MSNBot does not use compression and will infinite loop your site for hours at a time... If googlebot visits your site while MSNBot is DOS'ing it then googlebot will assume your site is fucked and leaves. If you can't fix page load times you will be far better off blocking MSNBot from robots.txt
     
    Last edited: Jul 5, 2010
  10. SilentFox

    SilentFox BANNED BANNED

    Joined:
    May 16, 2010
    Messages:
    157
    Likes Received:
    11
    bookmark your site or links with diggs...diggs can help your site to get index fast...some people said few minutes...my experience is less than one day...if lucky less than 1 hour...

    the important thins is bookmark it...settle...
     
  11. backlinkbooster

    backlinkbooster Newbie

    Joined:
    Jul 5, 2010
    Messages:
    3
    Likes Received:
    0
    Occupation:
    SEO - Virtual Assistant
    Location:
    Philippines - Ozamis City
    If you're site is not yet index by Google try to apply some link building strategy. You can do either social bookmarking submission, profile linking and other link building strategy. Also, if you want that your sub-pages will be index as well, during promotion be sure to include the external pages as well.
     
  12. konst666

    konst666 Registered Member

    Joined:
    Apr 18, 2010
    Messages:
    83
    Likes Received:
    19
    Use ScrapeBox and make 50-100 backlinks to each page
     
  13. seosuperman

    seosuperman Newbie

    Joined:
    May 4, 2010
    Messages:
    44
    Likes Received:
    5
    I can't remember the URL but there is a UK site that will ping your site to help the search engines find it. It was free when I used it.