1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

google is indexing and deindexind me. how?

Discussion in 'Link Building' started by icemusike, Jan 3, 2010.

  1. icemusike

    icemusike BANNED BANNED

    Joined:
    Oct 22, 2008
    Messages:
    161
    Likes Received:
    71
    hello friends, i ahve a serious problem over here. you see google is messing witrh me. he is indexing me , deindexing and so on
    well i got indext my main page but not completly only the link.. no description no title. aldough i did put everything right with seo all in one plugin for wordpress
    next day a post from my site was indexed realy nice when i searched " site:domain.info there i was a new post idnexed, next day it was no more, copuple of days later another post idnexet good, now its deindexed. how come?? i mean what could it be the problem? why arent all my pages get idnext when the botts are crawling my website?

    my robots.txt are now like so: are there good?

    Code:
    User-agent: *
    Allow: /
    Disallow: /cgi-bin
    Disallow: /wp-admin
    Disallow: /wp-includes
    Disallow: /wp-content
    Disallow: /search/*/feed
    Disallow: /search/*/*
    
    User-agent: Mediapartners-Google
    Allow: /
    
    User-agent: Adsbot-Google
    Allow: /
    
    User-agent: Googlebot-Image
    Allow: /
    
    User-agent: Googlebot-Mobile
    Allow: /
    
    #User-agent: ia_archiver-web.archive.org
    #Disallow: /
    
    Sitemap: http://www.askapache.com/sitemap.xml
    
    i submited the sitemap all that it seems like yahoo has indexed 2 pages of mine same way. and why does bots wont idnex htem all i mean ai add fresh content every day like 10 posts.
    how can i get crawled more often?
    can anyone tell me some good hints? i tryed like all i could find her on bhw about seo.
     
  2. BruceW4yne

    BruceW4yne Newbie

    Joined:
    Apr 1, 2008
    Messages:
    47
    Likes Received:
    2
    Move the section for all bots to the bottom, it could cause confusion. See below.

    Code:
    User-agent: Mediapartners-Google
    Allow: /
    
    User-agent: Adsbot-Google
    Allow: /
    
    User-agent: Googlebot-Image
    Allow: /
    
    User-agent: Googlebot-Mobile
    Allow: /
    
    #User-agent: ia_archiver-web.archive.org
    #Disallow: /
    
    User-agent: *
    Allow: /
    Disallow: /cgi-bin
    Disallow: /wp-admin
    Disallow: /wp-includes
    Disallow: /wp-content
    Disallow: /search/*/feed
    Disallow: /search/*/*
    
    Sitemap: http://www.askapache.com/sitemap.xml
    Also, I don't know if User-Agent: Allow is proper usage. From Google's site the way to allow adsense bot access is like this:

    Code:
    User-agent: Mediapartners-Google
    Disallow:
    
    I've been having the same problems with the Google dance.